00000001:02000400:3.0F:1789130685.130252:0:3300:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg311-server.virtnet: executing set_hostid 00000001:02000400:3.0:1789130693.726884:0:3502:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg311-server.virtnet: executing load_modules_local 00000001:01000000:1.0F:1789130694.743983:0:3565:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 1355 MB/s 00000001:01000000:1.0:1789130694.993844:0:3565:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 1647 MB/s 00000001:01000000:1.0:1789130695.243586:0:3565:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 10355 MB/s 00000020:02000000:3.0:1789130695.602276:0:3594:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_132_gd76390e 00000400:02000000:3.0:1789130696.018530:0:3609:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.203.111@tcp [8/256/0/180] 00008000:02000000:0.0F:1789130699.002067:0:3759:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:0.0:1789130759.854310:0:5727:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg311-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1789130774.235601:0:6477:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1789130774.235610:0:6477:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:1.0:1789130774.235611:0:6477:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1789130774.235774:0:6477:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 0000000003b0b988 00000080:02000400:1.0:1789130774.235788:0:6477:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:1.0:1789130774.248848:0:6477:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200065, mountfl=0 00000020:01000004:1.0:1789130774.248869:0:6477:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1789130774.248924:0:6477:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (000000009fe7a9b3) 00000020:00000080:1.0:1789130774.248952:0:6477:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1789130774.321388:0:6477:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:1.0:1789130774.321514:0:6477:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00080000:01000000:1.0:1789130774.347638:0:6477:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1789130774.349024:0:6477:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1789130774.349036:0:6477:0:(osd_handler.c:8895:osd_obd_connect()) connect #0 00000020:00000080:1.0:1789130774.349053:0:6477:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf3fe2838e1fc1c8c 00000020:01000004:1.0:1789130774.349063:0:6477:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:1.0:1789130774.349071:0:6477:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1789130774.349076:0:6477:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000003b0b988 from MGS 00000020:01000004:1.0:1789130774.349082:0:6477:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1789130774.349097:0:6477:0:(genops.c:413:class_newdev()) Allocate new device MGS (000000005796a79a) 00000020:00000080:1.0:1789130774.349110:0:6477:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1789130774.349376:0:6477:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000003b0b988 from MGS, refs=2 00080000:01000000:1.0:1789130774.349382:0:6477:0:(osd_handler.c:8895:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789130774.349388:0:6477:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf3fe2838e1fc1c9a 00000100:00100000:1.0:1789130774.349846:0:6477:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1789130774.349999:0:6477:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1789130774.350006:0:6477:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0F:1789130774.356701:0:6477:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1789130774.356732:0:6477:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1789130774.357841:0:6477:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789130774.358046:0:6477:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1789130774.358052:0:6477:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1789130774.359146:0:6477:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1789130774.359157:0:6477:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1789130774.361996:0:6477:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1789130774.362013:0:6477:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1789130774.386950:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130774.386959:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130774.386970:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130774.388866:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130774.388873:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130774.388876:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130774.389542:0:6477:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1789130774.392631:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:0.0:1789130774.639677:0:6477:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 3947 MB/s 00000001:01000000:0.0:1789130774.889753:0:6477:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 4175 MB/s 00000001:01000000:2.0:1789130775.144168:0:6477:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 381 MB/s 00000001:01000000:2.0:1789130775.393531:0:6477:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 571 MB/s 00080000:10000000:2.0:1789130775.408806:0:6477:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000040:01000000:0.0:1789130775.427427:0:6477:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:0.0:1789130775.429135:0:6491:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1789130775.429302:0:6477:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1789130775.429360:0:6477:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:1.0:1789130775.429671:0:6477:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1789130775.429696:0:6477:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1789130775.430404:0:6477:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789130775.432308:0:6477:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1789130775.432321:0:6477:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1789130775.437175:0:6477:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1789130775.437204:0:6477:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1789130775.438135:0:6477:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1789130775.438145:0:6477:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1789130775.440424:0:6477:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1789130775.440486:0:6477:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.111@tcp' 00000020:01000004:1.0:1789130775.440489:0:6477:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1789130775.440576:0:6477:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.111@tcp (typ=mgc) 00000100:00080000:0.0:1789130775.440748:0:6495:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:1.0:1789130775.441273:0:6477:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.111@tcp (0000000004f7340b) 00000020:00000080:1.0:1789130775.441298:0:6477:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1789130775.441419:0:6477:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000046ca0fb3@MGC192.168.203.111@tcp: add connection 192.168.203.111@tcp at head 00010000:00010000:1.0:1789130775.443492:0:6477:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.111@tcp-0 is initialized 00000040:01000000:1.0:1789130775.443507:0:6477:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.111@tcp ctxt 1 is initialized 00010000:00010000:0.0:1789130775.444374:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789130775.450665:0:6497:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1789130775.451639:0:6477:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.111@tcp (uuid 3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b) 00000020:00000080:0.0:1789130775.451678:0:6477:0:(genops.c:1385:class_connect()) connect: client 3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b, cookie 0xf3fe2838e1fc1ca8 00000100:00080000:0.0:1789130775.451696:0:6477:0:(import.c:510:import_select_connection()) MGC192.168.203.111@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789130775.451704:0:6477:0:(import.c:624:import_select_connection()) MGC192.168.203.111@tcp: import 0000000046ca0fb3 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:0.0:1789130775.451766:0:6477:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000006b83a6e3 x1876039508689024/t0(0) o250->MGC192.168.203.111@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789130775.451802:0:6477:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b->MGS 00000020:01000004:0.0:1789130775.451838:0:6477:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1789130775.451855:0:6477:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1789130775.451888:0:6477:0:(genops.c:413:class_newdev()) Allocate new device MDS (0000000005ec83cf) 00000020:00000080:0.0:1789130775.451906:0:6477:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1789130775.456485:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006b83a6e3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3624:1876039508689024:0@lo:250: 00000100:00100000:2.0:1789130775.456618:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130775.459004:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508689024 00000100:00100000:1.0:1789130775.459194:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508689024 00000100:00100000:1.0:1789130775.459295:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789130775.459305:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000237cdacb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3624:x1876039508689024:12345-0@lo:250: 00010000:00080000:1.0:1789130775.459341:0:6492:0:(ldlm_lib.c:1482:target_handle_connect()) MGS: connection from 3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b@0@lo t0 exp 0000000000000000 cur 131 last 0 00000020:00000080:1.0:1789130775.459376:0:6492:0:(genops.c:1385:class_connect()) connect: client 3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b, cookie 0xf3fe2838e1fc1cb6 00000100:00080000:1.0:1789130775.459568:0:6492:0:(import.c:65:import_set_state_nolock()) 000000002b0626af : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789130775.459701:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000237cdacb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+5:3624:x1876039508689024:12345-0@lo:250: Request processed in 395us (3082us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130775.459718:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789130775.466885:0:6477:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789130775.467075:0:6477:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1789130775.467081:0:6477:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1789130775.467733:0:3624:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.203.111@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1789130775.467746:0:3624:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.111@tcp: connect to target with instance 0 00000100:00080000:0.0:1789130775.467765:0:3624:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.111@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1789130775.467771:0:3624:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1789130775.467775:0:3624:0:(import.c:65:import_set_state_nolock()) 0000000046ca0fb3 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1789130775.467779:0:3624:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1789130775.467797:0:3624:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1789130775.467806:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006b83a6e3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3624:1876039508689024:0@lo:250: 00000100:00100000:0.0:1789130775.474933:0:6477:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1789130775.474952:0:6477:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1789130775.476294:0:6477:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1789130775.476310:0:6477:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1789130775.493903:0:6477:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789130775.494574:0:6477:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1789130775.494639:0:6477:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1789130775.496022:0:6477:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1789130775.496113:0:6477:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1789130775.590978:0:6477:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789130775.591174:0:6477:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1789130775.591180:0:6477:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1789130775.598782:0:6477:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1789130775.598803:0:6477:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1789130775.601868:0:6477:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789130775.602051:0:6477:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789130775.602056:0:6477:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1789130775.603721:0:6477:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789130775.603731:0:6477:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1789130775.605368:0:6477:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789130775.605604:0:6477:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789130775.605612:0:6477:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1789130775.612514:0:6477:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789130775.612535:0:6477:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1789130775.616571:0:6477:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789130775.616805:0:6477:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789130775.616812:0:6477:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1789130775.618928:0:6477:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789130775.618938:0:6477:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1789130775.663069:0:6477:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789130775.663293:0:6477:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1789130775.663300:0:6477:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1789130775.668486:0:6477:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1789130775.668501:0:6477:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1789130775.670238:0:6477:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1789130775.670251:0:6477:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1789130775.673915:0:6477:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1789130775.673951:0:6477:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:3.0:1789130775.673957:0:6477:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.111@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1789130775.674153:0:6477:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.111@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789130775.674190:0:6477:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.111@tcp, index=0000, flags=0x20065 00000020:01000004:3.0:1789130775.674194:0:6477:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789130775.674196:0:6477:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789130775.674197:0:6477:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789130775.674198:0:6477:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789130775.674199:0:6477:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789130775.674200:0:6477:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789130775.674202:0:6477:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789130775.674203:0:6477:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789130775.674204:0:6477:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789130775.674206:0:6477:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789130775.674207:0:6477:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789130775.674208:0:6477:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789130775.674211:0:6477:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:3.0:1789130775.674213:0:6477:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789130775.674214:0:6477:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789130775.674215:0:6477:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789130775.674216:0:6477:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789130775.674217:0:6477:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789130775.674219:0:6477:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789130775.674220:0:6477:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789130775.674221:0:6477:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789130775.674222:0:6477:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789130775.674223:0:6477:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789130775.674224:0:6477:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789130775.674229:0:6477:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789130775.674263:0:6477:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1789130775.674280:0:6477:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ee79d45e pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6477:1876039508689152:0@lo:253: 00000100:00100000:3.0:1789130775.679408:0:6477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130775.679667:0:6477:0:(client.c:2715:ptlrpc_set_wait()) set 000000007070088b going to sleep for 11 seconds 00000100:00100000:1.0:1789130775.680810:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508689152 00000100:00100000:1.0:1789130775.680823:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508689152 00000100:00100000:1.0:1789130775.680889:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789130775.680898:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cc4e6516 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+5:6477:x1876039508689152:12345-0@lo:253: 20000000:01000000:1.0:1789130775.680969:0:6494:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1789130775.680973:0:6494:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:2.0:1789130775.681493:0:6516:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1789130775.681591:0:6494:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:1.0:1789130775.681859:0:6494:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789130775.684255:0:6517:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:0.0:1789130775.687841:0:6494:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1789130775.687848:0:6494:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:0.0:1789130775.687854:0:6494:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:0.0:1789130775.687857:0:6494:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:0.0:1789130775.687870:0:6494:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:0.0:1789130775.688194:0:6494:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789130775.688448:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:0.0:1789130775.688588:0:6494:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1789130775.688610:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:0.0:1789130775.688624:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:0.0:1789130775.688650:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:0.0:1789130775.688708:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:0.0:1789130775.688716:0:6494:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:0.0:1789130775.688737:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:0.0:1789130775.688743:0:6494:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:0.0:1789130775.688754:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:0.0:1789130775.688758:0:6494:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:0.0:1789130775.688768:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:0.0:1789130775.688782:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:0.0:1789130775.688809:0:6494:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1789130775.688814:0:6494:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:0.0:1789130775.688821:0:6494:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789130775.688915:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:0.0:1789130775.688925:0:6494:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1789130775.688940:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:0.0:1789130775.688952:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:0.0:1789130775.688964:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:0.0:1789130775.688971:0:6494:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:0.0:1789130775.688994:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:0.0:1789130775.689001:0:6494:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1789130775.689014:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:0.0:1789130775.689027:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:0.0:1789130775.689155:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:0.0:1789130775.689168:0:6494:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:0.0:1789130775.689192:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:0.0:1789130775.689200:0:6494:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:0.0:1789130775.689212:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:0.0:1789130775.689240:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:0.0:1789130775.689291:0:6494:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:0.0:1789130775.689309:0:6494:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1789130775.689315:0:6494:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:2.0:1789130775.689872:0:6518:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:0.0:1789130775.690716:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:0.0:1789130775.690741:0:6494:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.111@tcp for mdt 20000000:01000000:0.0:1789130775.690743:0:6494:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.111@tcp (null) (null) (null) 00000040:00080000:0.0:1789130775.690758:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:0.0:1789130775.690776:0:6494:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1789130775.690791:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:0.0:1789130775.690797:0:6494:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.203.111@tcp (null) (null) 00000040:00080000:0.0:1789130775.690809:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:0.0:1789130775.690816:0:6494:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:0.0:1789130775.690829:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:0.0:1789130775.690844:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:0.0:1789130775.690872:0:6494:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:0.0:1789130775.690875:0:6494:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1789130775.690878:0:6494:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1789130775.690924:0:6494:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1789130775.690927:0:6494:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1789130775.694666:0:6519:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:1.0:1789130775.694930:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:1.0:1789130775.694960:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:1.0:1789130775.694975:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 20000000:01000000:1.0:1789130775.694987:0:6494:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1789130775.694990:0:6494:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:3.0:1789130775.699852:0:6520:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:1.0:1789130775.700089:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:1.0:1789130775.700117:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:1.0:1789130775.700132:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:1.0:1789130775.700147:0:6494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789130775.700149:0:6494:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:1.0:1789130775.700155:0:6494:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1789130775.700157:0:6494:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1789130775.700169:0:6494:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:1.0:1789130775.700176:0:6494:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:3.0:1789130775.700712:0:6521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:1.0:1789130775.700814:0:6494:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:1.0:1789130775.720097:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:1.0:1789130775.720143:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:1.0:1789130775.720158:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:1.0:1789130775.720186:0:6494:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1789130775.720280:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000803fd2dc/0xf3fe2838e1fc1cbd lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130775.720302:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000803fd2dc/0xf3fe2838e1fc1cbd lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130775.720314:0:6494:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000803fd2dc/0xf3fe2838e1fc1cbd lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130775.720320:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000803fd2dc/0xf3fe2838e1fc1cbd lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130775.720326:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000803fd2dc/0xf3fe2838e1fc1cbd lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130775.720333:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000803fd2dc/0xf3fe2838e1fc1cbd lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130775.720339:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000803fd2dc already unused, calling callback (00000000eb258dfd) 00010000:00010000:1.0:1789130775.720343:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000803fd2dc/0xf3fe2838e1fc1cbd lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130775.720351:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000803fd2dc/0xf3fe2838e1fc1cbd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130775.720388:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000803fd2dc/0xf3fe2838e1fc1cbd lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130775.720396:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000803fd2dc/0xf3fe2838e1fc1cbd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130775.720401:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000803fd2dc/0xf3fe2838e1fc1cbd lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789130775.720427:0:6494:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1789130775.734660:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cc4e6516 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+5:6477:x1876039508689152:12345-0@lo:253: Request processed in 53756us (60290us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130775.734681:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789130775.735966:0:6477:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ee79d45e pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6477:1876039508689152:0@lo:253: 10000000:01000000:2.0:1789130775.735994:0:6477:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1789130775.735999:0:6477:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789130775.736001:0:6477:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789130775.736002:0:6477:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789130775.736003:0:6477:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:2.0:1789130775.736004:0:6477:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789130775.736005:0:6477:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789130775.736007:0:6477:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789130775.736014:0:6477:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789130775.736017:0:6477:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1789130775.736019:0:6477:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789130775.736021:0:6477:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789130775.736053:0:6477:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000003b0b988 from lustre-MDT0000 10000000:01000000:2.0:1789130775.736108:0:6477:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1789130775.736112:0:6477:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1789130775.736134:0:6477:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff91ddd10e8000 10000000:01000000:2.0:1789130775.736143:0:6477:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789130775.736154:0:6477:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff91ddd10e8000 from 1 10000000:01000000:2.0:1789130775.736158:0:6477:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789130775.736223:0:6477:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: 00000000dc3f3eac/0xf3fe2838e1fc1cc4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130775.736235:0:6477:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: 00000000dc3f3eac/0xf3fe2838e1fc1cc4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130775.736245:0:6477:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: 00000000dc3f3eac/0xf3fe2838e1fc1cc4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130775.736269:0:6477:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001b47e26a pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6477:1876039508689280:0@lo:101: 00000100:00100000:2.0:1789130775.736351:0:6477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130775.736421:0:6477:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a4cedcef going to sleep for 11 seconds 00000100:00100000:1.0:1789130775.736521:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508689280 00000100:00100000:1.0:1789130775.736544:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508689280 00000100:00100000:1.0:1789130775.736609:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789130775.736617:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000046a0de52 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+5:6477:x1876039508689280:12345-0@lo:101: 00010000:00010000:1.0:1789130775.736635:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130775.736653:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000803fd2dc/0xf3fe2838e1fc1ccb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3fe2838e1fc1cc4 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130775.736678:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000803fd2dc/0xf3fe2838e1fc1ccb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3fe2838e1fc1cc4 expref: 6 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130775.736689:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000803fd2dc/0xf3fe2838e1fc1ccb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc1cc4 expref: 6 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130775.736699:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000803fd2dc, rc 0) 00000100:00100000:1.0:1789130775.736782:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000046a0de52 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+6:6477:x1876039508689280:12345-0@lo:101: Request processed in 166us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130775.736793:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789130775.736823:0:6477:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001b47e26a pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6477:1876039508689280:0@lo:101: 00010000:00010000:2.0:1789130775.736843:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: 00000000dc3f3eac/0xf3fe2838e1fc1cc4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc1ccb expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130775.736854:0:6477:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: 00000000dc3f3eac/0xf3fe2838e1fc1cc4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3fe2838e1fc1ccb expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130775.736921:0:6477:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001b47e26a pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6477:1876039508689408:0@lo:501: 00000100:00100000:2.0:1789130775.736961:0:6477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130775.736993:0:6477:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a4cedcef going to sleep for 11 seconds 00000100:00100000:0.0:1789130775.737250:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508689408 00000100:00100000:0.0:1789130775.737257:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508689408 00000100:00100000:0.0:1789130775.737355:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789130775.737362:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000846911ec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+6:6477:x1876039508689408:12345-0@lo:501: 00000100:00100000:0.0:1789130775.737559:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000846911ec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+6:6477:x1876039508689408:12345-0@lo:501: Request processed in 198us (599us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789130775.737567:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789130775.740100:0:6477:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001b47e26a pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6477:1876039508689408:0@lo:501: 10000000:01000000:3.0:1789130775.740160:0:6477:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1789130775.740188:0:6477:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: 00000000dc3f3eac/0xf3fe2838e1fc1cc4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc1ccb expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130775.740199:0:6477:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: 00000000dc3f3eac/0xf3fe2838e1fc1cc4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc1ccb expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789130775.740209:0:6477:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff91dded7b6800 10000000:01000000:3.0:1789130775.740217:0:6477:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789130775.740222:0:6477:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff91dded7b6800 10000000:01000000:3.0:1789130775.740225:0:6477:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1789130775.740228:0:6477:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff91dded7b6800 from 1 10000000:01000000:3.0:1789130775.740230:0:6477:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1789130775.740265:0:6477:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: 00000000e57d41a9/0xf3fe2838e1fc1cd2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130775.740271:0:6477:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: 00000000e57d41a9/0xf3fe2838e1fc1cd2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130775.740280:0:6477:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: 00000000e57d41a9/0xf3fe2838e1fc1cd2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130775.740298:0:6477:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e464907a pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6477:1876039508689536:0@lo:101: 00000100:00100000:3.0:1789130775.740369:0:6477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130775.740400:0:6477:0:(client.c:2715:ptlrpc_set_wait()) set 0000000046a48a25 going to sleep for 11 seconds 00000100:00100000:1.0:1789130775.740963:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508689536 00000100:00100000:1.0:1789130775.740979:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508689536 00000100:00100000:1.0:1789130775.741029:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789130775.741037:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000099b9e9a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+6:6477:x1876039508689536:12345-0@lo:101: 00010000:00010000:1.0:1789130775.741050:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130775.741063:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000065298e1d/0xf3fe2838e1fc1cd9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3fe2838e1fc1cd2 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130775.741084:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000065298e1d/0xf3fe2838e1fc1cd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3fe2838e1fc1cd2 expref: 7 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130775.741092:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000065298e1d/0xf3fe2838e1fc1cd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc1cd2 expref: 7 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130775.741100:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000065298e1d, rc 0) 00000100:00100000:1.0:1789130775.741147:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000099b9e9a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+7:6477:x1876039508689536:12345-0@lo:101: Request processed in 111us (779us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130775.741154:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789130775.743333:0:6477:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e464907a pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6477:1876039508689536:0@lo:101: 00010000:00010000:3.0:1789130775.743360:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: 00000000e57d41a9/0xf3fe2838e1fc1cd2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc1cd9 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130775.743372:0:6477:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: 00000000e57d41a9/0xf3fe2838e1fc1cd2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3fe2838e1fc1cd9 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789130775.743390:0:6477:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1789130775.743411:0:6477:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: 00000000e57d41a9/0xf3fe2838e1fc1cd2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc1cd9 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130775.743418:0:6477:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: 00000000e57d41a9/0xf3fe2838e1fc1cd2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc1cd9 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789130775.743425:0:6477:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1789130775.743432:0:6477:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789130775.743438:0:6477:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff91dded7b6800 10000000:01000000:3.0:1789130775.743440:0:6477:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1789130775.743443:0:6477:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1789130775.743445:0:6477:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1789130775.743507:0:6477:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: 00000000191121e4/0xf3fe2838e1fc1ce0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130775.743514:0:6477:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: 00000000191121e4/0xf3fe2838e1fc1ce0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130775.743522:0:6477:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: 00000000191121e4/0xf3fe2838e1fc1ce0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130775.743562:0:6477:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e464907a pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6477:1876039508689664:0@lo:101: 00000100:00100000:3.0:1789130775.743620:0:6477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130775.743652:0:6477:0:(client.c:2715:ptlrpc_set_wait()) set 0000000046a48a25 going to sleep for 11 seconds 00000100:00100000:1.0:1789130775.745328:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508689664 00000100:00100000:1.0:1789130775.745340:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508689664 00000100:00100000:1.0:1789130775.745398:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789130775.745407:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008416a291 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+7:6477:x1876039508689664:12345-0@lo:101: 00010000:00010000:1.0:1789130775.745423:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130775.745438:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c127434d/0xf3fe2838e1fc1ce7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3fe2838e1fc1ce0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130775.745477:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c127434d/0xf3fe2838e1fc1ce7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3fe2838e1fc1ce0 expref: 8 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130775.745488:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c127434d/0xf3fe2838e1fc1ce7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc1ce0 expref: 8 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130775.745512:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c127434d, rc 0) 00000100:00100000:1.0:1789130775.745590:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008416a291 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+8:6477:x1876039508689664:12345-0@lo:101: Request processed in 184us (1970us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130775.745597:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789130775.745815:0:6477:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e464907a pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6477:1876039508689664:0@lo:101: 00010000:00010000:3.0:1789130775.745832:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: 00000000191121e4/0xf3fe2838e1fc1ce0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc1ce7 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130775.745840:0:6477:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: 00000000191121e4/0xf3fe2838e1fc1ce0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3fe2838e1fc1ce7 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130775.745915:0:6477:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e464907a pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6477:1876039508689792:0@lo:501: 00000100:00100000:3.0:1789130775.745948:0:6477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130775.745971:0:6477:0:(client.c:2715:ptlrpc_set_wait()) set 0000000046a48a25 going to sleep for 11 seconds 00000100:00100000:0.0:1789130775.746256:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508689792 00000100:00100000:0.0:1789130775.746261:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508689792 00000100:00100000:0.0:1789130775.746298:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789130775.746305:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b154e0cf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+8:6477:x1876039508689792:12345-0@lo:501: 00000100:00100000:0.0:1789130775.746424:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b154e0cf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+9:6477:x1876039508689792:12345-0@lo:501: Request processed in 120us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130775.746442:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789130775.746641:0:6477:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e464907a pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6477:1876039508689792:0@lo:501: 00000100:00100000:3.0:1789130775.746672:0:6477:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e464907a pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6477:1876039508689920:0@lo:503: 00000100:00100000:3.0:1789130775.746714:0:6477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130775.746730:0:6477:0:(client.c:2715:ptlrpc_set_wait()) set 0000000046a48a25 going to sleep for 11 seconds 00000100:00100000:2.0:1789130775.746865:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508689920 00000100:00100000:2.0:1789130775.746871:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508689920 00000100:00100000:2.0:1789130775.746917:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789130775.746924:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000000d795e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+9:6477:x1876039508689920:12345-0@lo:503: 00000100:00100000:2.0:1789130775.747015:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000000d795e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+9:6477:x1876039508689920:12345-0@lo:503: Request processed in 92us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130775.747021:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789130775.747208:0:6477:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e464907a pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6477:1876039508689920:0@lo:503: 00000100:00100000:3.0:1789130775.747653:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e464907a pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6522:1876039508690048:0@lo:502: 00000100:00100000:3.0:1789130775.747693:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130775.747757:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c24f9cf3 going to sleep for 11 seconds 00000100:00100000:2.0:1789130775.757842:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508690048 00000100:00100000:2.0:1789130775.757857:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508690048 00000100:00100000:2.0:1789130775.757924:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789130775.757933:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007417b74d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+9:6522:x1876039508690048:12345-0@lo:502: 00000100:00100000:2.0:1789130775.758103:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007417b74d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+9:6522:x1876039508690048:12345-0@lo:502: Request processed in 171us (10409us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130775.758112:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789130775.759770:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e464907a pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6522:1876039508690048:0@lo:502: 00000020:01000000:3.0:1789130775.759825:0:6522:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789130775.759838:0:6522:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789130775.759849:0:6522:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1789130775.759856:0:6522:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1789130775.759859:0:6522:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789130775.759883:0:6522:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (000000002dc42058) 00000020:00000080:3.0:1789130775.759914:0:6522:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1789130775.759920:0:6522:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1789130775.760076:0:6522:0:(osd_handler.c:8895:osd_obd_connect()) connect #2 00000020:00000080:3.0:1789130775.760091:0:6522:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf3fe2838e1fc1cf5 00000020:00000080:3.0:1789130775.760317:0:6522:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1789130775.760322:0:6522:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789130775.760326:0:6522:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789130775.760327:0:6522:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1789130775.760329:0:6522:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789130775.760333:0:6522:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789130775.760334:0:6522:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1789130775.760337:0:6522:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789130775.760343:0:6522:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000c851cdb4) 00000020:00000080:3.0:1789130775.760353:0:6522:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1789130775.760357:0:6522:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1789130775.760358:0:6522:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1789130775.760361:0:6522:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1789130775.760366:0:6522:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789130775.760410:0:6522:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000003b0b988 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1789130775.760422:0:6522:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (0000000028b01188) 00000020:00000080:3.0:1789130775.760429:0:6522:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1789130775.760553:0:6522:0:(lod_dev.c:2292:lod_obd_connect()) connect #0 00000020:00000080:3.0:1789130775.760560:0:6522:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf3fe2838e1fc1d0a 00000020:00000080:3.0:1789130775.760650:0:6522:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1789130775.760656:0:6522:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1789130775.760660:0:6522:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xf3fe2838e1fc1d11 00080000:01000000:3.0:1789130775.760664:0:6522:0:(osd_handler.c:8895:osd_obd_connect()) connect #3 00000020:00000080:3.0:1789130775.760667:0:6522:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf3fe2838e1fc1d18 00080000:10000000:3.0:1789130775.761224:0:6522:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:3.0:1789130775.761385:0:6522:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:3.0:1789130775.769981:0:6522:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:1.0:1789130775.911395:0:6522:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:1.0:1789130775.913058:0:6522:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:0.0:1789130775.921401:0:6522:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:0.0:1789130775.921855:0:6522:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1789130775.925347:0:6522:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (0000000045d4d606) 00000020:00000080:2.0:1789130775.925371:0:6522:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1789130775.926875:0:6522:0:(osd_handler.c:8895:osd_obd_connect()) connect #4 00000020:00000080:2.0:1789130775.927020:0:6522:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf3fe2838e1fc1d26 00000020:00000080:2.0:1789130775.932720:0:6522:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:2.0:1789130775.933597:0:6522:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:10000000:2.0:1789130775.940096:0:6522:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:10000000:2.0:1789130775.953865:0:6522:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:10000000:2.0:1789130775.958412:0:6522:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:10000000:2.0:1789130775.966261:0:6522:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:10000000:2.0:1789130775.976729:0:6522:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00000020:00000080:2.0:1789130775.982922:0:6522:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xf3fe2838e1fc1d2d 00000020:00000080:0.0:1789130775.986171:0:6522:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1789130775.986193:0:6522:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789130775.986214:0:6522:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789130775.986217:0:6522:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1789130775.986221:0:6522:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789130775.986227:0:6522:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789130775.986228:0:6522:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789130775.986231:0:6522:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789130775.986233:0:6522:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789130775.986236:0:6522:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789130775.986238:0:6522:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789130775.986240:0:6522:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre sys.timeout 00000020:01000000:0.0:1789130775.986242:0:6522:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789130775.986246:0:6522:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789130775.986247:0:6522:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1789130775.986252:0:6522:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1789130775.986323:0:6522:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:0.0:1789130775.986403:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006b83a6e3 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6522:1876039508690176:0@lo:502: 00000100:00100000:0.0:1789130775.986585:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130775.986664:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set 000000000bdb9496 going to sleep for 11 seconds 00000100:00100000:1.0:1789130775.987017:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508690176 00000100:00100000:1.0:1789130775.987027:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508690176 00000100:00100000:1.0:1789130775.987096:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789130775.987107:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000089125a55 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+9:6522:x1876039508690176:12345-0@lo:502: 00000100:00100000:1.0:1789130775.987282:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000089125a55 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+9:6522:x1876039508690176:12345-0@lo:502: Request processed in 177us (698us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130775.987293:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789130775.987589:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006b83a6e3 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6522:1876039508690176:0@lo:502: 00000020:01000000:0.0:1789130775.987625:0:6522:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789130775.987632:0:6522:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789130775.987634:0:6522:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:0.0:1789130775.987638:0:6522:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:2.0:1789130775.987927:0:6477:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:2.0:1789130775.987952:0:6477:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1789130775.987975:0:6477:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: 00000000191121e4/0xf3fe2838e1fc1ce0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc1ce7 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130775.987985:0:6477:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: 00000000191121e4/0xf3fe2838e1fc1ce0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc1ce7 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789130775.988003:0:6477:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff91dded7b6800 from 1 10000000:01000000:2.0:1789130775.988006:0:6477:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789130775.988041:0:6477:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: 000000003a4f79fd/0xf3fe2838e1fc1d34 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130775.988048:0:6477:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: 000000003a4f79fd/0xf3fe2838e1fc1d34 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130775.988056:0:6477:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: 000000003a4f79fd/0xf3fe2838e1fc1d34 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130775.988074:0:6477:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a814f9e3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6477:1876039508690304:0@lo:101: 00000100:00100000:2.0:1789130775.988121:0:6477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130775.988159:0:6477:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a11a9609 going to sleep for 11 seconds 00000100:00100000:1.0:1789130775.988333:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508690304 00000100:00100000:1.0:1789130775.988338:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508690304 00000100:00100000:1.0:1789130775.988418:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789130775.988425:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000572c9efa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+9:6477:x1876039508690304:12345-0@lo:101: 00010000:00010000:1.0:1789130775.988437:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130775.988453:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000035fb5e4c/0xf3fe2838e1fc1d3b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3fe2838e1fc1d34 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130775.988530:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000035fb5e4c/0xf3fe2838e1fc1d3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3fe2838e1fc1d34 expref: 10 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130775.988552:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000035fb5e4c/0xf3fe2838e1fc1d3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc1d34 expref: 10 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130775.988575:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000035fb5e4c, rc 0) 00000100:00100000:1.0:1789130775.988614:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000572c9efa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+10:6477:x1876039508690304:12345-0@lo:101: Request processed in 190us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130775.988622:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789130775.988757:0:6477:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a814f9e3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6477:1876039508690304:0@lo:101: 00010000:00010000:0.0:1789130775.988778:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: 000000003a4f79fd/0xf3fe2838e1fc1d34 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc1d3b expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130775.988787:0:6477:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: 000000003a4f79fd/0xf3fe2838e1fc1d34 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3fe2838e1fc1d3b expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130775.989344:0:6477:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006b83a6e3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6477:1876039508690432:0@lo:256: 00000100:00100000:0.0:1789130775.989400:0:6477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130775.990176:0:6477:0:(client.c:2715:ptlrpc_set_wait()) set 000000000bdb9496 going to sleep for 11 seconds 00000100:00100000:2.0:1789130775.990355:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508690432 00000100:00100000:2.0:1789130775.990366:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508690432 00000100:00100000:2.0:1789130775.990409:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789130775.990417:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009e295ed7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+10:6477:x1876039508690432:12345-0@lo:256: 20000000:01000000:2.0:1789130775.990442:0:6492:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1789130775.990448:0:6492:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1789130775.990694:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009e295ed7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+10:6477:x1876039508690432:12345-0@lo:256: Request processed in 278us (1295us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130775.990703:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789130775.990911:0:6477:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006b83a6e3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6477:1876039508690432:0@lo:256: 10000000:01000000:0.0:1789130775.991574:0:6477:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789130775.991602:0:6477:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: 000000003a4f79fd/0xf3fe2838e1fc1d34 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc1d3b expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130775.991614:0:6477:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: 000000003a4f79fd/0xf3fe2838e1fc1d34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc1d3b expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789130775.991624:0:6477:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91dded7b6800 from 1 10000000:01000000:0.0:1789130775.991627:0:6477:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789130775.991667:0:6477:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: 0000000008639f49/0xf3fe2838e1fc1d42 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130775.991675:0:6477:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: 0000000008639f49/0xf3fe2838e1fc1d42 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130775.991683:0:6477:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: 0000000008639f49/0xf3fe2838e1fc1d42 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130775.991701:0:6477:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006b83a6e3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6477:1876039508690560:0@lo:101: 00000100:00100000:0.0:1789130775.991931:0:6477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130775.992044:0:6477:0:(client.c:2715:ptlrpc_set_wait()) set 000000000bdb9496 going to sleep for 11 seconds 00000100:00100000:3.0:1789130775.992099:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508690560 00000100:00100000:3.0:1789130775.992106:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508690560 00000100:00100000:1.0:1789130775.992164:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789130775.992174:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009c0e70db pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+10:6477:x1876039508690560:12345-0@lo:101: 00010000:00010000:1.0:1789130775.992189:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130775.992213:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002b555ef7/0xf3fe2838e1fc1d49 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3fe2838e1fc1d42 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130775.992239:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002b555ef7/0xf3fe2838e1fc1d49 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3fe2838e1fc1d42 expref: 11 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130775.992249:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002b555ef7/0xf3fe2838e1fc1d49 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc1d42 expref: 11 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130775.992258:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002b555ef7, rc 0) 00000100:00100000:1.0:1789130775.992350:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009c0e70db pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+11:6477:x1876039508690560:12345-0@lo:101: Request processed in 177us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130775.992357:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789130775.992603:0:6477:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006b83a6e3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6477:1876039508690560:0@lo:101: 00010000:00010000:0.0:1789130775.992617:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: 0000000008639f49/0xf3fe2838e1fc1d42 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc1d49 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130775.992624:0:6477:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: 0000000008639f49/0xf3fe2838e1fc1d42 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3fe2838e1fc1d49 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130775.992700:0:6477:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006b83a6e3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6477:1876039508690688:0@lo:501: 00000100:00100000:0.0:1789130775.992726:0:6477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130775.992874:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508690688 00000100:00100000:2.0:1789130775.992879:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508690688 00000100:00100000:2.0:1789130775.992907:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789130775.992914:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a417b4e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+11:6477:x1876039508690688:12345-0@lo:501: 00000100:00100000:2.0:1789130775.993102:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a417b4e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+11:6477:x1876039508690688:12345-0@lo:501: Request processed in 188us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130775.993120:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789130775.994044:0:6477:0:(client.c:2715:ptlrpc_set_wait()) set 000000000bdb9496 going to sleep for 11 seconds 00000100:00100000:0.0:1789130775.994075:0:6477:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006b83a6e3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6477:1876039508690688:0@lo:501: 00000100:00100000:0.0:1789130775.994122:0:6477:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006b83a6e3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6477:1876039508690816:0@lo:503: 00000100:00100000:0.0:1789130775.994181:0:6477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130775.994301:0:6477:0:(client.c:2715:ptlrpc_set_wait()) set 000000000bdb9496 going to sleep for 11 seconds 00000100:00100000:3.0:1789130775.994331:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508690816 00000100:00100000:3.0:1789130775.994337:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508690816 00000100:00100000:3.0:1789130775.994370:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789130775.994378:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ad728801 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+11:6477:x1876039508690816:12345-0@lo:503: 00000040:00080000:3.0:1789130775.994428:0:6493:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789130775.994492:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ad728801 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+11:6477:x1876039508690816:12345-0@lo:503: Request processed in 114us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130775.994500:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789130775.995686:0:6477:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006b83a6e3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6477:1876039508690816:0@lo:503: 00000040:00080000:0.0:1789130775.998352:0:6526:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:3.0:1789130775.998483:0:6477:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:3.0:1789130775.998510:0:6477:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789130775.998533:0:6477:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: 0000000008639f49/0xf3fe2838e1fc1d42 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc1d49 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130775.998557:0:6477:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: 0000000008639f49/0xf3fe2838e1fc1d42 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc1d49 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789130775.999191:0:6477:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789130775.999196:0:6477:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff91dded7b6800 10000000:01000000:3.0:1789130775.999199:0:6477:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff91dded7b6800 10000000:01000000:3.0:1789130775.999204:0:6477:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789130775.999211:0:6477:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff91dded7b6800 from 1 10000000:01000000:3.0:1789130775.999215:0:6477:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789130775.999389:0:6477:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: 000000000662d81e/0xf3fe2838e1fc1d50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130775.999401:0:6477:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: 000000000662d81e/0xf3fe2838e1fc1d50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130775.999434:0:6477:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: 000000000662d81e/0xf3fe2838e1fc1d50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130775.999493:0:6477:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e464907a pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6477:1876039508690944:0@lo:101: 00000100:00100000:3.0:1789130776.000312:0:6477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130776.000430:0:6477:0:(client.c:2715:ptlrpc_set_wait()) set 0000000090bc39fa going to sleep for 11 seconds 00000100:00100000:2.0:1789130776.005103:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508690944 00000100:00100000:2.0:1789130776.005123:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508690944 00000100:00100000:2.0:1789130776.005301:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789130776.005313:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003e0820be pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+11:6477:x1876039508690944:12345-0@lo:101: 00010000:00010000:2.0:1789130776.005337:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130776.005365:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000cdc4f461/0xf3fe2838e1fc1d57 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3fe2838e1fc1d50 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130776.005398:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000cdc4f461/0xf3fe2838e1fc1d57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3fe2838e1fc1d50 expref: 12 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130776.005409:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000cdc4f461/0xf3fe2838e1fc1d57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc1d50 expref: 12 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130776.005418:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000cdc4f461, rc 0) 00000100:00100000:2.0:1789130776.005549:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003e0820be pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+12:6477:x1876039508690944:12345-0@lo:101: Request processed in 237us (5240us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130776.005765:0:6477:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e464907a pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6477:1876039508690944:0@lo:101: 00010000:00010000:3.0:1789130776.005788:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: 000000000662d81e/0xf3fe2838e1fc1d50 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc1d57 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130776.005798:0:6477:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: 000000000662d81e/0xf3fe2838e1fc1d50 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3fe2838e1fc1d57 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130776.005855:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789130776.005897:0:6477:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e464907a pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6477:1876039508691072:0@lo:501: 00000100:00100000:3.0:1789130776.005935:0:6477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130776.007871:0:6477:0:(client.c:2715:ptlrpc_set_wait()) set 0000000090bc39fa going to sleep for 11 seconds 00000100:00100000:1.0:1789130776.008226:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508691072 00000100:00100000:1.0:1789130776.008246:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508691072 00000100:00100000:1.0:1789130776.008317:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789130776.008327:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005e07d5a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+12:6477:x1876039508691072:12345-0@lo:501: 00000100:00100000:3.0:1789130776.008688:0:6477:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e464907a pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6477:1876039508691072:0@lo:501: 00000100:00100000:3.0:1789130776.008745:0:6477:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e464907a pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6477:1876039508691200:0@lo:503: 00000100:00100000:1.0:1789130776.008934:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005e07d5a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+12:6477:x1876039508691072:12345-0@lo:501: Request processed in 607us (2998us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130776.008945:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789130776.010364:0:6477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130776.010502:0:6477:0:(client.c:2715:ptlrpc_set_wait()) set 0000000090bc39fa going to sleep for 11 seconds 00000100:00100000:2.0:1789130776.010628:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508691200 00000100:00100000:2.0:1789130776.010694:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508691200 00000100:00100000:2.0:1789130776.010908:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789130776.010919:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b1f91b91 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+12:6477:x1876039508691200:12345-0@lo:503: 00000100:00100000:2.0:1789130776.011099:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b1f91b91 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+12:6477:x1876039508691200:12345-0@lo:503: Request processed in 182us (743us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130776.011107:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789130776.011207:0:6477:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e464907a pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6477:1876039508691200:0@lo:503: 00000100:00100000:1.0:1789130776.012251:0:6527:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001cfdbd9a pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6527:1876039508691328:0@lo:502: 00000100:00100000:1.0:1789130776.012323:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130776.012600:0:6527:0:(client.c:2715:ptlrpc_set_wait()) set 00000000740713b8 going to sleep for 11 seconds 00000100:00100000:0.0:1789130776.012764:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508691328 00000100:00100000:0.0:1789130776.012773:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508691328 00000100:00100000:0.0:1789130776.012818:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789130776.012826:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000adfab7d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+12:6527:x1876039508691328:12345-0@lo:502: 00000100:00100000:0.0:1789130776.012968:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000adfab7d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+12:6527:x1876039508691328:12345-0@lo:502: Request processed in 143us (646us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130776.012977:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789130776.013216:0:6527:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001cfdbd9a pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6527:1876039508691328:0@lo:502: 00000020:01000004:1.0:1789130776.013293:0:6527:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1789130776.013312:0:6527:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000d44fd50e) 00000020:00000080:1.0:1789130776.013348:0:6527:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:1.0:1789130776.013455:0:6527:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000003b0b988 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1789130776.013488:0:6527:0:(tgt_mount.c:187:server_put_mount()) put mount 0000000003b0b988 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1789130776.013491:0:6527:0:(obd_mount.c:710:lustre_put_lsi()) put 0000000003b0b988 4 00010000:00080000:1.0:1789130776.013546:0:6527:0:(ldlm_lib.c:102:import_set_conn()) imp 000000008aeb16ad@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.111@tcp at head 00010000:00010000:1.0:1789130776.017278:0:6527:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:1.0:1789130776.017672:0:6527:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1789130776.017733:0:6527:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789130776.017902:0:6527:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xf3fe2838e1fc1d65 00000100:00080000:1.0:1789130776.017916:0:6527:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789130776.017922:0:6527:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000008aeb16ad using connection 192.168.203.111@tcp/0@lo 00000100:00100000:1.0:1789130776.017973:0:6527:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000001cfdbd9a x1876039508691456/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789130776.017998:0:6527:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1789130776.018264:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001cfdbd9a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3624:1876039508691456:0@lo:38: 00000100:00100000:0.0:1789130776.018373:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130776.018741:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508691456 00000100:00100000:1.0:1789130776.018863:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508691456 00000100:00100000:1.0:1789130776.018911:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789130776.018918:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006b83a6e3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3624:x1876039508691456:12345-0@lo:38: 00000100:00100000:1.0:1789130776.019003:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006b83a6e3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3624:x1876039508691456:12345-0@lo:38: Request processed in 84us (631us total) trans 0 rc -11/-11 00000100:00100000:1.0:1789130776.019011:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789130776.019126:0:6527:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ad8b2570 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6527:1876039508691584:0@lo:502: 00000100:00100000:1.0:1789130776.019190:0:6527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130776.019213:0:6527:0:(client.c:2715:ptlrpc_set_wait()) set 000000003379e60d going to sleep for 11 seconds 00000100:00100000:0.0:1789130776.019278:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508691584 00000100:00100000:0.0:1789130776.019282:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508691584 00000100:00100000:0.0:1789130776.019323:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789130776.019330:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000839db327 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+12:6527:x1876039508691584:12345-0@lo:502: 00000100:00100000:0.0:1789130776.019483:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000839db327 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+12:6527:x1876039508691584:12345-0@lo:502: Request processed in 129us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130776.019490:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789130776.019942:0:3624:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789130776.019955:0:3624:0:(import.c:65:import_set_state_nolock()) 000000008aeb16ad lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789130776.019960:0:3624:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1789130776.019965:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001cfdbd9a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3624:1876039508691456:0@lo:38: 00000100:00100000:1.0:1789130776.020071:0:6527:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ad8b2570 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6527:1876039508691584:0@lo:502: 00000040:00080000:1.0:1789130776.020099:0:6527:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:3.0:1789130776.020259:0:6477:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:3.0:1789130776.020287:0:6477:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789130776.020310:0:6477:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: 000000000662d81e/0xf3fe2838e1fc1d50 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc1d57 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130776.020323:0:6477:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: 000000000662d81e/0xf3fe2838e1fc1d50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc1d57 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789130776.020379:0:6477:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789130776.020381:0:6477:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789130776.020383:0:6477:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789130776.020384:0:6477:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789130776.020385:0:6477:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789130776.020387:0:6477:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789130776.020388:0:6477:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789130776.020389:0:6477:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789130776.020391:0:6477:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789130776.020393:0:6477:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789130776.020395:0:6477:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789130776.020396:0:6477:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789130776.020401:0:6477:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:3.0:1789130776.020404:0:6477:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789130776.020405:0:6477:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789130776.020406:0:6477:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789130776.020407:0:6477:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789130776.020408:0:6477:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789130776.020410:0:6477:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789130776.020410:0:6477:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789130776.020411:0:6477:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789130776.020412:0:6477:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789130776.020413:0:6477:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789130776.020414:0:6477:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789130776.020415:0:6477:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789130776.020437:0:6477:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1789130776.020448:0:6477:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e464907a pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6477:1876039508691712:0@lo:253: 00000100:00100000:3.0:1789130776.020531:0:6477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130776.020648:0:6477:0:(client.c:2715:ptlrpc_set_wait()) set 0000000090bc39fa going to sleep for 11 seconds 00000100:00100000:0.0:1789130776.020942:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508691712 00000100:00100000:0.0:1789130776.020950:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508691712 00000100:00100000:0.0:1789130776.020999:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789130776.021008:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f6282571 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+12:6477:x1876039508691712:12345-0@lo:253: 20000000:01000000:0.0:1789130776.021038:0:6494:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1789130776.021056:0:6494:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1789130776.034500:0:6494:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789130776.034518:0:6494:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1789130776.034574:0:6516:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789130776.034579:0:6516:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789130776.034608:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000008ea38fd2/0xf3fe2838e1fc1d6c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130776.034934:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000035fb5e4c/0xf3fe2838e1fc1d3b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc1d34 expref: 12 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130776.034944:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000008ea38fd2/0xf3fe2838e1fc1d6c lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130776.034994:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000035fb5e4c/0xf3fe2838e1fc1d3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf3fe2838e1fc1d34 expref: 12 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130776.035016:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000035fb5e4c/0xf3fe2838e1fc1d3b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf3fe2838e1fc1d34 expref: 12 pid: 6494 timeout: 281 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130776.035034:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000002f3bb8c pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6516:1876039508691840:0@lo:104: 00000100:00100000:2.0:1789130776.035123:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130776.035185:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set 000000006510a848 going to sleep for 11 seconds 00000100:00100000:1.0:1789130776.035421:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508691840 00000100:00100000:1.0:1789130776.035433:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508691840 00000100:00100000:1.0:1789130776.035502:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789130776.035511:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009f6bb8fc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+3:6516:x1876039508691840:12345-0@lo:104: 00010000:00010000:1.0:1789130776.035527:0:6483:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: 000000003a4f79fd/0xf3fe2838e1fc1d34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3fe2838e1fc1d3b expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130776.037142:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f6282571 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+12:6477:x1876039508691712:12345-0@lo:253: Request processed in 16125us (16601us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130776.037160:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:1.0:1789130776.038786:0:6483:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789130776.038803:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009f6bb8fc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+3:6516:x1876039508691840:12345-0@lo:104: Request processed in 3290us (3677us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130776.038816:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1789130776.038831:0:6488:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789130776.038840:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: 000000003a4f79fd/0xf3fe2838e1fc1d34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3fe2838e1fc1d3b expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130776.038852:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000003a4f79fd already unused, calling callback (00000000af325768) 10000000:00010000:0.0:1789130776.038856:0:6488:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: 000000003a4f79fd/0xf3fe2838e1fc1d34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf3fe2838e1fc1d3b expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130776.038868:0:6488:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: 000000003a4f79fd/0xf3fe2838e1fc1d34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf3fe2838e1fc1d3b expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789130776.038876:0:6488:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: 000000003a4f79fd/0xf3fe2838e1fc1d34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf3fe2838e1fc1d3b expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789130776.038882:0:6488:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789130776.038948:0:6488:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: 000000003a4f79fd/0xf3fe2838e1fc1d34 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc1d3b expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130776.038955:0:6488:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789130776.039051:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: 000000003a4f79fd/0xf3fe2838e1fc1d34 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc1d3b expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130776.039059:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: 000000003a4f79fd/0xf3fe2838e1fc1d34 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc1d3b expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130776.039078:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130776.039080:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130776.039081:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789130776.039336:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000002f3bb8c pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6516:1876039508691840:0@lo:104: 00010000:00010000:2.0:1789130776.039368:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000008ea38fd2/0xf3fe2838e1fc1d6c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130776.039508:0:6477:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e464907a pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6477:1876039508691712:0@lo:253: 10000000:01000000:3.0:1789130776.039523:0:6477:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1789130776.039527:0:6477:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789130776.039529:0:6477:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789130776.039530:0:6477:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789130776.039531:0:6477:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789130776.039533:0:6477:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789130776.039542:0:6477:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789130776.039543:0:6477:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789130776.039545:0:6477:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789130776.039547:0:6477:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789130776.039549:0:6477:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789130776.039550:0:6477:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789130776.039552:0:6477:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789130776.039565:0:6477:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1789130776.039604:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003bd77b99 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3626:1876039508691968:0@lo:103: 00000100:00100000:0.0:1789130776.039656:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130776.043124:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508691968 00000100:00100000:2.0:1789130776.043138:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508691968 00010000:00010000:2.0:1789130776.043183:0:6485:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000035fb5e4c/0xf3fe2838e1fc1d3b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3fe2838e1fc1d34 expref: 12 pid: 6494 timeout: 281 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130776.043246:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789130776.043256:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e8bae9d3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+12:3626:x1876039508691968:12345-0@lo:103: 00010000:00010000:2.0:1789130776.043273:0:6485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789130776.043278:0:6485:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000035fb5e4c/0xf3fe2838e1fc1d3b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3fe2838e1fc1d34 expref: 12 pid: 6494 timeout: 281 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130776.043292:0:6485:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000035fb5e4c/0xf3fe2838e1fc1d3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf3fe2838e1fc1d34 expref: 12 pid: 6494 timeout: 281 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130776.043315:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000035fb5e4c/0xf3fe2838e1fc1d3b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf3fe2838e1fc1d34 expref: 12 pid: 6494 timeout: 281 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130776.043331:0:6485:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000008ea38fd2/0xf3fe2838e1fc1d6c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130776.043340:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008ea38fd2/0xf3fe2838e1fc1d6c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789130776.043360:0:6485:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.008781586s 00010000:00010000:2.0:1789130776.043364:0:6485:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000008ea38fd2/0xf3fe2838e1fc1d6c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130776.043371:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000008ea38fd2/0xf3fe2838e1fc1d6c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130776.043377:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000008ea38fd2/0xf3fe2838e1fc1d6c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130776.043383:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000008ea38fd2/0xf3fe2838e1fc1d6c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130776.043395:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000008ea38fd2 already unused, calling callback (00000000eb258dfd) 00010000:00010000:2.0:1789130776.043399:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000008ea38fd2/0xf3fe2838e1fc1d6c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130776.043406:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000008ea38fd2/0xf3fe2838e1fc1d6c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130776.043421:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000008ea38fd2/0xf3fe2838e1fc1d6c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130776.043432:0:6485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789130776.043570:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e8bae9d3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+11:3626:x1876039508691968:12345-0@lo:103: Request processed in 315us (3913us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130776.043579:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1789130776.043616:0:6516:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000008ea38fd2/0xf3fe2838e1fc1d6c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130776.043625:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000008ea38fd2/0xf3fe2838e1fc1d6c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130776.043630:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000008ea38fd2/0xf3fe2838e1fc1d6c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130776.044093:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003bd77b99 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3626:1876039508691968:0@lo:103: 00080000:10000000:3.0:1789130776.053333:0:6477:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00080000:10000000:3.0:1789130776.053881:0:6477:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:0.0:1789130776.057434:0:6477:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00080000:10000000:0.0:1789130776.057951:0:6477:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:0.0:1789130776.058183:0:6477:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00080000:10000000:0.0:1789130776.058453:0:6477:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:0.0:1789130776.067359:0:6477:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00080000:10000000:0.0:1789130776.067587:0:6477:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:0.0:1789130776.067890:0:6477:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00080000:10000000:0.0:1789130776.068043:0:6477:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:0.0:1789130776.068198:0:6477:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00080000:10000000:0.0:1789130776.068412:0:6477:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 40000000:02000000:0.0:1789130776.074974:0:6477:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:3.0:1789130776.095375:0:6477:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1789130776.095608:0:6532:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:2.0:1789130776.095613:0:6532:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:1.0:1789130776.095902:0:6533:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:00080000:1.0:1789130776.103109:0:6533:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:1.0:1789130776.111042:0:6477:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1789130776.111276:0:6477:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1789130776.115396:0:6477:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1789130776.115429:0:6477:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1789130776.116981:0:6477:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789130776.119742:0:6533:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000040:00080000:1.0:1789130776.120379:0:6477:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1789130776.121044:0:6477:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1789130776.121086:0:6477:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1789130776.121398:0:6477:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1789130776.121785:0:6477:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x10:0x0] (8/32) registered 00100000:10000000:1.0:1789130776.122556:0:6477:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:1.0:1789130776.122696:0:6477:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:1.0:1789130776.122874:0:6477:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:1.0:1789130776.123010:0:6477:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:1.0:1789130776.123131:0:6477:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:1.0:1789130776.123265:0:6477:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:1.0:1789130776.123417:0:6477:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00000004:00080000:2.0:1789130776.123838:0:6533:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1789130776.123844:0:6533:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00100000:10000000:1.0:1789130776.127871:0:6477:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:1.0:1789130776.129793:0:6477:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:1.0:1789130776.130028:0:6477:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:1.0:1789130776.130199:0:6477:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:1.0:1789130776.131426:0:6477:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:1.0:1789130776.131833:0:6477:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:1.0:1789130776.131993:0:6477:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:1.0:1789130776.132185:0:6477:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:1.0:1789130776.133041:0:6477:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:1.0:1789130776.138173:0:6477:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:1.0:1789130776.138449:0:6477:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:1.0:1789130776.139049:0:6477:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:1.0:1789130776.139215:0:6477:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:1.0:1789130776.139368:0:6477:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:1.0:1789130776.142174:0:6477:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:1.0:1789130776.142374:0:6477:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:1.0:1789130776.143035:0:6477:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:1.0:1789130776.143193:0:6477:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:1.0:1789130776.143356:0:6477:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:1.0:1789130776.143529:0:6477:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:1.0:1789130776.145101:0:6477:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:1.0:1789130776.145294:0:6477:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:1.0:1789130776.145451:0:6477:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:1.0:1789130776.146215:0:6477:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:1.0:1789130776.146378:0:6477:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:1.0:1789130776.147132:0:6477:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:1.0:1789130776.153431:0:6477:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1789130776.153520:0:6477:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb3f441503988 00100000:10000000:1.0:1789130776.153532:0:6477:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1789130776.154734:0:6477:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789130776.154776:0:6477:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.111@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789130776.154802:0:6477:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=45 00000080:00000004:2.0:1789130776.154837:0:6477:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:2.0:1789130776.161662:0:6477:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789130776.161942:0:6477:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:0.0:1789130776.471356:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130777.489707:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130778.514063:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130779.538030:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130780.563384:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789130781.267662:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1789130781.267672:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1789130781.267675:0:38:0:(import.c:65:import_set_state_nolock()) 000000008aeb16ad lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789130781.267686:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000008aeb16ad using connection 192.168.203.111@tcp/0@lo 00000100:00100000:3.0:1789130781.267706:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000c3e82b0e x1876039508692224/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789130781.267888:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e464907a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3627:1876039508692096:0@lo:400: 00000100:00100000:3.0:1789130781.267959:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130781.268050:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c3e82b0e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3624:1876039508692224:0@lo:38: 00000100:00100000:3.0:1789130781.268086:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130781.268247:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508692096 00000100:00100000:0.0:1789130781.268256:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508692096 00000100:00100000:0.0:1789130781.268306:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789130781.268314:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000eada78c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+11:3627:x1876039508692096:12345-0@lo:400: 00000100:00100000:0.0:1789130781.268366:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000eada78c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+11:3627:x1876039508692096:12345-0@lo:400: Request processed in 53us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130781.268373:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789130781.268414:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e464907a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3627:1876039508692096:0@lo:400: 00000100:00100000:2.0:1789130781.268644:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508692224 00000100:00100000:2.0:1789130781.268649:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508692224 00000100:00100000:2.0:1789130781.268679:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789130781.268684:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ee79d45e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3624:x1876039508692224:12345-0@lo:38: 00010000:00080000:2.0:1789130781.268704:0:6502:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 137 last 0 00000020:00000080:2.0:1789130781.268739:0:6502:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xf3fe2838e1fc1d73 00000004:00100000:2.0:1789130781.268783:0:6502:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789130781.268910:0:6502:0:(import.c:65:import_set_state_nolock()) 00000000e041d519 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789130781.268962:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ee79d45e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1876039508692224:12345-0@lo:38: Request processed in 277us (876us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130781.268969:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789130781.269007:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000c3e82b0e x1876039508692224/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789130791 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789130781.269029:0:3624:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1789130781.269037:0:3624:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1789130781.269042:0:3624:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789130781.269044:0:3624:0:(import.c:65:import_set_state_nolock()) 000000008aeb16ad lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789130781.269049:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c3e82b0e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3624:1876039508692224:0@lo:38: 00010000:00010000:0.0:1789130781.585647:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789130781.586358:0:6778:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg311-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 10000000:01000000:2.0:1789130782.302433:0:6497:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789130782.302441:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff91dded7b6800 from 3 10000000:01000000:2.0:1789130782.302447:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789130782.302524:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: 00000000bec0997c/0xf3fe2838e1fc1d7a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130782.302538:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: 00000000bec0997c/0xf3fe2838e1fc1d7a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130782.302548:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: 00000000bec0997c/0xf3fe2838e1fc1d7a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130782.302572:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000feb9ada pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508692352:0@lo:101: 00000100:00100000:2.0:1789130782.302649:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130782.302697:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f1d7425f going to sleep for 11 seconds 00000100:00100000:2.0:1789130782.302720:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508692352 00000100:00100000:2.0:1789130782.302726:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508692352 00000100:00100000:2.0:1789130782.302772:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789130782.302791:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008c9d7935 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+11:6497:x1876039508692352:12345-0@lo:101: 00010000:00010000:2.0:1789130782.302804:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130782.302814:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000f5cba9c/0xf3fe2838e1fc1d81 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3fe2838e1fc1d7a expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130782.302835:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000f5cba9c/0xf3fe2838e1fc1d81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3fe2838e1fc1d7a expref: 12 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130782.302844:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000f5cba9c/0xf3fe2838e1fc1d81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc1d7a expref: 12 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130782.302854:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000f5cba9c, rc 0) 00000100:00100000:2.0:1789130782.302887:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008c9d7935 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+12:6497:x1876039508692352:12345-0@lo:101: Request processed in 97us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130782.302893:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789130782.302934:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000feb9ada pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508692352:0@lo:101: 00010000:00010000:2.0:1789130782.302947:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: 00000000bec0997c/0xf3fe2838e1fc1d7a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc1d81 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130782.302955:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: 00000000bec0997c/0xf3fe2838e1fc1d7a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3fe2838e1fc1d81 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130782.303003:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000feb9ada pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508692480:0@lo:256: 00000100:00100000:2.0:1789130782.303040:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130782.303054:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f1d7425f going to sleep for 11 seconds 00000100:00100000:2.0:1789130782.303065:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508692480 00000100:00100000:2.0:1789130782.303069:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508692480 00000100:00100000:2.0:1789130782.303091:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789130782.303097:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000027429d55 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+12:6497:x1876039508692480:12345-0@lo:256: 20000000:01000000:2.0:1789130782.303110:0:6493:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789130782.303124:0:6493:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789130782.303127:0:6493:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:2.0:1789130782.303198:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000027429d55 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+12:6497:x1876039508692480:12345-0@lo:256: Request processed in 100us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130782.303205:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789130782.303231:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000feb9ada pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508692480:0@lo:256: 10000000:01000000:2.0:1789130782.303265:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789130782.303270:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: 00000000bec0997c/0xf3fe2838e1fc1d7a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc1d81 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130782.303277:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: 00000000bec0997c/0xf3fe2838e1fc1d7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc1d81 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130782.620179:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789130782.663374:0:6830:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789130782.663629:0:6830:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789130783.638367:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130784.661715:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130785.681981:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789130785.782278:0:6932:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789130785.782510:0:6932:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1789130786.390985:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d21138a8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3625:1876039508692736:0@lo:400: 00000100:00100000:2.0:1789130786.391094:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130786.391208:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508692736 00000100:00100000:2.0:1789130786.391217:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508692736 00000100:00100000:2.0:1789130786.391272:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789130786.391282:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f28c6eb7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1876039508692736:12345-0@lo:400: 00000100:00100000:2.0:1789130786.391362:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f28c6eb7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1876039508692736:12345-0@lo:400: Request processed in 82us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130786.391371:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1789130786.391417:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000d21138a8 x1876039508692736/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130802 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789130786.391432:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d21138a8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3625:1876039508692736:0@lo:400: 00000100:00100000:0.0:1789130786.391794:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789130786.391809:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fb3105fa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3627:1876039508692608:0@lo:400: 00000100:00100000:0.0:1789130786.391855:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130786.392086:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508692608 00000100:00100000:2.0:1789130786.392093:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508692608 00000100:00100000:2.0:1789130786.392198:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789130786.392207:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007912e43e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+12:3627:x1876039508692608:12345-0@lo:400: 00000100:00100000:2.0:1789130786.392261:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007912e43e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+12:3627:x1876039508692608:12345-0@lo:400: Request processed in 56us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130786.392268:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789130786.392313:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fb3105fa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3627:1876039508692608:0@lo:400: 00010000:00010000:2.0:1789130786.707388:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130787.730491:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130788.768094:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130789.777768:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130790.802617:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789130791.507675:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789130791.507710:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008dba7366 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3628:1876039508692992:0@lo:400: 00000100:00100000:1.0:1789130791.507808:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130791.507912:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000425ef76b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3626:1876039508692864:0@lo:400: 00000100:00100000:2.0:1789130791.507954:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130791.508013:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508692992 00000100:00100000:2.0:1789130791.508022:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508692992 00000100:00100000:2.0:1789130791.508079:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789130791.508089:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000686a985f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1876039508692992:12345-0@lo:400: 00000100:00100000:2.0:1789130791.508151:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000686a985f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1876039508692992:12345-0@lo:400: Request processed in 63us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130791.508159:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789130791.508206:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000008dba7366 x1876039508692992/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130807 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789130791.508239:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008dba7366 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3628:1876039508692992:0@lo:400: 00000100:00100000:1.0:1789130791.508298:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508692864 00000100:00100000:1.0:1789130791.508302:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508692864 00000100:00100000:1.0:1789130791.508339:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789130791.508345:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000079465c55 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+12:3626:x1876039508692864:12345-0@lo:400: 00000100:00100000:1.0:1789130791.508380:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000079465c55 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+12:3626:x1876039508692864:12345-0@lo:400: Request processed in 36us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130791.508387:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789130791.508491:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000425ef76b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3626:1876039508692864:0@lo:400: 00010000:00010000:1.0:1789130791.831929:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130792.849665:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130793.874626:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130794.897630:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130795.924191:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789130796.070536:0:7430:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1789130796.070542:0:7430:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:1.0:1789130796.070543:0:7430:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1789130796.070735:0:7430:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000007f192d7d 00000020:01000004:1.0:1789130796.070759:0:7430:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200061, mountfl=0 00000020:01000004:1.0:1789130796.070773:0:7430:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1789130796.070805:0:7430:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (000000005fe67c49) 00000020:00000080:1.0:1789130796.070827:0:7430:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1789130796.149789:0:7430:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00100000:10000000:1.0:1789130796.149895:0:7430:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00080000:01000000:0.0:1789130796.188520:0:7430:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1789130796.189557:0:7430:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:0.0:1789130796.189573:0:7430:0:(osd_handler.c:8895:osd_obd_connect()) connect #0 00000020:00000080:0.0:1789130796.189587:0:7430:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xf3fe2838e1fc1d8f 00000020:01000004:0.0:1789130796.189595:0:7430:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:0.0:1789130796.190126:0:7430:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.111@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1789130796.190130:0:7430:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.111@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1789130796.190138:0:7430:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:0.0:1789130796.190209:0:7430:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:0.0:1789130796.190215:0:7430:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.111@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:0.0:1789130796.227422:0:7430:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.111@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789130796.228159:0:7430:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.111@tcp, index=0001, flags=0x20061 00000020:01000004:0.0:1789130796.228172:0:7430:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789130796.228174:0:7430:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789130796.228175:0:7430:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789130796.228176:0:7430:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789130796.228177:0:7430:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789130796.228180:0:7430:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789130796.228182:0:7430:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789130796.228183:0:7430:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789130796.228185:0:7430:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789130796.228186:0:7430:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789130796.228188:0:7430:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789130796.228192:0:7430:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020061 00000020:01000004:0.0:1789130796.228194:0:7430:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789130796.228196:0:7430:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789130796.228198:0:7430:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789130796.228200:0:7430:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789130796.228201:0:7430:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789130796.228202:0:7430:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789130796.228203:0:7430:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789130796.228205:0:7430:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789130796.228206:0:7430:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789130796.228207:0:7430:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789130796.228208:0:7430:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789130796.229200:0:7430:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1789130796.229225:0:7430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003929a872 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:7430:1876039508693120:0@lo:253: 00000100:00100000:0.0:1789130796.229321:0:7430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130796.229382:0:7430:0:(client.c:2715:ptlrpc_set_wait()) set 00000000839c5a9f going to sleep for 11 seconds 00000100:00100000:3.0:1789130796.231010:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508693120 00000100:00100000:3.0:1789130796.231030:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508693120 00000100:00100000:3.0:1789130796.231111:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789130796.231130:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000038975e56 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+12:7430:x1876039508693120:12345-0@lo:253: 20000000:01000000:3.0:1789130796.231204:0:6493:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1789130796.231211:0:6493:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0001, index=1 20000000:01000000:3.0:1789130796.231218:0:6493:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0001 to 1 20000000:01000000:3.0:1789130796.231223:0:6493:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0001 20000000:01000000:3.0:1789130796.231286:0:6493:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0001-mdtlov) log for lustre-MDT0001 00000040:00080000:3.0:1789130796.231650:0:6493:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789130796.231808:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:3.0:1789130796.231823:0:6493:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf001 lov lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1789130796.231841:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:3.0:1789130796.231856:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:3.0:1789130796.231869:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:3.0:1789130796.231931:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 20000000:01000000:3.0:1789130796.231940:0:6493:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf001 mdt lustre-MDT0001_UUID (null) (null) 00000040:00080000:3.0:1789130796.231951:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 20000000:01000000:3.0:1789130796.231956:0:6493:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0001 lustre-MDT0001-mdtlov (null) (null) 00000040:00080000:3.0:1789130796.231969:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 20000000:01000000:3.0:1789130796.231974:0:6493:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf003 lustre-MDT0001_UUID 1 lustre-MDT0001-mdtlov f 00000040:00080000:3.0:1789130796.231999:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:3.0:1789130796.232015:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:3.0:1789130796.232124:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 20000000:01000000:3.0:1789130796.232133:0:6493:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.111@tcp (null) (null) (null) 00000040:00080000:3.0:1789130796.232147:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 20000000:01000000:3.0:1789130796.232154:0:6493:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf001 osp lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1789130796.232166:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 20000000:01000000:3.0:1789130796.232172:0:6493:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf003 lustre-MDT0000_UUID 192.168.203.111@tcp (null) (null) 00000040:00080000:3.0:1789130796.232183:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 20000000:01000000:3.0:1789130796.232188:0:6493:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:3.0:1789130796.232201:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:3.0:1789130796.232215:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:3.0:1789130796.232226:0:6493:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:3.0:1789130796.232301:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 20000000:01000000:3.0:1789130796.232310:0:6493:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf009 sys.timeout=20 (null) (null) (null) 00000040:00080000:3.0:1789130796.232323:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:3.0:1789130796.232339:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:3.0:1789130796.232355:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 20000000:01000000:3.0:1789130796.232361:0:6493:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf00f mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (null) (null) (null) 00000040:00080000:3.0:1789130796.232372:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:3.0:1789130796.232402:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:3.0:1789130796.232410:0:6493:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 20000000:01000000:3.0:1789130796.232431:0:6493:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0001 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:3.0:1789130796.232438:0:6493:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0001/add mdc fl=4 00000040:00080000:3.0:1789130796.233157:0:7436:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:0.0:1789130796.233427:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:0.0:1789130796.233647:0:6493:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.111@tcp for mdt 20000000:01000000:0.0:1789130796.233651:0:6493:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.111@tcp (null) (null) (null) 00000040:00080000:0.0:1789130796.233679:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:0.0:1789130796.233686:0:6493:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1789130796.233701:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:0.0:1789130796.233707:0:6493:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf003 lustre-MDT0001_UUID 192.168.203.111@tcp (null) (null) 00000040:00080000:0.0:1789130796.233723:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:0.0:1789130796.233731:0:6493:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0001_UUID 1 1 lustre-MDT0001-mdc_UUID 00000040:00080000:0.0:1789130796.233758:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 160 off12472 00000040:00080000:0.0:1789130796.233776:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12696 20000000:01000000:0.0:1789130796.233831:0:6493:0:(mgs_llog.c:3435:mgs_write_log_osp_to_mdt()) adding osp index 1 to lustre-MDT0000 20000000:01000000:0.0:1789130796.233841:0:6493:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0001/add osp fl=4 00000040:00080000:3.0:1789130796.235289:0:7437:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000040:00080000:0.0:1789130796.235733:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:0.0:1789130796.235764:0:6493:0:(mgs_llog.c:3493:mgs_write_log_osp_to_mdt()) add nid 192.168.203.111@tcp for mdt 20000000:01000000:0.0:1789130796.235766:0:6493:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.111@tcp (null) (null) (null) 00000040:00080000:0.0:1789130796.235780:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:0.0:1789130796.235786:0:6493:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf001 osp lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1789130796.235798:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:0.0:1789130796.235804:0:6493:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf003 lustre-MDT0001_UUID 192.168.203.111@tcp (null) (null) 00000040:00080000:0.0:1789130796.235816:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:0.0:1789130796.235823:0:6493:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf014 lustre-MDT0001_UUID 1 1 (null) 00000040:00080000:0.0:1789130796.235835:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:0.0:1789130796.235850:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 20000000:01000000:0.0:1789130796.235872:0:6493:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:0.0:1789130796.235876:0:6493:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1789130796.235880:0:6493:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1789130796.235936:0:6493:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:0.0:1789130796.235939:0:6493:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789130796.236315:0:7438:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 16 marker 14 1->4: lustre sys.timeout 20000000:01000000:3.0:1789130796.236339:0:7438:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 14 2->4: lustre sys.timeout 00000040:00080000:3.0:1789130796.236353:0:7438:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 22 count 22 00000040:00080000:0.0:1789130796.236638:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:0.0:1789130796.236656:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:0.0:1789130796.236673:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 20000000:01000000:0.0:1789130796.236681:0:6493:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1789130796.236683:0:6493:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789130796.241065:0:7439:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 8 1->4: lustre sys.timeout 20000000:01000000:2.0:1789130796.241138:0:7439:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 8 2->4: lustre sys.timeout 00000040:00080000:2.0:1789130796.241156:0:7439:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:0.0:1789130796.241860:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:0.0:1789130796.241889:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:0.0:1789130796.241917:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:0.0:1789130796.241930:0:6493:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1789130796.241933:0:6493:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789130796.245856:0:7440:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:2.0:1789130796.246211:0:7440:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:2.0:1789130796.246230:0:7440:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:0.0:1789130796.246582:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12920 00000040:00080000:0.0:1789130796.246610:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off13000 00000040:00080000:0.0:1789130796.246649:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13224 20000000:01000000:0.0:1789130796.246666:0:6493:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1789130796.246670:0:6493:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1789130796.246676:0:6493:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:0.0:1789130796.246683:0:6493:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0001/lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:0.0:1789130796.247378:0:7441:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 20 count 25 20000000:00000400:1.0:1789130796.247727:0:6493:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 10000000:01000000:1.0:1789130796.259012:0:6493:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1789130796.259691:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000002b018ab6/0xf3fe2838e1fc1d96 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130796.259730:0:6493:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000803fd2dc/0xf3fe2838e1fc1ccb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc1cc4 expref: 12 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130796.259739:0:6493:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000c127434d/0xf3fe2838e1fc1ce7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc1ce0 expref: 12 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130796.259745:0:6493:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000cdc4f461/0xf3fe2838e1fc1d57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc1d50 expref: 12 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130796.259752:0:6493:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000002b018ab6/0xf3fe2838e1fc1d96 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130796.259815:0:6493:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000cdc4f461/0xf3fe2838e1fc1d57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf3fe2838e1fc1d50 expref: 12 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130796.259833:0:6493:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000cdc4f461/0xf3fe2838e1fc1d57 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf3fe2838e1fc1d50 expref: 12 pid: 6492 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130796.259850:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009b80c8fc pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6493:1876039508693248:0@lo:104: 00000100:00100000:0.0:1789130796.259940:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130796.260017:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508693248 00010000:00010000:0.0:1789130796.260025:0:6493:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000c127434d/0xf3fe2838e1fc1ce7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf3fe2838e1fc1ce0 expref: 12 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130796.260042:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508693248 00010000:00010000:0.0:1789130796.260042:0:6493:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000c127434d/0xf3fe2838e1fc1ce7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf3fe2838e1fc1ce0 expref: 12 pid: 6493 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130796.260049:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000096e81031 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6493:1876039508693376:0@lo:104: 00000100:00100000:0.0:1789130796.260073:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130796.260104:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508693376 00000100:00100000:3.0:1789130796.260107:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508693376 00000100:00100000:0.0:1789130796.260110:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789130796.260118:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006c6a01a3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+4:6493:x1876039508693248:12345-0@lo:104: 00010000:00010000:0.0:1789130796.260133:0:6483:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: 000000000662d81e/0xf3fe2838e1fc1d50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3fe2838e1fc1d57 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130796.260200:0:6483:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789130796.260206:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006c6a01a3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+4:6493:x1876039508693248:12345-0@lo:104: Request processed in 89us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130796.260214:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789130796.260236:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789130796.260242:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d1d7ac4c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+3:6493:x1876039508693376:12345-0@lo:104: 00010000:00010000:0.0:1789130796.260249:0:6483:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: 00000000191121e4/0xf3fe2838e1fc1ce0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3fe2838e1fc1ce7 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130796.260292:0:6483:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789130796.260296:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d1d7ac4c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+3:6493:x1876039508693376:12345-0@lo:104: Request processed in 56us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130796.260302:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1789130796.260331:0:6493:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000803fd2dc/0xf3fe2838e1fc1ccb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf3fe2838e1fc1cc4 expref: 12 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130796.260339:0:6493:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000803fd2dc/0xf3fe2838e1fc1ccb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf3fe2838e1fc1cc4 expref: 12 pid: 6492 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130796.260355:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ca107e3e pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6493:1876039508693504:0@lo:104: 00000100:00100000:0.0:1789130796.260387:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130796.260413:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set 000000005b13de1d going to sleep for 11 seconds 00010000:00010000:1.0:1789130796.260438:0:6488:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:0.0:1789130796.260440:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009b80c8fc pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6493:1876039508693248:0@lo:104: 00010000:00010000:3.0:1789130796.260450:0:6489:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1789130796.260451:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000096e81031 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6493:1876039508693376:0@lo:104: 00010000:00010000:1.0:1789130796.260543:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: 000000000662d81e/0xf3fe2838e1fc1d50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3fe2838e1fc1d57 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130796.260554:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000000662d81e already unused, calling callback (00000000af325768) 10000000:00010000:1.0:1789130796.260559:0:6488:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: 000000000662d81e/0xf3fe2838e1fc1d50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf3fe2838e1fc1d57 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130796.260568:0:6488:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: 000000000662d81e/0xf3fe2838e1fc1d50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf3fe2838e1fc1d57 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789130796.260575:0:6488:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: 000000000662d81e/0xf3fe2838e1fc1d50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf3fe2838e1fc1d57 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789130796.260581:0:6488:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1789130796.260592:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508693504 00000100:00100000:3.0:1789130796.260599:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508693504 00000100:00100000:3.0:1789130796.260632:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789130796.260637:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e5cc6550 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+3:6493:x1876039508693504:12345-0@lo:104: 00010000:00010000:3.0:1789130796.260644:0:6484:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: 00000000dc3f3eac/0xf3fe2838e1fc1cc4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3fe2838e1fc1ccb expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130796.260679:0:6484:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:1.0:1789130796.260682:0:6488:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: 000000000662d81e/0xf3fe2838e1fc1d50 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc1d57 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130796.260685:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e5cc6550 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+3:6493:x1876039508693504:12345-0@lo:104: Request processed in 47us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130796.260700:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1789130796.260700:0:6488:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789130796.260731:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: 000000000662d81e/0xf3fe2838e1fc1d50 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc1d57 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130796.260739:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: 000000000662d81e/0xf3fe2838e1fc1d50 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc1d57 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130796.260755:0:6488:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789130796.260758:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: 00000000dc3f3eac/0xf3fe2838e1fc1cc4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3fe2838e1fc1ccb expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130796.260764:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000dc3f3eac already unused, calling callback (00000000af325768) 10000000:00010000:1.0:1789130796.260766:0:6488:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: 00000000dc3f3eac/0xf3fe2838e1fc1cc4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf3fe2838e1fc1ccb expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130796.260772:0:6488:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: 00000000dc3f3eac/0xf3fe2838e1fc1cc4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf3fe2838e1fc1ccb expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789130796.260777:0:6488:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: 00000000dc3f3eac/0xf3fe2838e1fc1cc4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf3fe2838e1fc1ccb expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789130796.260781:0:6488:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789130796.260789:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130796.260802:0:6488:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: 00000000dc3f3eac/0xf3fe2838e1fc1cc4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc1ccb expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130796.260808:0:6488:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789130796.260823:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: 00000000dc3f3eac/0xf3fe2838e1fc1cc4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc1ccb expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130796.260828:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: 00000000dc3f3eac/0xf3fe2838e1fc1cc4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc1ccb expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130796.260837:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130796.260844:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130796.260846:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789130796.260978:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b76ed210 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3628:1876039508693632:0@lo:103: 00000100:00100000:2.0:1789130796.261015:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130796.261134:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009131adf3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3625:1876039508693760:0@lo:103: 00000100:00100000:0.0:1789130796.261162:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130796.261201:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ca107e3e pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6493:1876039508693504:0@lo:104: 00010000:00010000:0.0:1789130796.261232:0:6493:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000002b018ab6/0xf3fe2838e1fc1d96 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130796.261556:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508693632 00000100:00100000:1.0:1789130796.261562:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508693632 00010000:00010000:1.0:1789130796.261587:0:6486:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000cdc4f461/0xf3fe2838e1fc1d57 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3fe2838e1fc1d50 expref: 13 pid: 6492 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130796.261614:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508693760 00000100:00100000:1.0:1789130796.261618:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508693760 00010000:00010000:1.0:1789130796.261629:0:6486:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000803fd2dc/0xf3fe2838e1fc1ccb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3fe2838e1fc1cc4 expref: 14 pid: 6492 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130796.261653:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789130796.261660:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fb3105fa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+14:3628:x1876039508693632:12345-0@lo:103: 00010000:00010000:1.0:1789130796.261673:0:6486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789130796.261678:0:6486:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000cdc4f461/0xf3fe2838e1fc1d57 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3fe2838e1fc1d50 expref: 14 pid: 6492 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130796.261688:0:6486:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000cdc4f461/0xf3fe2838e1fc1d57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf3fe2838e1fc1d50 expref: 14 pid: 6492 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130796.261705:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000cdc4f461/0xf3fe2838e1fc1d57 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf3fe2838e1fc1d50 expref: 14 pid: 6492 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130796.261721:0:6486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789130796.261763:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fb3105fa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+13:3628:x1876039508693632:12345-0@lo:103: Request processed in 104us (747us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130796.261770:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789130796.261786:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789130796.261791:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d21850a2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+12:3625:x1876039508693760:12345-0@lo:103: 00010000:00010000:1.0:1789130796.261811:0:6486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789130796.261816:0:6486:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000803fd2dc/0xf3fe2838e1fc1ccb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3fe2838e1fc1cc4 expref: 12 pid: 6492 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130796.261823:0:6486:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000803fd2dc/0xf3fe2838e1fc1ccb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf3fe2838e1fc1cc4 expref: 12 pid: 6492 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130796.261832:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000803fd2dc/0xf3fe2838e1fc1ccb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf3fe2838e1fc1cc4 expref: 12 pid: 6492 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130796.261841:0:6486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789130796.261869:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d21850a2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+11:3625:x1876039508693760:12345-0@lo:103: Request processed in 78us (706us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130796.261876:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1789130796.261916:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: 00000000191121e4/0xf3fe2838e1fc1ce0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3fe2838e1fc1ce7 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130796.261925:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000191121e4 already unused, calling callback (00000000af325768) 10000000:00010000:3.0:1789130796.261928:0:6489:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: 00000000191121e4/0xf3fe2838e1fc1ce0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf3fe2838e1fc1ce7 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130796.261937:0:6489:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: 00000000191121e4/0xf3fe2838e1fc1ce0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf3fe2838e1fc1ce7 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789130796.261943:0:6489:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: 00000000191121e4/0xf3fe2838e1fc1ce0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf3fe2838e1fc1ce7 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789130796.261949:0:6489:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789130796.261971:0:6489:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: 00000000191121e4/0xf3fe2838e1fc1ce0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc1ce7 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130796.261983:0:6489:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789130796.261991:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: 00000000191121e4/0xf3fe2838e1fc1ce0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc1ce7 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130796.261997:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: 00000000191121e4/0xf3fe2838e1fc1ce0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc1ce7 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130796.262013:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130796.262015:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130796.262016:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130796.262029:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130796.262031:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789130796.262741:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009131adf3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3625:1876039508693760:0@lo:103: 00000100:00100000:0.0:1789130796.262764:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789130796.262772:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a022112a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3625:1876039508693888:0@lo:103: 00000100:00100000:0.0:1789130796.262821:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130796.263035:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508693888 00000100:00100000:1.0:1789130796.263043:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508693888 00010000:00010000:1.0:1789130796.263068:0:6486:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000c127434d/0xf3fe2838e1fc1ce7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3fe2838e1fc1ce0 expref: 11 pid: 6493 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130796.263102:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789130796.263121:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ca107e3e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+11:3625:x1876039508693888:12345-0@lo:103: 00010000:00010000:1.0:1789130796.263134:0:6486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789130796.263138:0:6486:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000c127434d/0xf3fe2838e1fc1ce7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3fe2838e1fc1ce0 expref: 11 pid: 6493 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130796.263147:0:6486:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000c127434d/0xf3fe2838e1fc1ce7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf3fe2838e1fc1ce0 expref: 11 pid: 6493 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130796.263160:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000c127434d/0xf3fe2838e1fc1ce7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf3fe2838e1fc1ce0 expref: 11 pid: 6493 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130796.263196:0:6486:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000002b018ab6/0xf3fe2838e1fc1d96 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130796.263205:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002b018ab6/0xf3fe2838e1fc1d96 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130796.263222:0:6486:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000002b018ab6/0xf3fe2838e1fc1d96 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130796.263229:0:6486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000002b018ab6/0xf3fe2838e1fc1d96 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130796.263235:0:6486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000002b018ab6/0xf3fe2838e1fc1d96 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130796.263241:0:6486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000002b018ab6/0xf3fe2838e1fc1d96 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130796.263246:0:6486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000002b018ab6 already unused, calling callback (00000000eb258dfd) 00010000:00010000:1.0:1789130796.263249:0:6486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000002b018ab6/0xf3fe2838e1fc1d96 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130796.263256:0:6486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000002b018ab6/0xf3fe2838e1fc1d96 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130796.263278:0:6486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000002b018ab6/0xf3fe2838e1fc1d96 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130796.263290:0:6486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789130796.263324:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ca107e3e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+10:3625:x1876039508693888:12345-0@lo:103: Request processed in 216us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130796.263341:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1789130796.263476:0:6493:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000002b018ab6/0xf3fe2838e1fc1d96 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130796.263486:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000002b018ab6/0xf3fe2838e1fc1d96 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130796.263492:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000002b018ab6/0xf3fe2838e1fc1d96 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789130796.263518:0:6493:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:0.0:1789130796.263670:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a022112a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3625:1876039508693888:0@lo:103: 00000100:00100000:2.0:1789130796.264482:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b76ed210 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3628:1876039508693632:0@lo:103: 00000100:00100000:3.0:1789130796.267853:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000038975e56 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+9:7430:x1876039508693120:12345-0@lo:253: Request processed in 36721us (38521us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130796.267872:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789130796.268112:0:7430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003929a872 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:7430:1876039508693120:0@lo:253: 10000000:01000000:0.0:1789130796.268133:0:7430:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1789130796.268137:0:7430:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789130796.268139:0:7430:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789130796.268141:0:7430:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789130796.268142:0:7430:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0001_UUID 00000020:01000004:0.0:1789130796.268143:0:7430:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789130796.268144:0:7430:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789130796.268146:0:7430:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789130796.268148:0:7430:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1789130796.268163:0:7430:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789130796.268164:0:7430:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789130796.268192:0:7430:0:(tgt_mount.c:101:server_register_mount()) register mount 000000007f192d7d from lustre-MDT0001 10000000:01000000:0.0:1789130796.268234:0:7430:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:0.0:1789130796.268237:0:7430:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1789130796.268246:0:7430:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff91ddd10e8000 local copy 10000000:01000000:0.0:1789130796.268251:0:7430:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789130796.268299:0:7430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: 00000000754fac63/0xf3fe2838e1fc1d9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130796.268310:0:7430:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.111@tcp lock: 00000000754fac63/0xf3fe2838e1fc1d9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130796.268319:0:7430:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: 00000000754fac63/0xf3fe2838e1fc1d9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130796.268341:0:7430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003929a872 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:7430:1876039508694016:0@lo:101: 00000100:00100000:0.0:1789130796.268554:0:7430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130796.268606:0:7430:0:(client.c:2715:ptlrpc_set_wait()) set 000000005737f4ed going to sleep for 11 seconds 00000100:00100000:2.0:1789130796.269179:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508694016 00000100:00100000:2.0:1789130796.269190:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508694016 00000100:00100000:2.0:1789130796.269249:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789130796.269258:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000aca86aeb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+9:7430:x1876039508694016:12345-0@lo:101: 00010000:00010000:2.0:1789130796.269275:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130796.269291:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004887fac8/0xf3fe2838e1fc1da4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3fe2838e1fc1d9d expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130796.269319:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004887fac8/0xf3fe2838e1fc1da4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3fe2838e1fc1d9d expref: 10 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130796.269331:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004887fac8/0xf3fe2838e1fc1da4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc1d9d expref: 10 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130796.269342:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004887fac8, rc 0) 00000100:00100000:2.0:1789130796.269418:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000aca86aeb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+10:7430:x1876039508694016:12345-0@lo:101: Request processed in 160us (865us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130796.269425:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789130796.269518:0:7430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003929a872 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:7430:1876039508694016:0@lo:101: 00010000:00010000:0.0:1789130796.269536:0:7430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: 00000000754fac63/0xf3fe2838e1fc1d9d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xf3fe2838e1fc1da4 expref: -99 pid: 7430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130796.269545:0:7430:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: 00000000754fac63/0xf3fe2838e1fc1d9d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xf3fe2838e1fc1da4 expref: -99 pid: 7430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130796.269667:0:7430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003929a872 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:7430:1876039508694144:0@lo:501: 00000100:00100000:0.0:1789130796.269698:0:7430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130796.269724:0:7430:0:(client.c:2715:ptlrpc_set_wait()) set 000000005737f4ed going to sleep for 11 seconds 00000100:00100000:3.0:1789130796.269813:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508694144 00000100:00100000:3.0:1789130796.269819:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508694144 00000100:00100000:3.0:1789130796.269854:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789130796.269860:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000034983ef6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+10:7430:x1876039508694144:12345-0@lo:501: 00000100:00100000:3.0:1789130796.269941:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000034983ef6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+10:7430:x1876039508694144:12345-0@lo:501: Request processed in 81us (242us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789130796.269948:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789130796.270188:0:7430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003929a872 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:7430:1876039508694144:0@lo:501: 10000000:01000000:0.0:1789130796.270213:0:7430:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.111@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1789130796.270232:0:7430:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.111@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1789130796.270238:0:7430:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: 00000000754fac63/0xf3fe2838e1fc1d9d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xf3fe2838e1fc1da4 expref: -99 pid: 7430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130796.270246:0:7430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: 00000000754fac63/0xf3fe2838e1fc1d9d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xf3fe2838e1fc1da4 expref: -99 pid: 7430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130796.270251:0:7430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.111@tcp lock: 00000000754fac63/0xf3fe2838e1fc1d9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xf3fe2838e1fc1da4 expref: -99 pid: 7430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130796.270276:0:7430:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789130796.270304:0:7430:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff91ddfce33000 10000000:01000000:0.0:1789130796.270310:0:7430:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789130796.270314:0:7430:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff91ddd10e8000 10000000:01000000:0.0:1789130796.270317:0:7430:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1789130796.270321:0:7430:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff91ddd10e8000 from 1 10000000:01000000:0.0:1789130796.270324:0:7430:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1789130796.270343:0:7430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: 00000000106c77d5/0xf3fe2838e1fc1dab lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130796.270350:0:7430:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: 00000000106c77d5/0xf3fe2838e1fc1dab lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130796.270358:0:7430:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: 00000000106c77d5/0xf3fe2838e1fc1dab lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130796.270371:0:7430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003929a872 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:7430:1876039508694272:0@lo:101: 00000100:00100000:0.0:1789130796.270415:0:7430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130796.270449:0:7430:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c38ffa3b going to sleep for 11 seconds 00000100:00100000:2.0:1789130796.270517:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508694272 00000100:00100000:2.0:1789130796.270523:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508694272 00000100:00100000:2.0:1789130796.270560:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789130796.270567:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000038caa93d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+10:7430:x1876039508694272:12345-0@lo:101: 00010000:00010000:2.0:1789130796.270575:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130796.270586:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002d7aec4b/0xf3fe2838e1fc1db2 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3fe2838e1fc1dab expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130796.270604:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002d7aec4b/0xf3fe2838e1fc1db2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3fe2838e1fc1dab expref: 11 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130796.270613:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002d7aec4b/0xf3fe2838e1fc1db2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc1dab expref: 11 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130796.270620:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002d7aec4b, rc 0) 00000100:00100000:2.0:1789130796.270661:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000038caa93d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+11:7430:x1876039508694272:12345-0@lo:101: Request processed in 94us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130796.270668:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789130796.270888:0:7430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003929a872 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:7430:1876039508694272:0@lo:101: 00010000:00010000:0.0:1789130796.270899:0:7430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: 00000000106c77d5/0xf3fe2838e1fc1dab lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc1db2 expref: -99 pid: 7430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130796.270907:0:7430:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: 00000000106c77d5/0xf3fe2838e1fc1dab lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3fe2838e1fc1db2 expref: -99 pid: 7430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130796.271028:0:6488:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789130796.271035:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: 00000000754fac63/0xf3fe2838e1fc1d9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xf3fe2838e1fc1da4 expref: -99 pid: 7430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130796.271045:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000754fac63 already unused, calling callback (00000000af325768) 10000000:00010000:1.0:1789130796.271048:0:6488:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: 00000000754fac63/0xf3fe2838e1fc1d9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xf3fe2838e1fc1da4 expref: -99 pid: 7430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130796.271057:0:6488:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: 00000000754fac63/0xf3fe2838e1fc1d9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xf3fe2838e1fc1da4 expref: -99 pid: 7430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789130796.271064:0:6488:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: 00000000754fac63/0xf3fe2838e1fc1d9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0xf3fe2838e1fc1da4 expref: -99 pid: 7430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789130796.271070:0:6488:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789130796.271095:0:6488:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: 00000000754fac63/0xf3fe2838e1fc1d9d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xf3fe2838e1fc1da4 expref: -99 pid: 7430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130796.271103:0:6488:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789130796.271141:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: 00000000754fac63/0xf3fe2838e1fc1d9d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xf3fe2838e1fc1da4 expref: -99 pid: 7430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130796.271148:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: 00000000754fac63/0xf3fe2838e1fc1d9d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xf3fe2838e1fc1da4 expref: -99 pid: 7430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130796.271169:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130796.271170:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130796.271172:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789130796.271534:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000297fdd80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3627:1876039508694400:0@lo:103: 00000100:00100000:2.0:1789130796.271580:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130796.272017:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508694400 00000100:00100000:1.0:1789130796.272039:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508694400 00000100:00100000:1.0:1789130796.272101:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789130796.272109:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000feb9ada pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+11:3627:x1876039508694400:12345-0@lo:103: 00010000:00010000:1.0:1789130796.272122:0:6486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789130796.272137:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000004887fac8/0xf3fe2838e1fc1da4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf3fe2838e1fc1d9d expref: 11 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130796.272154:0:6486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789130796.272192:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000feb9ada pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+10:3627:x1876039508694400:12345-0@lo:103: Request processed in 85us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130796.272201:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789130796.272721:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000297fdd80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3627:1876039508694400:0@lo:103: 10000000:01000000:0.0:1789130796.274870:0:7430:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1789130796.274941:0:7430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: 00000000106c77d5/0xf3fe2838e1fc1dab lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc1db2 expref: -99 pid: 7430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130796.274955:0:7430:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: 00000000106c77d5/0xf3fe2838e1fc1dab lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc1db2 expref: -99 pid: 7430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789130796.274968:0:7430:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff91ddfce33000 10000000:01000000:0.0:1789130796.274979:0:7430:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1789130796.274985:0:7430:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff91ddfce33000 from 1 10000000:01000000:0.0:1789130796.274988:0:7430:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1789130796.275032:0:7430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: 00000000ba18140b/0xf3fe2838e1fc1db9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130796.275040:0:7430:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: 00000000ba18140b/0xf3fe2838e1fc1db9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130796.275051:0:7430:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: 00000000ba18140b/0xf3fe2838e1fc1db9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130796.275089:0:7430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003929a872 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:7430:1876039508694528:0@lo:101: 00000100:00100000:0.0:1789130796.275167:0:7430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130796.275245:0:7430:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c38ffa3b going to sleep for 11 seconds 00000100:00100000:2.0:1789130796.276913:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508694528 00000100:00100000:2.0:1789130796.276930:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508694528 00000100:00100000:2.0:1789130796.277021:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789130796.277033:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000befb6e44 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+10:7430:x1876039508694528:12345-0@lo:101: 00010000:00010000:2.0:1789130796.277069:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130796.277087:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003a4f79fd/0xf3fe2838e1fc1dc0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3fe2838e1fc1db9 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130796.277119:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003a4f79fd/0xf3fe2838e1fc1dc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3fe2838e1fc1db9 expref: 11 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130796.277131:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003a4f79fd/0xf3fe2838e1fc1dc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc1db9 expref: 11 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130796.277143:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003a4f79fd, rc 0) 00000100:00100000:2.0:1789130796.277223:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000befb6e44 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+11:7430:x1876039508694528:12345-0@lo:101: Request processed in 194us (2057us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130796.277231:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789130796.277504:0:7430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003929a872 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:7430:1876039508694528:0@lo:101: 00010000:00010000:0.0:1789130796.277525:0:7430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: 00000000ba18140b/0xf3fe2838e1fc1db9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc1dc0 expref: -99 pid: 7430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130796.277535:0:7430:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: 00000000ba18140b/0xf3fe2838e1fc1db9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3fe2838e1fc1dc0 expref: -99 pid: 7430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789130796.277559:0:7430:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1789130796.277576:0:7430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: 00000000ba18140b/0xf3fe2838e1fc1db9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc1dc0 expref: -99 pid: 7430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130796.277584:0:7430:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: 00000000ba18140b/0xf3fe2838e1fc1db9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc1dc0 expref: -99 pid: 7430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789130796.277593:0:7430:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1789130796.277600:0:7430:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789130796.277606:0:7430:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff91ddfce33000 10000000:01000000:0.0:1789130796.277611:0:7430:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1789130796.277615:0:7430:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:0.0:1789130796.277618:0:7430:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1789130796.277648:0:7430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: 000000000207ef97/0xf3fe2838e1fc1dc7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130796.277656:0:7430:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: 000000000207ef97/0xf3fe2838e1fc1dc7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130796.277663:0:7430:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: 000000000207ef97/0xf3fe2838e1fc1dc7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130796.277682:0:7430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003929a872 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:7430:1876039508694656:0@lo:101: 00000100:00100000:0.0:1789130796.277732:0:7430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130796.277779:0:7430:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c38ffa3b going to sleep for 11 seconds 00000100:00100000:2.0:1789130796.278220:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508694656 00000100:00100000:2.0:1789130796.278228:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508694656 00000100:00100000:2.0:1789130796.278277:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789130796.278285:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a20003c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+11:7430:x1876039508694656:12345-0@lo:101: 00010000:00010000:2.0:1789130796.278296:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130796.278310:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000008ea38fd2/0xf3fe2838e1fc1dce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3fe2838e1fc1dc7 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130796.278328:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008ea38fd2/0xf3fe2838e1fc1dce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3fe2838e1fc1dc7 expref: 12 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130796.278338:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000008ea38fd2/0xf3fe2838e1fc1dce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc1dc7 expref: 12 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130796.278345:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000008ea38fd2, rc 0) 00000100:00100000:2.0:1789130796.279197:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a20003c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+12:7430:x1876039508694656:12345-0@lo:101: Request processed in 909us (1462us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130796.279208:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789130796.279317:0:7430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003929a872 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:7430:1876039508694656:0@lo:101: 00010000:00010000:0.0:1789130796.279336:0:7430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: 000000000207ef97/0xf3fe2838e1fc1dc7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc1dce expref: -99 pid: 7430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130796.279346:0:7430:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: 000000000207ef97/0xf3fe2838e1fc1dc7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3fe2838e1fc1dce expref: -99 pid: 7430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130796.279582:0:7430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003929a872 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:7430:1876039508694784:0@lo:501: 00000100:00100000:0.0:1789130796.279619:0:7430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130796.279656:0:7430:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c38ffa3b going to sleep for 11 seconds 00000100:00100000:2.0:1789130796.279895:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508694784 00000100:00100000:2.0:1789130796.279901:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508694784 00000100:00100000:2.0:1789130796.280058:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789130796.280076:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000999932eb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+12:7430:x1876039508694784:12345-0@lo:501: 00000100:00100000:2.0:1789130796.280216:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000999932eb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+12:7430:x1876039508694784:12345-0@lo:501: Request processed in 142us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130796.280224:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789130796.280317:0:7430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003929a872 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:7430:1876039508694784:0@lo:501: 00000100:00100000:0.0:1789130796.280367:0:7430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003929a872 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:7430:1876039508694912:0@lo:503: 00000100:00100000:0.0:1789130796.280419:0:7430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130796.280671:0:7430:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c38ffa3b going to sleep for 11 seconds 00000100:00100000:3.0:1789130796.280712:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508694912 00000100:00100000:3.0:1789130796.280718:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508694912 00000100:00100000:3.0:1789130796.280748:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789130796.280753:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000abbd8f93 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+12:7430:x1876039508694912:12345-0@lo:503: 00000100:00100000:3.0:1789130796.281008:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000abbd8f93 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+12:7430:x1876039508694912:12345-0@lo:503: Request processed in 253us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130796.281015:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789130796.281173:0:7430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003929a872 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:7430:1876039508694912:0@lo:503: 00000040:00080000:0.0:1789130796.281677:0:7430:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789130796.281776:0:7430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003929a872 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:7430:1876039508695040:0@lo:502: 00000100:00100000:0.0:1789130796.281904:0:7430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130796.282050:0:7430:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c38ffa3b going to sleep for 11 seconds 00000100:00100000:3.0:1789130796.282157:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508695040 00000100:00100000:3.0:1789130796.282166:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508695040 00000100:00100000:3.0:1789130796.282256:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789130796.282265:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000024aa97a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+12:7430:x1876039508695040:12345-0@lo:502: 00000100:00100000:3.0:1789130796.282491:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000024aa97a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+12:7430:x1876039508695040:12345-0@lo:502: Request processed in 227us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130796.282498:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789130796.282586:0:7430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003929a872 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:7430:1876039508695040:0@lo:502: 00000040:00080000:0.0:1789130796.282857:0:7430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1789130796.282887:0:7430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 136 off8552 00000040:00080000:0.0:1789130796.283041:0:7430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 176 off8728 00000040:00080000:0.0:1789130796.283072:0:7430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8952 00000040:00080000:0.0:1789130796.283097:0:7430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9176 00000040:00080000:0.0:1789130796.283109:0:7430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 120 off9296 00000040:00080000:0.0:1789130796.283119:0:7430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 112 off9408 00000040:00080000:0.0:1789130796.283129:0:7430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 160 off9568 00000040:00080000:0.0:1789130796.283139:0:7430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9792 00000040:00080000:0.0:1789130796.283150:0:7430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10016 00000040:00080000:0.0:1789130796.283161:0:7430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 88 off10104 00000040:00080000:0.0:1789130796.283172:0:7430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 144 off10248 00000040:00080000:0.0:1789130796.283182:0:7430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].13, 152 off10400 00000040:00080000:0.0:1789130796.283192:0:7430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].14, 168 off10568 00000040:00080000:0.0:1789130796.283202:0:7430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].15, 224 off10792 00000040:00080000:0.0:1789130796.283213:0:7430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].16, 224 off11016 00000040:00080000:0.0:1789130796.283225:0:7430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].17, 80 off11096 00000040:00080000:0.0:1789130796.283236:0:7430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].18, 224 off11320 00000040:00080000:0.0:1789130796.283246:0:7430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].19, 224 off11544 00000040:00080000:0.0:1789130796.283258:0:7430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].20, 160 off11704 00000040:00080000:0.0:1789130796.283284:0:7430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].21, 224 off11928 00000040:00080000:0.0:1789130796.283296:0:7430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].22, 224 off12152 00000040:00080000:0.0:1789130796.283305:0:7430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].23, 80 off12232 00000100:00100000:0.0:1789130796.283337:0:7430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003929a872 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:7430:1876039508695168:0@lo:502: 00000100:00100000:0.0:1789130796.283562:0:7430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130796.283728:0:7430:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c38ffa3b going to sleep for 11 seconds 00000100:00100000:2.0:1789130796.283778:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508695168 00000100:00100000:2.0:1789130796.283786:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508695168 00000100:00100000:2.0:1789130796.283888:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789130796.283894:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007992575f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+12:7430:x1876039508695168:12345-0@lo:502: 00000100:00100000:2.0:1789130796.284170:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007992575f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+12:7430:x1876039508695168:12345-0@lo:502: Request processed in 275us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130796.284179:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789130796.284284:0:7430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003929a872 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:7430:1876039508695168:0@lo:502: 00000040:00080000:0.0:1789130796.284345:0:7430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].24, 224 off12456 00000040:00080000:0.0:1789130796.284423:0:7430:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 24 count 25 00000020:01000000:2.0:1789130796.285052:0:7443:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789130796.285123:0:7443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789130796.285127:0:7443:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1789130796.285135:0:7443:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:2.0:1789130796.285138:0:7443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789130796.285154:0:7443:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (00000000de337f00) 00000020:00000080:2.0:1789130796.285179:0:7443:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lod with refcount 2 00000020:00000080:2.0:1789130796.285184:0:7443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1789130796.285280:0:7443:0:(osd_handler.c:8895:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789130796.285288:0:7443:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xf3fe2838e1fc1ddc 00000020:00000080:2.0:1789130796.285672:0:7443:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:2.0:1789130796.285677:0:7443:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789130796.285687:0:7443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789130796.285690:0:7443:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1789130796.285693:0:7443:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789130796.285696:0:7443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789130796.285697:0:7443:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:2.0:1789130796.285700:0:7443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789130796.285708:0:7443:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (000000000057d121) 00000020:00000080:2.0:1789130796.285719:0:7443:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type mdt with refcount 2 00000020:00000080:2.0:1789130796.285722:0:7443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1789130796.285724:0:7443:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:2.0:1789130796.285728:0:7443:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:2.0:1789130796.285734:0:7443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789130796.285857:0:7443:0:(tgt_mount.c:153:server_get_mount()) get mount 000000007f192d7d from lustre-MDT0001, refs=2 00000020:00000080:2.0:1789130796.285873:0:7443:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (00000000ef13bdcf) 00000020:00000080:2.0:1789130796.285881:0:7443:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type mdd with refcount 2 00000004:01000000:2.0:1789130796.286012:0:7443:0:(lod_dev.c:2292:lod_obd_connect()) connect #0 00000020:00000080:2.0:1789130796.286018:0:7443:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf3fe2838e1fc1df1 00000020:00000080:2.0:1789130796.286191:0:7443:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:2.0:1789130796.286198:0:7443:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1789130796.286202:0:7443:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xf3fe2838e1fc1df8 00080000:01000000:2.0:1789130796.286207:0:7443:0:(osd_handler.c:8895:osd_obd_connect()) connect #2 00000020:00000080:2.0:1789130796.286210:0:7443:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xf3fe2838e1fc1dff 00080000:10000000:2.0:1789130796.286880:0:7443:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:2.0:1789130796.287151:0:7443:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0001: No data found on store. Initialize space. 00010000:00010000:1.0:1789130796.400240:0:7443:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:02000400:1.0:1789130796.400701:0:7443:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0001: new disk, initializing 00000001:00000004:1.0:1789130796.404262:0:7443:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 0 00000001:00080000:1.0:1789130796.404767:0:7443:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0001: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1789130796.421857:0:7443:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:1.0:1789130796.421877:0:7443:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789130796.421884:0:7443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789130796.421887:0:7443:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:1.0:1789130796.421892:0:7443:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789130796.421899:0:7443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789130796.421900:0:7443:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:1.0:1789130796.421903:0:7443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789130796.421962:0:7443:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.111@tcp to nid 0x20000c0a8cb6f (192.168.203.111@tcp) 00000020:00000080:1.0:1789130796.421996:0:7443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789130796.422012:0:7443:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (000000005395b71f) 00000020:00000080:1.0:1789130796.422038:0:7443:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:1.0:1789130796.422042:0:7443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789130796.422217:0:7443:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:1.0:1789130796.422225:0:7443:0:(osd_handler.c:8895:osd_obd_connect()) connect #3 00000020:00000080:1.0:1789130796.422247:0:7443:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xf3fe2838e1fc1e0d 00010000:00080000:1.0:1789130796.422285:0:7443:0:(ldlm_lib.c:102:import_set_conn()) imp 000000002b2e7510@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.111@tcp at head 00010000:00010000:1.0:1789130796.428326:0:7443:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-2 is initialized 00000020:00000080:3.0:1789130796.431542:0:7443:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1789130796.431564:0:7443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1789130796.431617:0:7443:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:3.0:1789130796.431647:0:7443:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf3fe2838e1fc1e14 00000100:00080000:3.0:1789130796.431662:0:7443:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789130796.431669:0:7443:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import 000000002b2e7510 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:3.0:1789130796.431717:0:7443:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000005346d128 x1876039508695296/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789130796.431740:0:7443:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1789130796.431888:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005346d128 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3624:1876039508695296:0@lo:38: 00000100:00100000:1.0:1789130796.431987:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:0.0:1789130796.433044:0:7443:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789130796.433051:0:7443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789130796.433053:0:7443:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:0.0:1789130796.433057:0:7443:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1789130796.433214:0:7443:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1789130796.433217:0:7443:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789130796.433226:0:7443:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789130796.433227:0:7443:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1789130796.433231:0:7443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789130796.433232:0:7443:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1789130796.433235:0:7443:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789130796.433239:0:7443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789130796.433240:0:7443:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:0.0:1789130796.433246:0:7443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1789130796.433299:0:7443:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1789130796.433320:0:7443:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789130796.433322:0:7443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789130796.433323:0:7443:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:0.0:1789130796.433326:0:7443:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789130796.433328:0:7443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789130796.433329:0:7443:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789130796.433331:0:7443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789130796.433333:0:7443:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789130796.433363:0:7443:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789130796.433365:0:7443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789130796.433367:0:7443:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre sys.timeout 00000040:00080000:0.0:1789130796.433369:0:7443:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000020:01000000:0.0:1789130796.433451:0:7430:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-24 (rc=0) 10000000:01000000:0.0:1789130796.433510:0:7430:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1789130796.433528:0:7430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: 000000000207ef97/0xf3fe2838e1fc1dc7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc1dce expref: -99 pid: 7430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130796.433540:0:7430:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: 000000000207ef97/0xf3fe2838e1fc1dc7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc1dce expref: -99 pid: 7430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789130796.433549:0:7430:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff91ddfce33000 from 1 10000000:01000000:0.0:1789130796.433552:0:7430:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789130796.433588:0:7430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: 000000006c33715f/0xf3fe2838e1fc1e1b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130796.433616:0:7430:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: 000000006c33715f/0xf3fe2838e1fc1e1b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130796.433629:0:7430:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: 000000006c33715f/0xf3fe2838e1fc1e1b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130796.433648:0:7430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003929a872 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:7430:1876039508695552:0@lo:101: 00000100:00100000:0.0:1789130796.433710:0:7430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130796.433762:0:7430:0:(client.c:2715:ptlrpc_set_wait()) set 00000000839c5a9f going to sleep for 11 seconds 00000100:00100000:0.0:1789130796.433787:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508695552 00000100:00100000:0.0:1789130796.433806:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508695552 00000100:00100000:0.0:1789130796.433849:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789130796.433858:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c0cc1683 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+12:7430:x1876039508695552:12345-0@lo:101: 00010000:00010000:0.0:1789130796.433873:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130796.433886:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000497375fc/0xf3fe2838e1fc1e22 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3fe2838e1fc1e1b expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130796.434056:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000497375fc/0xf3fe2838e1fc1e22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3fe2838e1fc1e1b expref: 13 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130796.434123:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000497375fc/0xf3fe2838e1fc1e22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc1e1b expref: 13 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130796.434132:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000497375fc, rc 0) 00000100:00100000:0.0:1789130796.434173:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c0cc1683 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+13:7430:x1876039508695552:12345-0@lo:101: Request processed in 316us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130796.434180:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789130796.434231:0:7430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003929a872 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:7430:1876039508695552:0@lo:101: 00010000:00010000:0.0:1789130796.434251:0:7430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: 000000006c33715f/0xf3fe2838e1fc1e1b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc1e22 expref: -99 pid: 7430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130796.434259:0:7430:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: 000000006c33715f/0xf3fe2838e1fc1e1b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3fe2838e1fc1e22 expref: -99 pid: 7430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130796.436346:0:7430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003929a872 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:7430:1876039508695680:0@lo:256: 00000100:00100000:0.0:1789130796.436438:0:7430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130796.436491:0:7430:0:(client.c:2715:ptlrpc_set_wait()) set 00000000839c5a9f going to sleep for 11 seconds 00000100:00100000:1.0:1789130796.436988:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508695680 00000100:00100000:1.0:1789130796.437000:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508695680 00000100:00100000:1.0:1789130796.437055:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789130796.437134:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000af6b83b7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+13:7430:x1876039508695680:12345-0@lo:256: 20000000:01000000:1.0:1789130796.437162:0:6494:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1789130796.437183:0:6494:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1789130796.437186:0:6494:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:1.0:1789130796.437289:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000af6b83b7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+13:7430:x1876039508695680:12345-0@lo:256: Request processed in 159us (851us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130796.437298:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789130796.437728:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a022112a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3628:1876039508695424:0@lo:400: 00000100:00100000:3.0:1789130796.437778:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130796.437907:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508695296 00000100:00100000:1.0:1789130796.437999:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508695424 00000100:00100000:1.0:1789130796.438004:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508695424 00000100:00100000:1.0:1789130796.438037:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789130796.438043:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009bdd9e51 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1876039508695424:12345-0@lo:400: 00000100:00100000:0.0:1789130796.438182:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508695296 00000100:00100000:0.0:1789130796.438211:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789130796.438216:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000cb1c895 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3624:x1876039508695296:12345-0@lo:38: 00010000:00080000:0.0:1789130796.438237:0:6505:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 152 last 0 00000020:00000080:0.0:1789130796.438272:0:6505:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf3fe2838e1fc1e29 00000004:00100000:0.0:1789130796.438289:0:6505:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1789130796.438295:0:6505:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:0.0:1789130796.438417:0:7430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003929a872 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:7430:1876039508695680:0@lo:256: 00000100:00100000:1.0:1789130796.438879:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009bdd9e51 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1876039508695424:12345-0@lo:400: Request processed in 835us (1100us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130796.438889:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1789130796.439013:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000a022112a x1876039508695424/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130812 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130796.439026:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a022112a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3628:1876039508695424:0@lo:400: 10000000:01000000:0.0:1789130796.440187:0:7430:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789130796.440253:0:7430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: 000000006c33715f/0xf3fe2838e1fc1e1b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc1e22 expref: -99 pid: 7430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130796.440267:0:7430:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: 000000006c33715f/0xf3fe2838e1fc1e1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc1e22 expref: -99 pid: 7430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789130796.440276:0:7430:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91ddfce33000 from 1 10000000:01000000:0.0:1789130796.440280:0:7430:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789130796.440333:0:7430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: 000000003ab82567/0xf3fe2838e1fc1e30 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130796.440339:0:7430:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: 000000003ab82567/0xf3fe2838e1fc1e30 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130796.440349:0:7430:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: 000000003ab82567/0xf3fe2838e1fc1e30 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130796.440372:0:7430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003929a872 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:7430:1876039508695808:0@lo:101: 00000100:00100000:0.0:1789130796.440528:0:7430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130796.440569:0:7430:0:(client.c:2715:ptlrpc_set_wait()) set 00000000839c5a9f going to sleep for 11 seconds 00000100:00100000:1.0:1789130796.442685:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508695808 00000100:00100000:1.0:1789130796.442703:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508695808 00000100:00100000:1.0:1789130796.442773:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789130796.442782:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000346b345f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+13:7430:x1876039508695808:12345-0@lo:101: 00010000:00010000:1.0:1789130796.442816:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130796.442837:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c127434d/0xf3fe2838e1fc1e37 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3fe2838e1fc1e30 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130796.442881:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c127434d/0xf3fe2838e1fc1e37 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3fe2838e1fc1e30 expref: 14 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130796.442893:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c127434d/0xf3fe2838e1fc1e37 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc1e30 expref: 14 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130796.442903:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c127434d, rc 0) 00000100:00100000:1.0:1789130796.443002:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000346b345f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+14:7430:x1876039508695808:12345-0@lo:101: Request processed in 221us (2475us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130796.443010:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789130796.445496:0:7430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003929a872 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:7430:1876039508695808:0@lo:101: 00010000:00010000:0.0:1789130796.445532:0:7430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: 000000003ab82567/0xf3fe2838e1fc1e30 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc1e37 expref: -99 pid: 7430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130796.445547:0:7430:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: 000000003ab82567/0xf3fe2838e1fc1e30 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3fe2838e1fc1e37 expref: -99 pid: 7430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130796.445886:0:7430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003929a872 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:7430:1876039508695936:0@lo:501: 00000100:00100000:0.0:1789130796.445960:0:7430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130796.446012:0:7430:0:(client.c:2715:ptlrpc_set_wait()) set 0000000007a79f1a going to sleep for 11 seconds 00000100:00100000:3.0:1789130796.446320:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508695936 00000100:00100000:3.0:1789130796.446327:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508695936 00000100:00100000:3.0:1789130796.446380:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789130796.446389:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009a678161 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+14:7430:x1876039508695936:12345-0@lo:501: 00000100:00100000:3.0:1789130796.446550:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009a678161 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+14:7430:x1876039508695936:12345-0@lo:501: Request processed in 162us (589us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130796.446558:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789130796.446666:0:7430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003929a872 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:7430:1876039508695936:0@lo:501: 00000100:00100000:0.0:1789130796.446699:0:7430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003929a872 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:7430:1876039508696064:0@lo:503: 00000100:00100000:0.0:1789130796.446747:0:7430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130796.446777:0:7430:0:(client.c:2715:ptlrpc_set_wait()) set 0000000007a79f1a going to sleep for 11 seconds 00000100:00100000:3.0:1789130796.446932:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508696064 00000100:00100000:3.0:1789130796.446936:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508696064 00000100:00100000:3.0:1789130796.446966:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789130796.446973:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000051f669ee pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+14:7430:x1876039508696064:12345-0@lo:503: 00000040:00080000:3.0:1789130796.447006:0:6493:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789130796.447044:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000051f669ee pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+14:7430:x1876039508696064:12345-0@lo:503: Request processed in 71us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130796.447051:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789130796.447188:0:7430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003929a872 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:7430:1876039508696064:0@lo:503: 00000040:00080000:0.0:1789130796.447540:0:7430:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789130796.447623:0:7430:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 1 count 1 00000040:00080000:0.0:1789130796.447704:0:7430:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789130796.448858:0:7448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 00000020:01000000:3.0:1789130796.449185:0:7430:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:3.0:1789130796.449212:0:7430:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789130796.449236:0:7430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: 000000003ab82567/0xf3fe2838e1fc1e30 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc1e37 expref: -99 pid: 7430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130796.449248:0:7430:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: 000000003ab82567/0xf3fe2838e1fc1e30 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc1e37 expref: -99 pid: 7430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789130796.449322:0:7430:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789130796.449325:0:7430:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff91ddfce33000 10000000:01000000:3.0:1789130796.449329:0:7430:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff91ddfce33000 10000000:01000000:3.0:1789130796.449333:0:7430:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789130796.449338:0:7430:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff91ddfce33000 from 1 10000000:01000000:3.0:1789130796.449341:0:7430:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789130796.449377:0:7430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: 00000000191121e4/0xf3fe2838e1fc1e3e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130796.449383:0:7430:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: 00000000191121e4/0xf3fe2838e1fc1e3e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130796.449403:0:7430:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: 00000000191121e4/0xf3fe2838e1fc1e3e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130796.449424:0:7430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a022112a pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:7430:1876039508696192:0@lo:101: 00000100:00100000:3.0:1789130796.449510:0:7430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130796.449550:0:7430:0:(client.c:2715:ptlrpc_set_wait()) set 000000008d55a026 going to sleep for 11 seconds 00000100:00100000:0.0:1789130796.449649:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508696192 00000100:00100000:0.0:1789130796.449656:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508696192 00000100:00100000:0.0:1789130796.449698:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789130796.449706:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000023d8e1d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+14:7430:x1876039508696192:12345-0@lo:101: 00010000:00010000:0.0:1789130796.449720:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130796.449734:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000001e5da41a/0xf3fe2838e1fc1e45 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3fe2838e1fc1e3e expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130796.449760:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001e5da41a/0xf3fe2838e1fc1e45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3fe2838e1fc1e3e expref: 15 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130796.449770:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000001e5da41a/0xf3fe2838e1fc1e45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc1e3e expref: 15 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130796.449779:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000001e5da41a, rc 0) 00000100:00100000:0.0:1789130796.450005:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000023d8e1d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+15:7430:x1876039508696192:12345-0@lo:101: Request processed in 299us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130796.450013:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789130796.450200:0:7430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a022112a pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:7430:1876039508696192:0@lo:101: 00010000:00010000:3.0:1789130796.450216:0:7430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: 00000000191121e4/0xf3fe2838e1fc1e3e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc1e45 expref: -99 pid: 7430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130796.450224:0:7430:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: 00000000191121e4/0xf3fe2838e1fc1e3e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3fe2838e1fc1e45 expref: -99 pid: 7430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130796.450324:0:7430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a022112a pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:7430:1876039508696320:0@lo:501: 00000100:00100000:3.0:1789130796.450350:0:7430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130796.450398:0:7430:0:(client.c:2715:ptlrpc_set_wait()) set 000000008d55a026 going to sleep for 11 seconds 00000100:00100000:0.0:1789130796.451428:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508696320 00000100:00100000:0.0:1789130796.451440:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508696320 00000100:00100000:0.0:1789130796.451498:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789130796.451507:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c2d512c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+15:7430:x1876039508696320:12345-0@lo:501: 00000100:00100000:0.0:1789130796.451675:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c2d512c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+15:7430:x1876039508696320:12345-0@lo:501: Request processed in 169us (1323us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130796.451683:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789130796.451768:0:7430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a022112a pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:7430:1876039508696320:0@lo:501: 00000100:00100000:3.0:1789130796.451821:0:7430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a022112a pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:7430:1876039508696448:0@lo:503: 00000100:00100000:3.0:1789130796.451866:0:7430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130796.451899:0:7430:0:(client.c:2715:ptlrpc_set_wait()) set 000000008d55a026 going to sleep for 11 seconds 00000100:00100000:0.0:1789130796.452051:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508696448 00000100:00100000:0.0:1789130796.452069:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508696448 00000100:00100000:0.0:1789130796.452098:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789130796.452104:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002d9f432f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+15:7430:x1876039508696448:12345-0@lo:503: 00000100:00100000:0.0:1789130796.452181:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002d9f432f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+15:7430:x1876039508696448:12345-0@lo:503: Request processed in 77us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130796.452188:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789130796.452308:0:7430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a022112a pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:7430:1876039508696448:0@lo:503: 00000040:00080000:3.0:1789130796.452695:0:7430:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789130796.452765:0:7430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a022112a pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:7430:1876039508696576:0@lo:502: 00000100:00100000:3.0:1789130796.452810:0:7430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130796.452827:0:7430:0:(client.c:2715:ptlrpc_set_wait()) set 00000000149492ce going to sleep for 11 seconds 00000100:00100000:1.0:1789130796.453286:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508696576 00000100:00100000:1.0:1789130796.453293:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508696576 00000100:00100000:1.0:1789130796.453333:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789130796.453340:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008a233fb6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+15:7430:x1876039508696576:12345-0@lo:502: 00000100:00100000:1.0:1789130796.453507:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008a233fb6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+15:7430:x1876039508696576:12345-0@lo:502: Request processed in 117us (646us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130796.453515:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789130796.453780:0:7430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a022112a pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:7430:1876039508696576:0@lo:502: 00000040:00080000:3.0:1789130796.454276:0:7430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1789130796.454305:0:7430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1789130796.454318:0:7430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1789130796.454329:0:7430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1789130796.454353:0:7430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1789130796.454367:0:7430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1789130796.454381:0:7430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1789130796.454407:0:7430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1789130796.454423:0:7430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1789130796.454436:0:7430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1789130796.454449:0:7430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1789130796.454558:0:7430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1789130796.454577:0:7430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1789130796.454588:0:7430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1789130796.454600:0:7430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1789130796.454611:0:7430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1789130796.454623:0:7430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1789130796.454634:0:7430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1789130796.454655:0:7430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1789130796.454667:0:7430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1789130796.454687:0:7430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1789130796.454700:0:7430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1789130796.454711:0:7430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1789130796.454722:0:7430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1789130796.454734:0:7430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:3.0:1789130796.454745:0:7430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:3.0:1789130796.454757:0:7430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:3.0:1789130796.454768:0:7430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000100:00100000:3.0:1789130796.455129:0:7430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a022112a pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:7430:1876039508696704:0@lo:502: 00000100:00100000:3.0:1789130796.455201:0:7430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130796.455270:0:7430:0:(client.c:2715:ptlrpc_set_wait()) set 00000000149492ce going to sleep for 11 seconds 00000100:00080000:2.0:1789130796.455562:0:6505:0:(import.c:65:import_set_state_nolock()) 00000000d33d5c97 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789130796.455642:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000cb1c895 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3624:x1876039508695296:12345-0@lo:38: Request processed in 17424us (23654us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130796.455658:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789130796.455767:0:3624:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789130796.455777:0:3624:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 1 00000100:00080000:3.0:1789130796.455789:0:3624:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1789130796.455807:0:3624:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789130796.455809:0:3624:0:(import.c:65:import_set_state_nolock()) 000000002b2e7510 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789130796.455826:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005346d128 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3624:1876039508695296:0@lo:38: 00000100:00100000:2.0:1789130796.456140:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003929a872 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508696832:0@lo:41: 00000100:00100000:2.0:1789130796.456180:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130796.456267:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508696832 00000100:00100000:3.0:1789130796.456274:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508696832 00000100:00100000:3.0:1789130796.456315:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789130796.456323:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000002f3bb8c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3625:x1876039508696832:12345-0@lo:41: 00000004:00000024:3.0:1789130796.456352:0:6506:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:3.0:1789130796.456412:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000002f3bb8c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3625:x1876039508696832:12345-0@lo:41: Request processed in 90us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130796.456419:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789130796.456452:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003929a872 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508696832:0@lo:41: 00000100:00100000:1.0:1789130796.456685:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508696704 00000100:00100000:1.0:1789130796.456690:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508696704 00000100:00100000:1.0:1789130796.456750:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789130796.456757:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005785489a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+15:7430:x1876039508696704:12345-0@lo:502: 00000100:00100000:1.0:1789130796.456876:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005785489a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+15:7430:x1876039508696704:12345-0@lo:502: Request processed in 120us (1676us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130796.456883:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789130796.457007:0:7430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a022112a pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:7430:1876039508696704:0@lo:502: 00000040:00080000:3.0:1789130796.457087:0:7430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:3.0:1789130796.457099:0:7430:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:3.0:1789130796.457875:0:7449:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:3.0:1789130796.457894:0:7449:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (00000000869ada52) 00000020:00000080:3.0:1789130796.457930:0:7449:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:3.0:1789130796.458022:0:7449:0:(tgt_mount.c:153:server_get_mount()) get mount 000000007f192d7d from lustre-MDT0001, refs=3 00000020:01000004:3.0:1789130796.458026:0:7449:0:(tgt_mount.c:187:server_put_mount()) put mount 000000007f192d7d from lustre-MDT0001, refs=3 00000020:01000004:3.0:1789130796.458029:0:7449:0:(obd_mount.c:710:lustre_put_lsi()) put 000000007f192d7d 3 00010000:00080000:3.0:1789130796.458072:0:7449:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000869bd6e4@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.111@tcp at head 00010000:00010000:3.0:1789130796.459705:0:7449:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-3 is initialized 00000020:00000080:3.0:1789130796.459978:0:7449:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:3.0:1789130796.460031:0:7449:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789130796.460047:0:7449:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xf3fe2838e1fc1e53 00000100:00080000:3.0:1789130796.460059:0:7449:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789130796.460065:0:7449:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import 00000000869bd6e4 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:3.0:1789130796.460111:0:7449:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000a022112a x1876039508696960/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789130796.460139:0:7449:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1789130796.460482:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a022112a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3624:1876039508696960:0@lo:38: 00000100:00100000:2.0:1789130796.460584:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:2.0:1789130796.462205:0:7449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:2.0:1789130796.462283:0:7430:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:2.0:1789130796.462331:0:7430:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789130796.462350:0:7430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: 00000000191121e4/0xf3fe2838e1fc1e3e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc1e45 expref: -99 pid: 7430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130796.462363:0:7430:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: 00000000191121e4/0xf3fe2838e1fc1e3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc1e45 expref: -99 pid: 7430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789130796.462426:0:7430:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789130796.462429:0:7430:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789130796.462430:0:7430:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789130796.462431:0:7430:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789130796.462432:0:7430:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789130796.462434:0:7430:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789130796.462435:0:7430:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789130796.462437:0:7430:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789130796.462438:0:7430:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789130796.462440:0:7430:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789130796.462442:0:7430:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789130796.462446:0:7430:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020061 00000020:01000004:2.0:1789130796.462449:0:7430:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789130796.462450:0:7430:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789130796.462451:0:7430:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789130796.462452:0:7430:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789130796.462453:0:7430:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789130796.462454:0:7430:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789130796.462455:0:7430:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789130796.462456:0:7430:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789130796.462476:0:7430:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789130796.462477:0:7430:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789130796.462478:0:7430:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789130796.462507:0:7430:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1789130796.462526:0:7430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a814f9e3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:7430:1876039508697088:0@lo:253: 00000100:00100000:2.0:1789130796.462599:0:7430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130796.462645:0:7430:0:(client.c:2715:ptlrpc_set_wait()) set 000000006ea17ff7 going to sleep for 11 seconds 40000000:00080000:1.0:1789130796.462930:0:7450:0:(fid_handler.c:282:seq_server_check_and_alloc_super()) srv-lustre-MDT0001: Can't allocate super-sequence: rc = -115 00000100:00100000:3.0:1789130796.464859:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508696960 00000100:00100000:3.0:1789130796.464880:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508696960 00000100:00100000:2.0:1789130796.468436:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508697088 00000100:00100000:2.0:1789130796.468456:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508697088 00000100:00100000:2.0:1789130796.468556:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789130796.468566:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ae6de966 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+15:7430:x1876039508697088:12345-0@lo:253: 20000000:01000000:2.0:1789130796.468612:0:6493:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1789130796.468630:0:6493:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1789130796.468877:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789130796.468884:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d7bd7d14 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3624:x1876039508696960:12345-0@lo:38: 00010000:00080000:3.0:1789130796.468923:0:6502:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 152 last 0 00000020:00000080:3.0:1789130796.468968:0:6502:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xf3fe2838e1fc1e5a 00000004:00100000:3.0:1789130796.468988:0:6502:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789130796.469026:0:6502:0:(import.c:65:import_set_state_nolock()) 000000004fe1f000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789130796.470889:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d7bd7d14 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1876039508696960:12345-0@lo:38: Request processed in 1995us (10297us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130796.470920:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1789130796.470999:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000a022112a x1876039508696960/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789130806 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130796.471014:0:3624:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789130796.471027:0:3624:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 1 00000100:00080000:3.0:1789130796.471037:0:3624:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1789130796.471043:0:3624:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789130796.471046:0:3624:0:(import.c:65:import_set_state_nolock()) 00000000869bd6e4 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789130796.471053:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a022112a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3624:1876039508696960:0@lo:38: 00000001:00100000:1.0:1789130796.474949:0:6479:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:3.0:1789130796.475159:0:6493:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789130796.475182:0:6493:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:3.0:1789130796.475566:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ae6de966 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+15:7430:x1876039508697088:12345-0@lo:253: Request processed in 6996us (12961us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130796.475582:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789130796.475670:0:7430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a814f9e3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:7430:1876039508697088:0@lo:253: 10000000:01000000:3.0:1789130796.475687:0:7430:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1789130796.475690:0:7430:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789130796.475692:0:7430:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1789130796.475693:0:7430:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789130796.475695:0:7430:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789130796.475696:0:7430:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789130796.475697:0:7430:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789130796.475699:0:7430:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789130796.475700:0:7430:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789130796.475702:0:7430:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789130796.475703:0:7430:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789130796.475705:0:7430:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789130796.475723:0:7430:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:1.0:1789130796.477675:0:6516:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1789130796.477688:0:6516:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1789130796.477715:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000803fd2dc/0xf3fe2838e1fc1e61 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130796.477737:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000000f5cba9c/0xf3fe2838e1fc1d81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc1d7a expref: 14 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130796.477745:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000497375fc/0xf3fe2838e1fc1e22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc1e1b expref: 14 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130796.477753:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000803fd2dc/0xf3fe2838e1fc1e61 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130796.477805:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000497375fc/0xf3fe2838e1fc1e22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf3fe2838e1fc1e1b expref: 14 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130796.477825:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000497375fc/0xf3fe2838e1fc1e22 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf3fe2838e1fc1e1b expref: 14 pid: 6492 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130796.477841:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ad8b2570 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6516:1876039508697216:0@lo:104: 00000100:00100000:1.0:1789130796.477916:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789130796.477986:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000000f5cba9c/0xf3fe2838e1fc1d81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf3fe2838e1fc1d7a expref: 14 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130796.477995:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000000f5cba9c/0xf3fe2838e1fc1d81 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf3fe2838e1fc1d7a expref: 14 pid: 6494 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130796.478002:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009cba34be pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6516:1876039508697344:0@lo:104: 00000100:00100000:1.0:1789130796.478024:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130796.478047:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f22b5c4f going to sleep for 11 seconds 00000100:00100000:0.0:1789130796.478125:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508697216 00000100:00100000:0.0:1789130796.478136:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508697216 00000100:00100000:0.0:1789130796.478180:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508697344 00000100:00100000:0.0:1789130796.478184:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508697344 00000100:00100000:2.0:1789130796.478196:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789130796.478207:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001cfdbd9a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+4:6516:x1876039508697216:12345-0@lo:104: 00010000:00010000:2.0:1789130796.478222:0:6484:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: 000000006c33715f/0xf3fe2838e1fc1e1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3fe2838e1fc1e22 expref: -99 pid: 7430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130796.478295:0:6484:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789130796.478301:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001cfdbd9a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+4:6516:x1876039508697216:12345-0@lo:104: Request processed in 97us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130796.478367:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ad8b2570 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6516:1876039508697216:0@lo:104: 00000100:00100000:2.0:1789130796.479750:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789130796.479790:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789130796.479804:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002d8c873f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+3:6516:x1876039508697344:12345-0@lo:104: 00010000:00010000:2.0:1789130796.479819:0:6484:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: 00000000bec0997c/0xf3fe2838e1fc1d7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3fe2838e1fc1d81 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130796.479895:0:6484:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789130796.479899:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002d8c873f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+3:6516:x1876039508697344:12345-0@lo:104: Request processed in 104us (1875us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130796.479904:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789130796.479941:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009cba34be pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6516:1876039508697344:0@lo:104: 00010000:00010000:2.0:1789130796.479976:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000803fd2dc/0xf3fe2838e1fc1e61 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130796.480518:0:6489:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789130796.480527:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: 000000006c33715f/0xf3fe2838e1fc1e1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3fe2838e1fc1e22 expref: -99 pid: 7430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130796.480536:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000006c33715f already unused, calling callback (00000000af325768) 10000000:00010000:2.0:1789130796.480540:0:6489:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: 000000006c33715f/0xf3fe2838e1fc1e1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf3fe2838e1fc1e22 expref: -99 pid: 7430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130796.480548:0:6489:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: 000000006c33715f/0xf3fe2838e1fc1e1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf3fe2838e1fc1e22 expref: -99 pid: 7430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789130796.480554:0:6489:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: 000000006c33715f/0xf3fe2838e1fc1e1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf3fe2838e1fc1e22 expref: -99 pid: 7430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789130796.480559:0:6489:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789130796.480604:0:6489:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: 000000006c33715f/0xf3fe2838e1fc1e1b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc1e22 expref: -99 pid: 7430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130796.480612:0:6489:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789130796.480644:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: 000000006c33715f/0xf3fe2838e1fc1e1b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc1e22 expref: -99 pid: 7430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130796.480652:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: 000000006c33715f/0xf3fe2838e1fc1e1b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc1e22 expref: -99 pid: 7430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130796.480664:0:6489:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789130796.480667:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: 00000000bec0997c/0xf3fe2838e1fc1d7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3fe2838e1fc1d81 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130796.480685:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000bec0997c already unused, calling callback (00000000af325768) 10000000:00010000:2.0:1789130796.480687:0:6489:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: 00000000bec0997c/0xf3fe2838e1fc1d7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf3fe2838e1fc1d81 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130796.480693:0:6489:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: 00000000bec0997c/0xf3fe2838e1fc1d7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf3fe2838e1fc1d81 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789130796.480698:0:6489:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: 00000000bec0997c/0xf3fe2838e1fc1d7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf3fe2838e1fc1d81 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789130796.480703:0:6489:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789130796.480719:0:6489:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: 00000000bec0997c/0xf3fe2838e1fc1d7a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc1d81 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130796.480726:0:6489:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789130796.480741:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: 00000000bec0997c/0xf3fe2838e1fc1d7a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc1d81 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130796.480748:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: 00000000bec0997c/0xf3fe2838e1fc1d7a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc1d81 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130796.480762:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130796.480764:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130796.480766:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789130796.480782:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a814f9e3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3627:1876039508697600:0@lo:103: 00000100:00100000:2.0:1789130796.480834:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130796.480895:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508697600 00000100:00100000:2.0:1789130796.480904:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508697600 00010000:00010000:2.0:1789130796.480931:0:6485:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000000f5cba9c/0xf3fe2838e1fc1d81 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3fe2838e1fc1d7a expref: 15 pid: 6494 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130796.480967:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789130796.480975:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008e8cb381 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+15:3627:x1876039508697600:12345-0@lo:103: 00010000:00010000:2.0:1789130796.480987:0:6485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789130796.480992:0:6485:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000000f5cba9c/0xf3fe2838e1fc1d81 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3fe2838e1fc1d7a expref: 15 pid: 6494 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130796.481001:0:6485:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000000f5cba9c/0xf3fe2838e1fc1d81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf3fe2838e1fc1d7a expref: 15 pid: 6494 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130796.481016:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000000f5cba9c/0xf3fe2838e1fc1d81 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf3fe2838e1fc1d7a expref: 15 pid: 6494 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130796.481033:0:6485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789130796.481065:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008e8cb381 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+14:3627:x1876039508697600:12345-0@lo:103: Request processed in 92us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130796.481072:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789130796.481104:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a814f9e3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3627:1876039508697600:0@lo:103: 00010000:00010000:3.0:1789130796.481346:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789130796.481366:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001b47e26a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3626:1876039508697472:0@lo:103: 00000100:00100000:3.0:1789130796.481412:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130796.481850:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508697472 00000100:00100000:2.0:1789130796.481856:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508697472 00010000:00010000:2.0:1789130796.481873:0:6487:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000497375fc/0xf3fe2838e1fc1e22 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3fe2838e1fc1e1b expref: 14 pid: 6492 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130796.481903:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789130796.481979:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009eaca53a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+14:3626:x1876039508697472:12345-0@lo:103: 00010000:00010000:2.0:1789130796.481991:0:6487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789130796.481995:0:6487:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000497375fc/0xf3fe2838e1fc1e22 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3fe2838e1fc1e1b expref: 14 pid: 6492 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130796.482016:0:6487:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000497375fc/0xf3fe2838e1fc1e22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf3fe2838e1fc1e1b expref: 14 pid: 6492 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130796.482028:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000497375fc/0xf3fe2838e1fc1e22 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf3fe2838e1fc1e1b expref: 14 pid: 6492 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130796.482041:0:6487:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000803fd2dc/0xf3fe2838e1fc1e61 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130796.482049:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000803fd2dc/0xf3fe2838e1fc1e61 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789130796.482161:0:6487:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.008781586s 00010000:00010000:2.0:1789130796.482167:0:6487:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000803fd2dc/0xf3fe2838e1fc1e61 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130796.482174:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000803fd2dc/0xf3fe2838e1fc1e61 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130796.482180:0:6487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000803fd2dc/0xf3fe2838e1fc1e61 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130796.482186:0:6487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000803fd2dc/0xf3fe2838e1fc1e61 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130796.482192:0:6487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000803fd2dc already unused, calling callback (00000000eb258dfd) 00010000:00010000:2.0:1789130796.482195:0:6487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000803fd2dc/0xf3fe2838e1fc1e61 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130796.482203:0:6487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000803fd2dc/0xf3fe2838e1fc1e61 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130796.482232:0:6487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000803fd2dc/0xf3fe2838e1fc1e61 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130796.482243:0:6487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789130796.482282:0:6516:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000803fd2dc/0xf3fe2838e1fc1e61 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130796.482292:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000803fd2dc/0xf3fe2838e1fc1e61 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130796.482298:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000803fd2dc/0xf3fe2838e1fc1e61 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130796.482326:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009eaca53a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+13:3626:x1876039508697472:12345-0@lo:103: Request processed in 416us (914us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130796.482334:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789130796.482432:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001b47e26a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3626:1876039508697472:0@lo:103: 00080000:10000000:3.0:1789130796.483787:0:7430:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00080000:10000000:3.0:1789130796.484010:0:7430:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:3.0:1789130796.484199:0:7430:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:3.0:1789130796.484316:0:7430:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:3.0:1789130796.484670:0:7430:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:3.0:1789130796.484831:0:7430:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:3.0:1789130796.486005:0:7430:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:3.0:1789130796.486345:0:7430:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:3.0:1789130796.487028:0:7430:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:10000000:3.0:1789130796.487216:0:7430:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:3.0:1789130796.487337:0:7430:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00080000:10000000:3.0:1789130796.487683:0:7430:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00000040:01000000:2.0:1789130796.490813:0:7430:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:3.0:1789130796.491031:0:7454:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:3.0:1789130796.491036:0:7454:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:1.0:1789130796.491276:0:7455:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000100:00100000:1.0:1789130796.491346:0:7455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bdd71952 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7455:1876039508697728:0@lo:700: 00000100:00100000:1.0:1789130796.491451:0:7455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130796.491522:0:7455:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e985014c going to sleep for 11 seconds 00000100:00100000:0.0:1789130796.491526:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508697728 00000100:00100000:0.0:1789130796.491536:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508697728 00000100:00100000:1.0:1789130796.491678:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789130796.491689:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000c37acf2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:7455:x1876039508697728:12345-0@lo:700: 00000040:01000000:2.0:1789130796.491869:0:7430:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:0.0:1789130796.492614:0:7456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000096e81031 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7456:1876039508697856:0@lo:1000: 00000100:00100000:0.0:1789130796.492705:0:7456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130796.492782:0:7456:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a17289b6 going to sleep for 11 seconds 00000100:00100000:3.0:1789130796.493692:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508697856 00000100:00100000:3.0:1789130796.493705:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508697856 00000040:01000000:2.0:1789130796.493945:0:7430:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:2.0:1789130796.494100:0:7430:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1789130796.494569:0:7430:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1789130796.494578:0:7430:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:2.0:1789130796.494853:0:7430:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789130796.495729:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789130796.495748:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009b80c8fc pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7456:x1876039508697856:12345-0@lo:1000: 00000100:00100000:3.0:1789130796.495943:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009b80c8fc pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7456:x1876039508697856:12345-0@lo:1000: Request processed in 202us (3237us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130796.495952:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789130796.496087:0:7456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000096e81031 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7456:1876039508697856:0@lo:1000: 00000040:01000000:1.0:1789130796.496136:0:7456:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000100:00100000:1.0:1789130796.496184:0:7456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000db196646 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7456:1876039508697984:0@lo:700: 00000100:00100000:1.0:1789130796.496229:0:7456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130796.496262:0:7456:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b2c2e3da going to sleep for 11 seconds 00000100:00100000:0.0:1789130796.496434:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508697984 00000100:00100000:0.0:1789130796.496442:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508697984 00000100:00100000:0.0:1789130796.496649:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789130796.496658:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000029781780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7456:x1876039508697984:12345-0@lo:700: 00000100:00100000:0.0:1789130796.496778:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000029781780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7456:x1876039508697984:12345-0@lo:700: Request processed in 122us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130796.496786:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789130796.496815:0:7456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000db196646 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7456:1876039508697984:0@lo:700: 00000040:00080000:2.0:1789130796.496850:0:7430:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000100:00100000:0.0:1789130796.496876:0:7456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ba4cb56b pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7456:1876039508698112:0@lo:900: 00000100:00100000:0.0:1789130796.496914:0:7456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130796.496946:0:7456:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ca63f884 going to sleep for 11 seconds 00000040:00080000:2.0:1789130796.498692:0:7430:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1789130796.498766:0:7430:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:2.0:1789130796.499057:0:7430:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1789130796.500010:0:7430:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000100:00100000:3.0:1789130796.500604:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508698112 00000100:00100000:3.0:1789130796.500617:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508698112 00000100:00100000:3.0:1789130796.500692:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789130796.500703:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003bd77b99 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7456:x1876039508698112:12345-0@lo:900: 00000100:00100000:3.0:1789130796.500841:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003bd77b99 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7456:x1876039508698112:12345-0@lo:900: Request processed in 140us (3928us total) trans 0 rc 0/0 00100000:10000000:2.0:1789130796.501179:0:7430:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:2.0:1789130796.501342:0:7430:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00010000:00080000:1.0:1789130796.501505:0:7456:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000ba4cb56b x1876039508698112/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789130812 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789130796.501523:0:7456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ba4cb56b pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7456:1876039508698112:0@lo:900: 00000100:00100000:1.0:1789130796.501671:0:7456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000db196646 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7456:1876039508698240:0@lo:1000: 00000100:00100000:1.0:1789130796.501726:0:7456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130796.501756:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789130796.501760:0:7456:0:(client.c:2715:ptlrpc_set_wait()) set 00000000750e566f going to sleep for 11 seconds 00100000:10000000:2.0:1789130796.502014:0:7430:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:2.0:1789130796.502245:0:7430:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00000100:00100000:1.0:1789130796.502586:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508698240 00000100:00100000:1.0:1789130796.502595:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508698240 00000100:00100000:1.0:1789130796.502651:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789130796.502659:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009cba34be pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7456:x1876039508698240:12345-0@lo:1000: 00000100:00100000:1.0:1789130796.502773:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009cba34be pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7456:x1876039508698240:12345-0@lo:1000: Request processed in 114us (1047us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130796.502781:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789130796.502817:0:7456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000db196646 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7456:1876039508698240:0@lo:1000: 00000004:00080000:1.0:1789130796.502874:0:7456:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 00000000485421e2 with version 0 00000020:00100000:1.0:1789130796.502893:0:7456:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1789130796.502899:0:7456:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000db196646 x1876039508698496/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789130796.502914:0:7456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000db196646 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7456:1876039508698496:0@lo:1000: 00000100:00100000:1.0:1789130796.502946:0:7456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130796.502967:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508698496 00000100:00100000:1.0:1789130796.502970:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508698496 00000100:00100000:1.0:1789130796.502988:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789130796.502992:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ad8b2570 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7456:x1876039508698496:12345-0@lo:1000: 00000100:00100000:1.0:1789130796.503294:0:7456:0:(client.c:2715:ptlrpc_set_wait()) set 000000009d5c577b going to sleep for 11 seconds 40000000:02000000:0.0:1789130796.503560:0:6508:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt 00100000:10000000:2.0:1789130796.503802:0:7430:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:2.0:1789130796.507646:0:7430:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:2.0:1789130796.507984:0:7430:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:2.0:1789130796.508129:0:7430:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:2.0:1789130796.508332:0:7430:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:2.0:1789130796.508779:0:7430:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:2.0:1789130796.508918:0:7430:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:2.0:1789130796.509154:0:7430:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:2.0:1789130796.509320:0:7430:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:2.0:1789130796.509546:0:7430:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:2.0:1789130796.509700:0:7430:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:2.0:1789130796.509837:0:7430:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00000001:00080000:3.0:1789130796.512278:0:6479:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000100:00100000:1.0:1789130796.512545:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ad8b2570 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7456:x1876039508698496:12345-0@lo:1000: Request processed in 9545us (9592us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1789130796.512562:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000004:00080000:3.0:1789130796.512729:0:7456:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:3.0:1789130796.512736:0:7456:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1789130796.512755:0:7456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000db196646 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7456:1876039508698496:0@lo:1000: 00000100:00100000:3.0:1789130796.512870:0:7456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a022112a pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7456:1876039508698624:0@lo:1000: 00000100:00100000:3.0:1789130796.512919:0:7456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00100000:10000000:2.0:1789130796.512969:0:7430:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00000100:00100000:3.0:1789130796.512973:0:7456:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b3cf9f35 going to sleep for 11 seconds 00000100:00100000:1.0:1789130796.513365:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508698624 00000100:00100000:1.0:1789130796.513373:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508698624 00000100:00100000:1.0:1789130796.513432:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789130796.513441:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005346d128 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7456:x1876039508698624:12345-0@lo:1000: 00000100:00100000:1.0:1789130796.513562:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005346d128 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7456:x1876039508698624:12345-0@lo:1000: Request processed in 123us (644us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130796.513577:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789130796.513776:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000c37acf2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:7455:x1876039508697728:12345-0@lo:700: Request processed in 22088us (22325us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130796.513785:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1789130796.513870:0:7455:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000bdd71952 x1876039508697728/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789130812 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789130796.513886:0:7455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bdd71952 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7455:1876039508697728:0@lo:700: 40000000:02000000:0.0:1789130796.513896:0:7455:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] 00000100:00100000:3.0:1789130796.514128:0:7456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a022112a pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7456:1876039508698624:0@lo:1000: 00000040:00080000:3.0:1789130796.514158:0:7456:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:3.0:1789130796.514194:0:7456:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 000000007601989a with version 1 00100000:10000000:2.0:1789130796.514349:0:7430:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00000004:00080000:1.0:1789130796.514489:0:7446:0:(osp_trans.c:1336:osp_get_next_request()) ou 00000000a210f6d7 version 1 rpc_version 1 00000020:00100000:1.0:1789130796.514833:0:7446:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1789130796.514841:0:7446:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000297fdd80 x1876039508698880/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789130796.514860:0:7446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000297fdd80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7446:1876039508698880:0@lo:1000: 00000100:00100000:1.0:1789130796.514910:0:7446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130796.514947:0:7446:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b2c2e3da going to sleep for 11 seconds 00000100:00100000:1.0:1789130796.514966:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508698880 00000100:00100000:1.0:1789130796.514972:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508698880 00000100:00100000:1.0:1789130796.515009:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789130796.515016:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b76ed210 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7446:x1876039508698880:12345-0@lo:1000: 00100000:10000000:2.0:1789130796.515351:0:7430:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:2.0:1789130796.515610:0:7430:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:2.0:1789130796.515748:0:7430:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:2.0:1789130796.515887:0:7430:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:2.0:1789130796.516039:0:7430:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:2.0:1789130796.518775:0:7430:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:2.0:1789130796.518968:0:7430:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:2.0:1789130796.519787:0:7430:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:2.0:1789130796.519934:0:7430:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:2.0:1789130796.520978:0:7430:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:2.0:1789130796.521600:0:7430:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:2.0:1789130796.522658:0:7430:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:2.0:1789130796.522835:0:7430:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:2.0:1789130796.523007:0:7430:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000040:00080000:3.0:1789130796.525012:0:7456:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1789130796.525146:0:7456:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000001:00080000:1.0:1789130796.525735:0:6479:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000100:00100000:3.0:1789130796.525932:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b76ed210 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7446:x1876039508698880:12345-0@lo:1000: Request processed in 10912us (11017us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1789130796.525950:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000001:00000004:2.0:1789130796.525972:0:7430:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000004:00080000:1.0:1789130796.526166:0:7446:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:1.0:1789130796.526172:0:7446:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1789130796.526196:0:7446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000297fdd80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7446:1876039508698880:0@lo:1000: 00000001:00080000:2.0:1789130796.537988:0:7430:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1789130796.538076:0:7430:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffb3f441c5b988 00100000:10000000:2.0:1789130796.538087:0:7430:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:2.0:1789130796.539724:0:7430:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789130796.539771:0:7430:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.111@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789130796.539796:0:7430:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1789130796.539819:0:7430:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:2.0:1789130796.542796:0:7430:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789130796.543028:0:7430:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00000040:00080000:2.0:1789130796.572692:0:7455:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789130796.586493:0:7455:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1789130796.586604:0:7455:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1789130796.586611:0:7455:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00010000:00010000:1.0:1789130796.949894:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130797.969662:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130798.993683:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130800.017774:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130801.043221:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789130801.497284:0:7701:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg311-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 10000000:01000000:0.0:1789130801.748139:0:6497:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789130801.748147:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff91ddfce33000 from 4 10000000:01000000:0.0:1789130801.748152:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789130801.748195:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: 00000000497375fc/0xf3fe2838e1fc1e68 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130801.748208:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: 00000000497375fc/0xf3fe2838e1fc1e68 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130801.748219:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: 00000000497375fc/0xf3fe2838e1fc1e68 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130801.748241:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c549eb71 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508699008:0@lo:101: 00000100:00100000:0.0:1789130801.748310:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130801.748379:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set 00000000cde5be48 going to sleep for 11 seconds 00000100:00100000:0.0:1789130801.748402:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508699008 00000100:00100000:0.0:1789130801.748408:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508699008 00000100:00100000:0.0:1789130801.748454:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789130801.748479:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000122b74fc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+13:6497:x1876039508699008:12345-0@lo:101: 00010000:00010000:0.0:1789130801.748492:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130801.748503:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006c33715f/0xf3fe2838e1fc1e6f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3fe2838e1fc1e68 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130801.748523:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006c33715f/0xf3fe2838e1fc1e6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3fe2838e1fc1e68 expref: 14 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130801.748540:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006c33715f/0xf3fe2838e1fc1e6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc1e68 expref: 14 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130801.748549:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006c33715f, rc 0) 00000100:00100000:0.0:1789130801.749129:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000122b74fc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+14:6497:x1876039508699008:12345-0@lo:101: Request processed in 651us (817us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130801.749136:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789130801.749191:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c549eb71 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508699008:0@lo:101: 00010000:00010000:0.0:1789130801.749208:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: 00000000497375fc/0xf3fe2838e1fc1e68 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc1e6f expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130801.749217:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: 00000000497375fc/0xf3fe2838e1fc1e68 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3fe2838e1fc1e6f expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130801.749268:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c549eb71 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508699136:0@lo:256: 00000100:00100000:0.0:1789130801.749299:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130801.749323:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set 00000000cde5be48 going to sleep for 11 seconds 00000100:00100000:0.0:1789130801.749400:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508699136 00000100:00100000:0.0:1789130801.749405:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508699136 00000100:00100000:0.0:1789130801.749432:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789130801.749438:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004c9b840a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+14:6497:x1876039508699136:12345-0@lo:256: 20000000:01000000:0.0:1789130801.749454:0:6493:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789130801.749492:0:6493:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789130801.749496:0:6493:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:0.0:1789130801.749653:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004c9b840a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+14:6497:x1876039508699136:12345-0@lo:256: Request processed in 215us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130801.749661:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789130801.749699:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c549eb71 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508699136:0@lo:256: 10000000:01000000:0.0:1789130801.749738:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789130801.749744:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: 00000000497375fc/0xf3fe2838e1fc1e68 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc1e6f expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130801.749752:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: 00000000497375fc/0xf3fe2838e1fc1e68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc1e6f expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789130801.749761:0:6497:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789130801.749762:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff91dded7b6800 from 21 10000000:01000000:0.0:1789130801.749765:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789130801.749785:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: 00000000754fac63/0xf3fe2838e1fc1e76 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130801.749791:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: 00000000754fac63/0xf3fe2838e1fc1e76 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130801.749798:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: 00000000754fac63/0xf3fe2838e1fc1e76 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130801.749809:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c549eb71 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508699264:0@lo:101: 00000100:00100000:0.0:1789130801.749832:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130801.749851:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f2dc9eb3 going to sleep for 11 seconds 00000100:00100000:0.0:1789130801.749862:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508699264 00000100:00100000:0.0:1789130801.749866:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508699264 00000100:00100000:0.0:1789130801.749886:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789130801.749890:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000be59ce11 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+14:6497:x1876039508699264:12345-0@lo:101: 00010000:00010000:0.0:1789130801.749898:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130801.749908:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002b018ab6/0xf3fe2838e1fc1e7d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3fe2838e1fc1e76 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130801.749929:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002b018ab6/0xf3fe2838e1fc1e7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3fe2838e1fc1e76 expref: 15 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130801.749936:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002b018ab6/0xf3fe2838e1fc1e7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc1e76 expref: 15 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130801.749943:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002b018ab6, rc 0) 00000100:00100000:0.0:1789130801.749971:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000be59ce11 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+15:6497:x1876039508699264:12345-0@lo:101: Request processed in 80us (139us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130801.749978:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789130801.750007:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c549eb71 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508699264:0@lo:101: 00010000:00010000:0.0:1789130801.750015:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: 00000000754fac63/0xf3fe2838e1fc1e76 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc1e7d expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130801.756415:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: 00000000754fac63/0xf3fe2838e1fc1e76 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3fe2838e1fc1e7d expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130801.756544:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c549eb71 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508699392:0@lo:501: 00000100:00100000:0.0:1789130801.756607:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130801.756648:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f2dc9eb3 going to sleep for 11 seconds 00000100:00100000:0.0:1789130801.756700:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000346d7dc5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1876039508699520:0@lo:41: 00000100:00100000:0.0:1789130801.756730:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130801.756768:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508699520 00000100:00100000:0.0:1789130801.756774:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508699520 00000100:00100000:0.0:1789130801.756812:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789130801.756819:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ba4cb56b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3628:x1876039508699520:12345-0@lo:41: 00000004:00000024:0.0:1789130801.756860:0:6505:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:0.0:1789130801.756905:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ba4cb56b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3628:x1876039508699520:12345-0@lo:41: Request processed in 86us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130801.756912:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789130801.756954:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000346d7dc5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1876039508699520:0@lo:41: 00000100:00100000:0.0:1789130801.756976:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508699392 00000100:00100000:0.0:1789130801.756979:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508699392 00000100:00100000:0.0:1789130801.757000:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789130801.757005:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000811a7e46 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+15:6497:x1876039508699392:12345-0@lo:501: 00000100:00100000:0.0:1789130801.757114:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000811a7e46 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+15:6497:x1876039508699392:12345-0@lo:501: Request processed in 109us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130801.757121:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789130801.757153:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c549eb71 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508699392:0@lo:501: 00000100:00100000:0.0:1789130801.757182:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c549eb71 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508699648:0@lo:503: 00000100:00100000:0.0:1789130801.757217:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130801.757230:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f2dc9eb3 going to sleep for 11 seconds 00000100:00100000:0.0:1789130801.757241:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508699648 00000100:00100000:0.0:1789130801.757244:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508699648 00000100:00100000:0.0:1789130801.757264:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789130801.757269:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000727cff01 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+15:6497:x1876039508699648:12345-0@lo:503: 00000100:00100000:0.0:1789130801.757346:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000727cff01 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+15:6497:x1876039508699648:12345-0@lo:503: Request processed in 76us (128us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130801.757352:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789130801.757406:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c549eb71 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508699648:0@lo:503: 00000100:00100000:0.0:1789130801.757632:0:7717:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c549eb71 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:7717:1876039508699776:0@lo:502: 00000100:00100000:0.0:1789130801.757668:0:7717:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130801.757687:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508699776 00000100:00100000:0.0:1789130801.757691:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508699776 00000100:00100000:0.0:1789130801.757711:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789130801.757716:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000926b426d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+15:7717:x1876039508699776:12345-0@lo:502: 00000100:00100000:0.0:1789130801.757794:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000926b426d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+15:7717:x1876039508699776:12345-0@lo:502: Request processed in 77us (126us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130801.757800:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789130801.757835:0:7717:0:(client.c:2715:ptlrpc_set_wait()) set 00000000713c5731 going to sleep for 11 seconds 00000100:00100000:0.0:1789130801.757849:0:7717:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c549eb71 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:7717:1876039508699776:0@lo:502: 00000100:00100000:0.0:1789130801.757884:0:7717:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c549eb71 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:7717:1876039508699904:0@lo:502: 00000100:00100000:0.0:1789130801.757913:0:7717:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130801.757931:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508699904 00000100:00100000:0.0:1789130801.757934:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508699904 00000100:00100000:0.0:1789130801.757952:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789130801.757957:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005197647b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+15:7717:x1876039508699904:12345-0@lo:502: 00000100:00100000:0.0:1789130801.758013:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005197647b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+15:7717:x1876039508699904:12345-0@lo:502: Request processed in 56us (99us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130801.758019:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789130801.758045:0:7717:0:(client.c:2715:ptlrpc_set_wait()) set 000000008131a2e4 going to sleep for 11 seconds 00000100:00100000:0.0:1789130801.758057:0:7717:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c549eb71 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:7717:1876039508699904:0@lo:502: 00000040:00080000:0.0:1789130801.758074:0:7717:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:0.0:1789130801.758125:0:6497:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:0.0:1789130801.758143:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789130801.758151:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: 00000000754fac63/0xf3fe2838e1fc1e76 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc1e7d expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130801.758174:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: 00000000754fac63/0xf3fe2838e1fc1e76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc1e7d expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789130801.758184:0:6497:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789130801.758186:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff91dded7b6800 from 4 10000000:01000000:0.0:1789130801.758189:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789130801.758212:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: 00000000c22816bb/0xf3fe2838e1fc1e84 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130801.758219:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: 00000000c22816bb/0xf3fe2838e1fc1e84 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130801.758227:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: 00000000c22816bb/0xf3fe2838e1fc1e84 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130801.758238:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c549eb71 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508700032:0@lo:101: 00000100:00100000:0.0:1789130801.758264:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130801.758279:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set 000000008131a2e4 going to sleep for 11 seconds 00000100:00100000:0.0:1789130801.758290:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508700032 00000100:00100000:0.0:1789130801.758293:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508700032 00000100:00100000:0.0:1789130801.758313:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789130801.758319:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000715b45fb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+15:6497:x1876039508700032:12345-0@lo:101: 00010000:00010000:0.0:1789130801.758327:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130801.758339:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000046a5b22a/0xf3fe2838e1fc1e8b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3fe2838e1fc1e84 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130801.758813:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000899eebbc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3625:1876039508700160:0@lo:400: 00000100:00100000:2.0:1789130801.758851:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130801.758875:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789130801.758881:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008e8cb381 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3625:1876039508700288:0@lo:400: 00000100:00100000:2.0:1789130801.758902:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130801.758932:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508700160 00000100:00100000:2.0:1789130801.758936:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508700160 00000100:00100000:2.0:1789130801.758965:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508700288 00000100:00100000:2.0:1789130801.758968:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508700288 00000100:00100000:2.0:1789130801.758984:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789130801.758990:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d21138a8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1876039508700160:12345-0@lo:400: 00000100:00100000:2.0:1789130801.759040:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d21138a8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1876039508700160:12345-0@lo:400: Request processed in 50us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130801.759047:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789130801.759071:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789130801.759077:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001b47e26a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1876039508700288:12345-0@lo:400: 00000100:00100000:2.0:1789130801.759106:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001b47e26a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1876039508700288:12345-0@lo:400: Request processed in 30us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130801.759112:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1789130801.759147:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000008e8cb381 x1876039508700288/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130817 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789130801.759159:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008e8cb381 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3625:1876039508700288:0@lo:400: 00010000:00080000:2.0:1789130801.759168:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000899eebbc x1876039508700160/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130817 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789130801.759176:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000899eebbc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3625:1876039508700160:0@lo:400: 00010000:00010000:0.0:1789130801.762759:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000046a5b22a/0xf3fe2838e1fc1e8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3fe2838e1fc1e84 expref: 16 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130801.762794:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000046a5b22a/0xf3fe2838e1fc1e8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc1e84 expref: 16 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130801.762803:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000046a5b22a, rc 0) 00000100:00100000:0.0:1789130801.763016:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000715b45fb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+16:6497:x1876039508700032:12345-0@lo:101: Request processed in 4695us (4750us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130801.763096:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789130801.763179:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c549eb71 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508700032:0@lo:101: 00010000:00010000:0.0:1789130801.763199:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: 00000000c22816bb/0xf3fe2838e1fc1e84 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc1e8b expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130801.763207:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: 00000000c22816bb/0xf3fe2838e1fc1e84 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3fe2838e1fc1e8b expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130801.763269:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c549eb71 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508700416:0@lo:256: 00000100:00100000:0.0:1789130801.763307:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130801.763335:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set 000000008131a2e4 going to sleep for 11 seconds 00000100:00100000:0.0:1789130801.763351:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508700416 00000100:00100000:0.0:1789130801.763366:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508700416 00000100:00100000:0.0:1789130801.763401:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789130801.763409:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000032b7f05 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+16:6497:x1876039508700416:12345-0@lo:256: 20000000:01000000:0.0:1789130801.763426:0:6492:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789130801.763442:0:6492:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789130801.763445:0:6492:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:0.0:1789130801.763544:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000032b7f05 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+16:6497:x1876039508700416:12345-0@lo:256: Request processed in 136us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130801.763552:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789130801.764563:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c549eb71 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508700416:0@lo:256: 10000000:01000000:0.0:1789130801.764696:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789130801.764704:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: 00000000c22816bb/0xf3fe2838e1fc1e84 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc1e8b expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130801.764713:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: 00000000c22816bb/0xf3fe2838e1fc1e84 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc1e8b expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789130801.764721:0:6497:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1789130801.764723:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:0.0:1789130801.764726:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1789130801.764750:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: 00000000fe8ca449/0xf3fe2838e1fc1e92 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130801.764757:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: 00000000fe8ca449/0xf3fe2838e1fc1e92 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130801.764764:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: 00000000fe8ca449/0xf3fe2838e1fc1e92 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130801.764777:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c549eb71 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508700544:0@lo:101: 00000100:00100000:0.0:1789130801.764814:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130801.764843:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e431b28f going to sleep for 11 seconds 00000100:00100000:0.0:1789130801.764859:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508700544 00000100:00100000:0.0:1789130801.764863:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508700544 00000100:00100000:0.0:1789130801.764895:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789130801.764901:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000216a558 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+16:6497:x1876039508700544:12345-0@lo:101: 00010000:00010000:0.0:1789130801.764912:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130801.764923:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000009ce736ce/0xf3fe2838e1fc1e99 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3fe2838e1fc1e92 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130801.764950:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009ce736ce/0xf3fe2838e1fc1e99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3fe2838e1fc1e92 expref: 17 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130801.764959:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000009ce736ce/0xf3fe2838e1fc1e99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc1e92 expref: 17 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130801.764967:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000009ce736ce, rc 0) 00000100:00100000:0.0:1789130801.765001:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000216a558 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+17:6497:x1876039508700544:12345-0@lo:101: Request processed in 100us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130801.765008:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789130801.766172:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c549eb71 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508700544:0@lo:101: 00010000:00010000:0.0:1789130801.766192:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: 00000000fe8ca449/0xf3fe2838e1fc1e92 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc1e99 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130801.766202:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: 00000000fe8ca449/0xf3fe2838e1fc1e92 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3fe2838e1fc1e99 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130801.766272:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c549eb71 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508700672:0@lo:501: 00000100:00100000:0.0:1789130801.766312:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130801.767147:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e431b28f going to sleep for 11 seconds 00000100:00100000:0.0:1789130801.767171:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508700672 00000100:00100000:0.0:1789130801.767177:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508700672 00000100:00100000:0.0:1789130801.767219:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789130801.767226:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005b4dfb4e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+17:6497:x1876039508700672:12345-0@lo:501: 00000100:00100000:0.0:1789130801.768725:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005b4dfb4e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+17:6497:x1876039508700672:12345-0@lo:501: Request processed in 1494us (2407us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130801.768738:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789130801.768818:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c549eb71 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508700672:0@lo:501: 00000100:00100000:0.0:1789130801.768869:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c549eb71 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508700800:0@lo:503: 00000100:00100000:0.0:1789130801.768914:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130801.768941:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e431b28f going to sleep for 11 seconds 00000100:00100000:0.0:1789130801.768955:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508700800 00000100:00100000:0.0:1789130801.768960:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508700800 00000100:00100000:0.0:1789130801.768992:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789130801.768999:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ebec0705 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+17:6497:x1876039508700800:12345-0@lo:503: 00000100:00100000:0.0:1789130801.771108:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ebec0705 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+17:6497:x1876039508700800:12345-0@lo:503: Request processed in 1564us (1647us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130801.771121:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789130801.771203:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c549eb71 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508700800:0@lo:503: 00000100:00100000:3.0:1789130801.783421:0:7718:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c79e5a10 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:7718:1876039508700928:0@lo:502: 00000100:00100000:3.0:1789130801.783537:0:7718:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130801.783580:0:7718:0:(client.c:2715:ptlrpc_set_wait()) set 00000000251e6f1c going to sleep for 11 seconds 00000100:00100000:1.0:1789130801.783851:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508700928 00000100:00100000:1.0:1789130801.783859:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508700928 00000100:00100000:1.0:1789130801.783906:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789130801.783914:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000092fc4c57 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+17:7718:x1876039508700928:12345-0@lo:502: 00000100:00100000:1.0:1789130801.784053:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000092fc4c57 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+17:7718:x1876039508700928:12345-0@lo:502: Request processed in 140us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130801.784067:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789130801.784877:0:7718:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c79e5a10 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:7718:1876039508700928:0@lo:502: 00000020:01000000:3.0:1789130801.784956:0:7718:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789130801.784970:0:7718:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789130801.784972:0:7718:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:3.0:1789130801.784977:0:7718:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789130801.784988:0:7718:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.111@tcp to nid 0x20000c0a8cb6f (192.168.203.111@tcp) 00000020:00000080:3.0:1789130801.785011:0:7718:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789130801.785037:0:7718:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (000000005ca62878) 00000020:00000080:3.0:1789130801.785059:0:7718:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osp with refcount 2 00000020:00000080:3.0:1789130801.785066:0:7718:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789130801.785158:0:7718:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:3.0:1789130801.785164:0:7718:0:(osd_handler.c:8895:osd_obd_connect()) connect #5 00000020:00000080:3.0:1789130801.785172:0:7718:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf3fe2838e1fc1ea7 00010000:00080000:3.0:1789130801.785204:0:7718:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000c14ae1e5@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.111@tcp at head 00010000:00010000:3.0:1789130801.786916:0:7718:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-4 is initialized 00000020:00000080:2.0:1789130801.798549:0:7718:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789130801.798566:0:7718:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1789130801.798612:0:7718:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:2.0:1789130801.798634:0:7718:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf3fe2838e1fc1eae 00000100:00080000:2.0:1789130801.798645:0:7718:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789130801.798651:0:7718:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import 00000000c14ae1e5 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:2.0:1789130801.798698:0:7718:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000fb3105fa x1876039508701056/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789130801.798722:0:7718:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000040:01000000:2.0:1789130801.798757:0:7718:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:0.0:1789130801.798855:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fb3105fa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3624:1876039508701056:0@lo:38: 00000100:00100000:0.0:1789130801.798931:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130801.798989:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508701056 00000100:00100000:0.0:1789130801.798995:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508701056 00000100:00100000:0.0:1789130801.799024:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789130801.799030:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c549eb71 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3624:x1876039508701056:12345-0@lo:38: 00010000:00080000:0.0:1789130801.799056:0:6505:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 157 last 0 00000020:00000080:0.0:1789130801.799087:0:6505:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf3fe2838e1fc1eb5 00000004:00100000:0.0:1789130801.799102:0:6505:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1789130801.799108:0:6505:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:1.0:1789130801.803822:0:7723:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@000000008dba7366 x1876039508701184/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789130801.803838:0:7723:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a992ed2a going to sleep for 0 seconds 00000020:01000000:2.0:1789130801.803942:0:7718:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789130801.803948:0:7718:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789130801.803950:0:7718:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:2.0:1789130801.803953:0:7718:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789130801.803956:0:7718:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789130801.803958:0:7718:0:(obd_config.c:1563:class_process_config()) marker 19 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789130801.803966:0:7718:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789130801.803968:0:7718:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1789130801.803990:0:7718:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000feb9ada pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:7718:1876039508701312:0@lo:502: 00000100:00100000:2.0:1789130801.804061:0:7718:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130801.804140:0:7718:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a0e4a074 going to sleep for 11 seconds 00000100:00100000:0.0:1789130801.804181:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508701312 00000100:00100000:0.0:1789130801.804189:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508701312 00000100:00100000:0.0:1789130801.804756:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789130801.804767:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000820ca03f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+17:7718:x1876039508701312:12345-0@lo:502: 00000100:00100000:0.0:1789130801.804890:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000820ca03f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+17:7718:x1876039508701312:12345-0@lo:502: Request processed in 126us (828us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130801.804898:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789130801.805079:0:7718:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000feb9ada pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:7718:1876039508701312:0@lo:502: 00000020:01000000:2.0:1789130801.805107:0:7718:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789130801.805112:0:7718:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789130801.805114:0:7718:0:(obd_config.c:1563:class_process_config()) marker 19 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789130801.805117:0:7718:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:2.0:1789130801.805169:0:6497:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:2.0:1789130801.805186:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1789130801.805194:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: 00000000fe8ca449/0xf3fe2838e1fc1e92 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc1e99 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130801.805204:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: 00000000fe8ca449/0xf3fe2838e1fc1e92 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc1e99 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789130801.805212:0:6497:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1789130801.805214:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff91ddd10e8000 from 1 10000000:01000000:2.0:1789130801.805217:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789130801.805238:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: 00000000cdc4f461/0xf3fe2838e1fc1ebc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130801.805244:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: 00000000cdc4f461/0xf3fe2838e1fc1ebc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130801.805252:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: 00000000cdc4f461/0xf3fe2838e1fc1ebc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130801.805263:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000feb9ada pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508701440:0@lo:101: 00000100:00100000:2.0:1789130801.805296:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130801.805406:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a0e4a074 going to sleep for 11 seconds 00000100:00100000:1.0:1789130801.805519:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508701440 00000100:00100000:1.0:1789130801.805524:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508701440 00000100:00100000:1.0:1789130801.805549:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789130801.805554:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005951eb4f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+17:6497:x1876039508701440:12345-0@lo:101: 00010000:00010000:1.0:1789130801.805562:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130801.805572:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d55bbd55/0xf3fe2838e1fc1ec3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3fe2838e1fc1ebc expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130801.805592:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d55bbd55/0xf3fe2838e1fc1ec3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3fe2838e1fc1ebc expref: 18 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130801.805601:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d55bbd55/0xf3fe2838e1fc1ec3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc1ebc expref: 18 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130801.805608:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d55bbd55, rc 0) 00000100:00100000:1.0:1789130801.805643:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005951eb4f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+18:6497:x1876039508701440:12345-0@lo:101: Request processed in 88us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130801.805648:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789130801.805765:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000feb9ada pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508701440:0@lo:101: 00010000:00010000:3.0:1789130801.805777:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: 00000000cdc4f461/0xf3fe2838e1fc1ebc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc1ec3 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130801.805785:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: 00000000cdc4f461/0xf3fe2838e1fc1ebc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3fe2838e1fc1ec3 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130801.805839:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c79e5a10 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508701568:0@lo:501: 00000100:00100000:3.0:1789130801.805863:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130801.805872:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set 0000000009ce00ff going to sleep for 11 seconds 00000100:00100000:1.0:1789130801.805911:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508701568 00000100:00100000:1.0:1789130801.805914:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508701568 00000100:00100000:1.0:1789130801.805927:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789130801.805931:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000624fef9f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+18:6497:x1876039508701568:12345-0@lo:501: 00000100:00100000:1.0:1789130801.805996:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000624fef9f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+18:6497:x1876039508701568:12345-0@lo:501: Request processed in 64us (132us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789130801.806012:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789130801.806313:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c79e5a10 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508701568:0@lo:501: 10000000:01000000:3.0:1789130801.806339:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1789130801.806344:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: 00000000cdc4f461/0xf3fe2838e1fc1ebc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc1ec3 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130801.806351:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: 00000000cdc4f461/0xf3fe2838e1fc1ebc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc1ec3 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789130801.815167:0:6505:0:(import.c:65:import_set_state_nolock()) 000000000e7cc57b : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789130801.815267:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c549eb71 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3624:x1876039508701056:12345-0@lo:38: Request processed in 16234us (16334us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130801.815278:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789130801.815327:0:3624:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789130801.815338:0:3624:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1789130801.815347:0:3624:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1789130801.815363:0:3624:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1789130801.815365:0:3624:0:(import.c:65:import_set_state_nolock()) 00000000c14ae1e5 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:0.0:1789130801.815381:0:3624:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000a992ed2a): req@000000008dba7366 x1876039508701184/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789130801.815396:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fb3105fa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3624:1876039508701056:0@lo:38: 00000100:00100000:0.0:1789130801.815485:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000346d7dc5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1876039508701696:0@lo:41: 00000100:00100000:0.0:1789130801.815522:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130801.815559:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508701696 00000100:00100000:0.0:1789130801.815635:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508701696 00000100:00100000:0.0:1789130801.815913:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789130801.815922:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000096e81031 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3627:x1876039508701696:12345-0@lo:41: 00000004:00000024:0.0:1789130801.815948:0:6506:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:0.0:1789130801.815986:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000096e81031 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3627:x1876039508701696:12345-0@lo:41: Request processed in 67us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130801.815993:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789130801.816024:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000346d7dc5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1876039508701696:0@lo:41: 00000100:00100000:0.0:1789130801.816084:0:7723:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130801.816103:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508701184 00000100:00100000:0.0:1789130801.816107:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508701184 00000100:00100000:0.0:1789130801.816128:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789130801.816133:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000346d7dc5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7723:x1876039508701184:12345-0@lo:1000: 00000100:00100000:0.0:1789130801.816186:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000346d7dc5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7723:x1876039508701184:12345-0@lo:1000: Request processed in 53us (102us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130801.816193:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789130801.816217:0:7723:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008dba7366 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7723:1876039508701184:0@lo:1000: 00000040:01000000:0.0:1789130801.816248:0:7723:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1789130801.816278:0:7723:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e8bae9d3 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7723:1876039508701824:0@lo:1000: 00000100:00100000:0.0:1789130801.816305:0:7723:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130801.816323:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508701824 00000100:00100000:0.0:1789130801.816326:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508701824 00000100:00100000:0.0:1789130801.816345:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789130801.816349:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d21850a2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7723:x1876039508701824:12345-0@lo:1000: 00000100:00100000:0.0:1789130801.816447:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d21850a2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7723:x1876039508701824:12345-0@lo:1000: Request processed in 98us (141us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130801.816454:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789130801.816490:0:7723:0:(client.c:2715:ptlrpc_set_wait()) set 000000003acd24c6 going to sleep for 11 seconds 00000100:00100000:0.0:1789130801.816502:0:7723:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e8bae9d3 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7723:1876039508701824:0@lo:1000: 00000100:00100000:0.0:1789130801.816536:0:7723:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e8bae9d3 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7723:1876039508701952:0@lo:700: 00000100:00100000:0.0:1789130801.816560:0:7723:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130801.817894:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508701952 00000100:00100000:0.0:1789130801.817903:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508701952 00000100:00100000:0.0:1789130801.817954:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789130801.817961:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ca107e3e pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0000-mdtlov_UUID+6:7723:x1876039508701952:12345-0@lo:700: 00000100:00100000:0.0:1789130801.818021:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ca107e3e pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0000-mdtlov_UUID+6:7723:x1876039508701952:12345-0@lo:700: Request processed in 62us (1461us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130801.818029:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789130801.818049:0:7723:0:(client.c:2715:ptlrpc_set_wait()) set 00000000dac5b68a going to sleep for 11 seconds 00000100:00100000:0.0:1789130801.818068:0:7723:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e8bae9d3 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7723:1876039508701952:0@lo:700: 00000100:00100000:0.0:1789130801.818220:0:7723:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e8bae9d3 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7723:1876039508702080:0@lo:1000: 00000100:00100000:0.0:1789130801.818252:0:7723:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130801.818275:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508702080 00000100:00100000:0.0:1789130801.818278:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508702080 00000100:00100000:0.0:1789130801.818300:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789130801.818307:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003929a872 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7723:x1876039508702080:12345-0@lo:1000: 00000100:00100000:0.0:1789130801.818362:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003929a872 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7723:x1876039508702080:12345-0@lo:1000: Request processed in 47us (100us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130801.818369:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789130801.818387:0:7723:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f6953e66 going to sleep for 11 seconds 00000100:00100000:0.0:1789130801.818398:0:7723:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e8bae9d3 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7723:1876039508702080:0@lo:1000: 00000004:00080000:0.0:1789130801.818434:0:7723:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 00000000dac5b68a with version 0 00000020:00100000:0.0:1789130801.818447:0:7723:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1789130801.818452:0:7723:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000e8bae9d3 x1876039508702336/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789130801.818487:0:7723:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e8bae9d3 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7723:1876039508702336:0@lo:1000: 00000100:00100000:0.0:1789130801.818526:0:7723:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130801.818547:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508702336 00000100:00100000:0.0:1789130801.818550:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508702336 00000100:00100000:0.0:1789130801.818646:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789130801.818653:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fdece23e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7723:x1876039508702336:12345-0@lo:1000: 00000100:00100000:0.0:1789130801.819050:0:7723:0:(client.c:2715:ptlrpc_set_wait()) set 00000000efe262dd going to sleep for 11 seconds 00000001:00080000:3.0:1789130801.832330:0:7432:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967297 is committed 00000001:00100000:3.0:1789130801.832351:0:7432:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1789130801.832542:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fdece23e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7723:x1876039508702336:12345-0@lo:1000: Request processed in 13886us (14011us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1789130801.832557:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000004:00080000:1.0:1789130801.832723:0:7723:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:1.0:1789130801.832729:0:7723:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1789130801.832744:0:7723:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e8bae9d3 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7723:1876039508702336:0@lo:1000: 00000100:00100000:1.0:1789130801.832838:0:7723:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008dba7366 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7723:1876039508702464:0@lo:1000: 00000100:00100000:1.0:1789130801.832878:0:7723:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130801.832920:0:7723:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a992ed2a going to sleep for 11 seconds 00000100:00100000:0.0:1789130801.833025:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508702464 00000100:00100000:0.0:1789130801.833034:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508702464 00000100:00100000:0.0:1789130801.833080:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789130801.833089:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009131adf3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7723:x1876039508702464:12345-0@lo:1000: 00000100:00100000:0.0:1789130801.833157:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009131adf3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7723:x1876039508702464:12345-0@lo:1000: Request processed in 70us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130801.833164:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789130801.833237:0:7723:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008dba7366 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7723:1876039508702464:0@lo:1000: 00000040:00080000:3.0:1789130801.833255:0:7723:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:3.0:1789130801.833287:0:7723:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 0000000009ce00ff with version 1 00000004:00080000:0.0:1789130801.834682:0:7719:0:(osp_trans.c:1336:osp_get_next_request()) ou 000000004d57c5e7 version 1 rpc_version 1 00000020:00100000:0.0:1789130801.834718:0:7719:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1789130801.834726:0:7719:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000001bfa61b3 x1876039508702720/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789130801.834743:0:7719:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001bfa61b3 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7719:1876039508702720:0@lo:1000: 00000100:00100000:0.0:1789130801.834791:0:7719:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130801.834821:0:7719:0:(client.c:2715:ptlrpc_set_wait()) set 00000000df948c35 going to sleep for 11 seconds 00000100:00100000:0.0:1789130801.834841:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508702720 00000100:00100000:0.0:1789130801.834847:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508702720 00000100:00100000:0.0:1789130801.834880:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789130801.834886:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a15ee0ed pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7719:x1876039508702720:12345-0@lo:1000: 00000040:00080000:3.0:1789130801.836349:0:7723:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1789130801.836444:0:7723:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1789130801.836450:0:7723:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000001:00080000:3.0:1789130801.843030:0:7432:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967298 is committed 00000100:00100000:0.0:1789130801.843194:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a15ee0ed pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7719:x1876039508702720:12345-0@lo:1000: Request processed in 8304us (8398us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1789130801.843207:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000004:00080000:3.0:1789130801.843292:0:7719:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:3.0:1789130801.843297:0:7719:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1789130801.843312:0:7719:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001bfa61b3 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7719:1876039508702720:0@lo:1000: 00010000:00010000:1.0:1789130802.072170:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789130802.540975:0:7758:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789130802.541202:0:7758:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789130803.092201:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130804.113841:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130805.142418:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789130805.511944:0:7860:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789130805.512180:0:7860:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789130806.166515:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789130806.677937:0:7908:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffe567f600 20000000:00000080:1.0:1789130806.677961:0:7908:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff91ddff472800 uarg=0000000000000000 20000000:01000000:1.0:1789130806.678025:0:7908:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1789130806.678036:0:7908:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1789130806.678041:0:7908:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1789130806.678203:0:7908:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:1.0:1789130806.678217:0:7908:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:1.0:1789130806.681973:0:7908:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789130806.682444:0:7908:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1789130806.682692:0:7908:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:1.0:1789130806.682709:0:7908:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:1.0:1789130806.682729:0:7908:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1789130806.682753:0:7908:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000ccd508ad/0xf3fe2838e1fc1eca lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130806.682778:0:7908:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000002b555ef7/0xf3fe2838e1fc1d49 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc1d42 expref: 17 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130806.682797:0:7908:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000c127434d/0xf3fe2838e1fc1e37 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc1e30 expref: 17 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130806.682804:0:7908:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000ccd508ad/0xf3fe2838e1fc1eca lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 7908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130806.682854:0:7908:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000c127434d/0xf3fe2838e1fc1e37 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf3fe2838e1fc1e30 expref: 17 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130806.682869:0:7908:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000c127434d/0xf3fe2838e1fc1e37 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf3fe2838e1fc1e30 expref: 17 pid: 6494 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130806.682886:0:7908:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000db196646 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7908:1876039508702848:0@lo:104: 00000100:00100000:1.0:1789130806.682975:0:7908:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789130806.683047:0:7908:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000002b555ef7/0xf3fe2838e1fc1d49 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf3fe2838e1fc1d42 expref: 17 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130806.683055:0:7908:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000002b555ef7/0xf3fe2838e1fc1d49 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf3fe2838e1fc1d42 expref: 17 pid: 6492 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130806.683063:0:7908:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000425ef76b pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7908:1876039508702976:0@lo:104: 00000100:00100000:2.0:1789130806.683083:0:6484:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1789130806.683084:0:7908:0:(client.c:2715:ptlrpc_set_wait()) set 000000001c37d8f3 going to sleep for 11 seconds 00000100:00100000:2.0:1789130806.683103:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130806.683132:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508702848 00000100:00100000:2.0:1789130806.683140:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508702848 00000100:00100000:0.0:1789130806.683151:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508702976 00000100:00100000:0.0:1789130806.683155:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508702976 00000100:00100000:2.0:1789130806.683189:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789130806.683196:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005fe6568d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+4:7908:x1876039508702848:12345-0@lo:104: 00010000:00010000:2.0:1789130806.683276:0:6484:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: 000000003ab82567/0xf3fe2838e1fc1e30 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3fe2838e1fc1e37 expref: -99 pid: 7430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130806.683359:0:6484:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789130806.683364:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005fe6568d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+4:7908:x1876039508702848:12345-0@lo:104: Request processed in 169us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130806.683371:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789130806.683422:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789130806.683428:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a814f9e3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+3:7908:x1876039508702976:12345-0@lo:104: 00010000:00010000:2.0:1789130806.683435:0:6484:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: 0000000008639f49/0xf3fe2838e1fc1d42 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3fe2838e1fc1d49 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130806.683489:0:6484:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:0.0:1789130806.683499:0:6489:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:2.0:1789130806.683503:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a814f9e3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+3:7908:x1876039508702976:12345-0@lo:104: Request processed in 76us (400us total) trans 0 rc 0/0 00010000:00010000:0.0:1789130806.683505:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: 000000003ab82567/0xf3fe2838e1fc1e30 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3fe2838e1fc1e37 expref: -99 pid: 7430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130806.683521:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000003ab82567 already unused, calling callback (00000000af325768) 10000000:00010000:0.0:1789130806.683525:0:6489:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: 000000003ab82567/0xf3fe2838e1fc1e30 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf3fe2838e1fc1e37 expref: -99 pid: 7430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130806.683538:0:6489:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: 000000003ab82567/0xf3fe2838e1fc1e30 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf3fe2838e1fc1e37 expref: -99 pid: 7430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789130806.683545:0:6489:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: 000000003ab82567/0xf3fe2838e1fc1e30 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf3fe2838e1fc1e37 expref: -99 pid: 7430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789130806.683551:0:6489:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789130806.683581:0:6489:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: 000000003ab82567/0xf3fe2838e1fc1e30 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc1e37 expref: -99 pid: 7430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130806.683588:0:6489:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789130806.683606:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: 000000003ab82567/0xf3fe2838e1fc1e30 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc1e37 expref: -99 pid: 7430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130806.683612:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: 000000003ab82567/0xf3fe2838e1fc1e30 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc1e37 expref: -99 pid: 7430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130806.683628:0:6489:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789130806.683630:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: 0000000008639f49/0xf3fe2838e1fc1d42 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3fe2838e1fc1d49 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130806.683636:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000008639f49 already unused, calling callback (00000000af325768) 10000000:00010000:0.0:1789130806.683638:0:6489:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: 0000000008639f49/0xf3fe2838e1fc1d42 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf3fe2838e1fc1d49 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130806.683650:0:6489:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: 0000000008639f49/0xf3fe2838e1fc1d42 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf3fe2838e1fc1d49 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789130806.683656:0:6489:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: 0000000008639f49/0xf3fe2838e1fc1d42 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf3fe2838e1fc1d49 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789130806.683661:0:6489:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789130806.683674:0:6489:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: 0000000008639f49/0xf3fe2838e1fc1d42 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc1d49 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130806.683680:0:6489:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789130806.683695:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: 0000000008639f49/0xf3fe2838e1fc1d42 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc1d49 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130806.683701:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: 0000000008639f49/0xf3fe2838e1fc1d42 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc1d49 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130806.683715:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130806.683716:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130806.683718:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789130806.683732:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000690c29c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3628:1876039508703104:0@lo:103: 00000100:00100000:0.0:1789130806.683770:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130806.683818:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000023863187 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3625:1876039508703232:0@lo:103: 00000100:00100000:0.0:1789130806.683842:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130806.683879:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508703104 00000100:00100000:0.0:1789130806.683884:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508703104 00010000:00010000:0.0:1789130806.683903:0:6485:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000c127434d/0xf3fe2838e1fc1e37 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3fe2838e1fc1e30 expref: 18 pid: 6494 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130806.683937:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508703232 00000100:00100000:0.0:1789130806.683940:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508703232 00010000:00010000:0.0:1789130806.683951:0:6485:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000002b555ef7/0xf3fe2838e1fc1d49 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3fe2838e1fc1d42 expref: 19 pid: 6492 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130806.683963:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789130806.683969:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e67a2f7d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+19:3628:x1876039508703104:12345-0@lo:103: 00010000:00010000:0.0:1789130806.683980:0:6485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789130806.683984:0:6485:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000c127434d/0xf3fe2838e1fc1e37 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3fe2838e1fc1e30 expref: 19 pid: 6494 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130806.683994:0:6485:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000c127434d/0xf3fe2838e1fc1e37 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf3fe2838e1fc1e30 expref: 19 pid: 6494 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130806.684013:0:6485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789130806.684039:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e67a2f7d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+19:3628:x1876039508703104:12345-0@lo:103: Request processed in 71us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130806.684047:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789130806.684062:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789130806.684067:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c7858a5f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+18:3625:x1876039508703232:12345-0@lo:103: 00010000:00010000:0.0:1789130806.684074:0:6485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789130806.684077:0:6485:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000002b555ef7/0xf3fe2838e1fc1d49 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3fe2838e1fc1d42 expref: 18 pid: 6492 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130806.684084:0:6485:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000002b555ef7/0xf3fe2838e1fc1d49 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf3fe2838e1fc1d42 expref: 18 pid: 6492 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130806.684095:0:6485:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000ccd508ad/0xf3fe2838e1fc1eca lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 7908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130806.684108:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ccd508ad/0xf3fe2838e1fc1eca lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 7908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130806.684116:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:0.0:1789130806.684123:0:6485:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000ccd508ad/0xf3fe2838e1fc1eca lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130806.684257:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000ccd508ad/0xf3fe2838e1fc1eca lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130806.684265:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000ccd508ad/0xf3fe2838e1fc1eca lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130806.684272:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000ccd508ad/0xf3fe2838e1fc1eca lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130806.684276:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ccd508ad already unused, calling callback (00000000eb258dfd) 00010000:00010000:0.0:1789130806.684280:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000ccd508ad/0xf3fe2838e1fc1eca lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130806.684364:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000ccd508ad/0xf3fe2838e1fc1eca lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 7908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130806.684374:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000ccd508ad/0xf3fe2838e1fc1eca lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130806.684385:0:6485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789130806.684422:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c7858a5f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+18:3625:x1876039508703232:12345-0@lo:103: Request processed in 355us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130806.684430:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789130806.684503:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000690c29c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3628:1876039508703104:0@lo:103: 00000100:00100000:2.0:1789130806.684654:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000023863187 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3625:1876039508703232:0@lo:103: 00010000:00010000:3.0:1789130806.685114:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130806.685378:0:7908:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000c127434d/0xf3fe2838e1fc1e37 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf3fe2838e1fc1e30 expref: 17 pid: 6494 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130806.685394:0:7908:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000db196646 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7908:1876039508702848:0@lo:104: 00010000:00010000:1.0:1789130806.685406:0:7908:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000002b555ef7/0xf3fe2838e1fc1d49 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf3fe2838e1fc1d42 expref: 16 pid: 6492 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130806.685429:0:7908:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000425ef76b pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7908:1876039508702976:0@lo:104: 00010000:00010000:1.0:1789130806.685451:0:7908:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000ccd508ad/0xf3fe2838e1fc1eca lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130806.685740:0:7908:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000ccd508ad/0xf3fe2838e1fc1eca lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130806.685748:0:7908:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000ccd508ad/0xf3fe2838e1fc1eca lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130806.685754:0:7908:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ccd508ad/0xf3fe2838e1fc1eca lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7908 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130806.865884:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000690c29c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3626:1876039508703360:0@lo:400: 00000100:00100000:0.0:1789130806.865987:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130806.866067:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789130806.866073:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009e8aefab pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508703744:0@lo:400: 00000100:00100000:0.0:1789130806.866102:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130806.866143:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002553a606 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508703488:0@lo:400: 00000100:00100000:0.0:1789130806.866167:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130806.866186:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789130806.866190:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e1ae4f09 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3627:1876039508703616:0@lo:400: 00000100:00100000:0.0:1789130806.866211:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130806.866284:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508703360 00000100:00100000:0.0:1789130806.866293:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508703360 00000100:00100000:0.0:1789130806.866360:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508703616 00000100:00100000:0.0:1789130806.866363:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508703616 00000100:00100000:0.0:1789130806.866384:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789130806.866392:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000554d81c2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1876039508703360:12345-0@lo:400: 00000100:00100000:0.0:1789130806.866456:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000554d81c2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1876039508703360:12345-0@lo:400: Request processed in 65us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130806.866495:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789130806.866516:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789130806.866522:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000045672a86 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1876039508703616:12345-0@lo:400: 00000100:00100000:0.0:1789130806.866554:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000045672a86 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1876039508703616:12345-0@lo:400: Request processed in 32us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130806.866559:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789130806.866577:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508703744 00000100:00100000:0.0:1789130806.866580:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508703744 00000100:00100000:0.0:1789130806.866598:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508703488 00000100:00100000:0.0:1789130806.866608:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508703488 00000100:00100000:0.0:1789130806.866623:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789130806.866628:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008c0e65ec pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508703744:12345-0@lo:400: 00000100:00100000:0.0:1789130806.866666:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008c0e65ec pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508703744:12345-0@lo:400: Request processed in 38us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130806.866673:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789130806.866684:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789130806.866689:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005d193241 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508703488:12345-0@lo:400: 00000100:00100000:0.0:1789130806.866715:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005d193241 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508703488:12345-0@lo:400: Request processed in 27us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130806.866721:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:0.0:1789130806.866764:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000e1ae4f09 x1876039508703616/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130822 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789130806.866781:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e1ae4f09 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3627:1876039508703616:0@lo:400: 00000100:00100000:0.0:1789130806.866793:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002553a606 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508703488:0@lo:400: 00000100:00100000:0.0:1789130806.866824:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009e8aefab pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508703744:0@lo:400: 00010000:00080000:0.0:1789130806.866835:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000000690c29c x1876039508703360/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130822 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789130806.866844:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000690c29c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3626:1876039508703360:0@lo:400: 00000100:00100000:3.0:1789130806.866989:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789130806.867000:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002749aba0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508703872:0@lo:41: 00000100:00100000:3.0:1789130806.867036:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130806.867064:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508703872 00000100:00100000:3.0:1789130806.867068:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508703872 00000100:00100000:3.0:1789130806.867089:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789130806.867094:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000053e430ce pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508703872:12345-0@lo:41: 00000004:00000024:3.0:1789130806.867125:0:6505:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:3.0:1789130806.867160:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000053e430ce pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508703872:12345-0@lo:41: Request processed in 66us (124us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130806.867166:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789130806.867195:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002749aba0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508703872:0@lo:41: 00000100:00100000:1.0:1789130806.870512:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789130806.870549:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000425ef76b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1876039508704000:0@lo:41: 00000100:00100000:1.0:1789130806.870638:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130806.870702:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508704000 00000100:00100000:1.0:1789130806.870711:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508704000 00000100:00100000:1.0:1789130806.870769:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789130806.870778:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000db196646 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3628:x1876039508704000:12345-0@lo:41: 00000004:00000024:1.0:1789130806.870820:0:6505:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:1.0:1789130806.870871:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000db196646 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3628:x1876039508704000:12345-0@lo:41: Request processed in 93us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130806.870878:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789130806.870930:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000425ef76b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1876039508704000:0@lo:41: 00010000:00010000:2.0:1789130807.191352:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130808.210665:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789130808.401823:0:6497:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789130808.401835:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91ddfce33000 from 1 10000000:01000000:3.0:1789130808.401849:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789130808.401905:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: 00000000de523a7d/0xf3fe2838e1fc1ed1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130808.401920:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: 00000000de523a7d/0xf3fe2838e1fc1ed1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130808.401932:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: 00000000de523a7d/0xf3fe2838e1fc1ed1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130808.401961:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002749aba0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508704128:0@lo:101: 00000100:00100000:3.0:1789130808.403264:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130808.406427:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set 000000004383c880 going to sleep for 11 seconds 00000100:00100000:1.0:1789130808.407370:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508704128 00000100:00100000:1.0:1789130808.407384:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508704128 00000100:00100000:2.0:1789130808.407698:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789130808.407713:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e9953736 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+16:6497:x1876039508704128:12345-0@lo:101: 00010000:00010000:2.0:1789130808.407736:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130808.407761:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000531938a7/0xf3fe2838e1fc1ed8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3fe2838e1fc1ed1 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130808.407794:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000531938a7/0xf3fe2838e1fc1ed8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3fe2838e1fc1ed1 expref: 17 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130808.407806:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000531938a7/0xf3fe2838e1fc1ed8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc1ed1 expref: 17 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130808.407817:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000531938a7, rc 0) 00000100:00100000:2.0:1789130808.407916:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e9953736 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+17:6497:x1876039508704128:12345-0@lo:101: Request processed in 207us (4658us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130808.407923:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789130808.408029:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002749aba0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508704128:0@lo:101: 00010000:00010000:3.0:1789130808.408049:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: 00000000de523a7d/0xf3fe2838e1fc1ed1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc1ed8 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130808.408058:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: 00000000de523a7d/0xf3fe2838e1fc1ed1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3fe2838e1fc1ed8 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130808.408149:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002749aba0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508704256:0@lo:501: 00000100:00100000:3.0:1789130808.408187:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130808.408228:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set 000000004383c880 going to sleep for 11 seconds 00000100:00100000:1.0:1789130808.408276:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508704256 00000100:00100000:1.0:1789130808.408281:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508704256 00000100:00100000:1.0:1789130808.408321:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789130808.408327:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000237cdacb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+17:6497:x1876039508704256:12345-0@lo:501: 00000100:00100000:1.0:1789130808.408481:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000237cdacb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+17:6497:x1876039508704256:12345-0@lo:501: Request processed in 154us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130808.408488:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789130808.408570:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002749aba0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508704256:0@lo:501: 00000100:00100000:3.0:1789130808.408600:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002749aba0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508704384:0@lo:503: 00000100:00100000:3.0:1789130808.408651:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130808.408675:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set 000000004383c880 going to sleep for 11 seconds 00000100:00100000:3.0:1789130808.408688:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508704384 00000100:00100000:3.0:1789130808.408697:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508704384 00000100:00100000:3.0:1789130808.408717:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789130808.408723:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cc4e6516 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+17:6497:x1876039508704384:12345-0@lo:503: 00000100:00100000:3.0:1789130808.408809:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cc4e6516 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+17:6497:x1876039508704384:12345-0@lo:503: Request processed in 86us (158us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130808.408816:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789130808.408857:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002749aba0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508704384:0@lo:503: 00000100:00100000:3.0:1789130808.410532:0:7974:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002749aba0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:7974:1876039508704512:0@lo:502: 00000100:00100000:3.0:1789130808.410635:0:7974:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130808.410676:0:7974:0:(client.c:2715:ptlrpc_set_wait()) set 000000004ccd15b1 going to sleep for 11 seconds 00000100:00100000:2.0:1789130808.413280:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508704512 00000100:00100000:2.0:1789130808.413300:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508704512 00000100:00100000:2.0:1789130808.413392:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789130808.413403:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000046a0de52 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+17:7974:x1876039508704512:12345-0@lo:502: 00000100:00100000:2.0:1789130808.413684:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000046a0de52 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+17:7974:x1876039508704512:12345-0@lo:502: Request processed in 283us (3050us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130808.413693:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789130808.417863:0:7974:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002749aba0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:7974:1876039508704512:0@lo:502: 00000020:01000000:0.0:1789130808.417926:0:7974:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789130808.417940:0:7974:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789130808.417943:0:7974:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789130808.417952:0:7974:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff91ddfce33000 00000020:00000080:0.0:1789130808.417964:0:7974:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789130808.418040:0:7974:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff751a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:7974:1876039508704640:0@lo:502: 00000100:00100000:0.0:1789130808.418132:0:7974:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130808.418201:0:7974:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddd85cdf00 going to sleep for 11 seconds 00000100:00100000:3.0:1789130808.418369:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508704640 00000100:00100000:3.0:1789130808.418378:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508704640 00000100:00100000:3.0:1789130808.418448:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789130808.418501:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8606050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+17:7974:x1876039508704640:12345-0@lo:502: 00000100:00100000:3.0:1789130808.418678:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8606050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+17:7974:x1876039508704640:12345-0@lo:502: Request processed in 219us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130808.418687:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789130808.418983:0:7974:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff751a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:7974:1876039508704640:0@lo:502: 00000020:01000000:0.0:1789130808.419009:0:7974:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789130808.419015:0:7974:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789130808.419017:0:7974:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1789130808.419022:0:7974:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:2.0:1789130808.424562:0:6497:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1789130808.424619:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789130808.424635:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff91ddfa939e00/0xf3fe2838e1fc1ed1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc1ed8 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130808.424666:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff91ddfa939e00/0xf3fe2838e1fc1ed1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc1ed8 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789130808.424680:0:6497:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789130808.424683:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91dded7b6800 from 1 10000000:01000000:2.0:1789130808.424686:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789130808.424739:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff91ddc27e6400/0xf3fe2838e1fc1edf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130808.424746:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff91ddc27e6400/0xf3fe2838e1fc1edf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130808.424759:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff91ddc27e6400/0xf3fe2838e1fc1edf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130808.424791:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddca0c7c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508704768:0@lo:101: 00000100:00100000:2.0:1789130808.424885:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130808.424941:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddff7a8000 going to sleep for 11 seconds 00000100:00100000:2.0:1789130808.424967:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508704768 00000100:00100000:2.0:1789130808.424974:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508704768 00000100:00100000:2.0:1789130808.425029:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789130808.425040:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8604c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+17:6497:x1876039508704768:12345-0@lo:101: 00010000:00010000:2.0:1789130808.425056:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130808.425071:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91ddc27e6a00/0xf3fe2838e1fc1ee6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3fe2838e1fc1edf expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130808.425098:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91ddc27e6a00/0xf3fe2838e1fc1ee6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3fe2838e1fc1edf expref: 18 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130808.425121:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91ddc27e6a00/0xf3fe2838e1fc1ee6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc1edf expref: 18 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130808.425132:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ddc27e6a00, rc 0) 00000100:00100000:2.0:1789130808.425176:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8604c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+18:6497:x1876039508704768:12345-0@lo:101: Request processed in 137us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130808.425184:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789130808.425238:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddca0c7c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508704768:0@lo:101: 00010000:00010000:2.0:1789130808.425255:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff91ddc27e6400/0xf3fe2838e1fc1edf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc1ee6 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130808.425263:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff91ddc27e6400/0xf3fe2838e1fc1edf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3fe2838e1fc1ee6 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130808.425342:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddca0c7c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508704896:0@lo:501: 00000100:00100000:2.0:1789130808.425366:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130808.425379:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddff7a8000 going to sleep for 11 seconds 00000100:00100000:2.0:1789130808.425405:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508704896 00000100:00100000:2.0:1789130808.425409:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508704896 00000100:00100000:2.0:1789130808.425442:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789130808.425449:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8605050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+18:6497:x1876039508704896:12345-0@lo:501: 00000100:00100000:2.0:1789130808.425599:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8605050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+18:6497:x1876039508704896:12345-0@lo:501: Request processed in 150us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130808.425606:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789130808.425637:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddca0c7c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508704896:0@lo:501: 00000100:00100000:2.0:1789130808.425666:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddca0c7c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508705024:0@lo:503: 00000100:00100000:2.0:1789130808.425718:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130808.425732:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddff7a8000 going to sleep for 11 seconds 00000100:00100000:2.0:1789130808.425744:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508705024 00000100:00100000:2.0:1789130808.425747:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508705024 00000100:00100000:2.0:1789130808.425767:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789130808.425773:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8607450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+18:6497:x1876039508705024:12345-0@lo:503: 00000100:00100000:2.0:1789130808.425847:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8607450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+18:6497:x1876039508705024:12345-0@lo:503: Request processed in 74us (129us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130808.425853:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789130808.425891:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddca0c7c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508705024:0@lo:503: 00000100:00100000:0.0:1789130808.435928:0:7976:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff751a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:7976:1876039508705152:0@lo:502: 00000100:00100000:0.0:1789130808.436047:0:7976:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130808.436109:0:7976:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddd85cd6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789130808.436168:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508705152 00000100:00100000:2.0:1789130808.436177:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508705152 00000100:00100000:2.0:1789130808.436244:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789130808.436257:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8607850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+18:7976:x1876039508705152:12345-0@lo:502: 00000100:00100000:2.0:1789130808.436423:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8607850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+18:7976:x1876039508705152:12345-0@lo:502: Request processed in 157us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130808.436432:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789130808.442161:0:7976:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff751a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:7976:1876039508705152:0@lo:502: 00000020:01000000:2.0:1789130808.442229:0:7976:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789130808.442247:0:7976:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789130808.442249:0:7976:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789130808.442258:0:7976:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff91dded7b6800 00000020:00000080:2.0:1789130808.442262:0:7976:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789130808.442330:0:7976:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddca0c7c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:7976:1876039508705280:0@lo:502: 00000100:00100000:2.0:1789130808.442442:0:7976:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130808.442517:0:7976:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddff7a8840 going to sleep for 11 seconds 00000100:00100000:3.0:1789130808.442690:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508705280 00000100:00100000:3.0:1789130808.442698:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508705280 00000100:00100000:3.0:1789130808.442771:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789130808.442782:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8606c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+18:7976:x1876039508705280:12345-0@lo:502: 00000100:00100000:3.0:1789130808.442922:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8606c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+18:7976:x1876039508705280:12345-0@lo:502: Request processed in 142us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130808.442931:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789130808.443128:0:7976:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddca0c7c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:7976:1876039508705280:0@lo:502: 00000020:01000000:2.0:1789130808.443164:0:7976:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789130808.443170:0:7976:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789130808.443171:0:7976:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1789130808.443175:0:7976:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:3.0:1789130808.447612:0:6497:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1789130808.447664:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789130808.447679:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff91ddc27e6400/0xf3fe2838e1fc1edf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc1ee6 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130808.447720:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff91ddc27e6400/0xf3fe2838e1fc1edf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc1ee6 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130809.238069:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130810.260365:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130811.282615:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789130811.985854:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789130811.985888:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddca181680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508705408:0@lo:41: 00000100:00100000:3.0:1789130811.985994:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130811.986090:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508705408 00000100:00100000:3.0:1789130811.986099:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508705408 00000100:00100000:3.0:1789130811.986158:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789130811.986170:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddca180b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508705408:12345-0@lo:41: 00000004:00000024:3.0:1789130811.986219:0:6505:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:3.0:1789130811.986269:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddca180b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508705408:12345-0@lo:41: Request processed in 102us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130811.986277:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789130811.986348:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddca181680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508705408:0@lo:41: 00000100:00100000:3.0:1789130811.991179:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddca180f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3626:1876039508705664:0@lo:400: 00000100:00100000:3.0:1789130811.991266:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130811.991333:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789130811.991339:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddca181680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3626:1876039508705536:0@lo:400: 00000100:00100000:3.0:1789130811.991382:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130811.991423:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddca1821c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1876039508705920:0@lo:400: 00000100:00100000:3.0:1789130811.991505:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130811.991526:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789130811.991532:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddca180780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3628:1876039508705792:0@lo:400: 00000100:00100000:3.0:1789130811.991564:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130811.991593:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508705920 00000100:00100000:3.0:1789130811.991602:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508705920 00000100:00100000:3.0:1789130811.991657:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789130811.991666:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff7c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3628:x1876039508705920:12345-0@lo:400: 00000100:00100000:3.0:1789130811.991724:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff7c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3628:x1876039508705920:12345-0@lo:400: Request processed in 58us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130811.991731:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789130811.991783:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddca1821c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1876039508705920:0@lo:400: 00000100:00100000:0.0:1789130811.996220:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508705664 00000100:00100000:0.0:1789130811.996241:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508705664 00000100:00100000:0.0:1789130811.996336:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508705792 00000100:00100000:0.0:1789130811.996340:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508705792 00000100:00100000:0.0:1789130811.996372:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789130811.996384:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddca182580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1876039508705664:12345-0@lo:400: 00000100:00100000:0.0:1789130811.996544:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddca182580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1876039508705664:12345-0@lo:400: Request processed in 161us (5277us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130811.996552:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789130811.996570:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789130811.996577:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff7c12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3628:x1876039508705792:12345-0@lo:400: 00000100:00100000:0.0:1789130811.996615:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff7c12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3628:x1876039508705792:12345-0@lo:400: Request processed in 39us (5050us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130811.996621:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1789130811.996682:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91ddca180f00 x1876039508705664/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130827 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789130811.996708:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddca180f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3626:1876039508705664:0@lo:400: 00010000:00080000:0.0:1789130811.996751:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91ddca180780 x1876039508705792/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130827 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789130811.996761:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddca180780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3628:1876039508705792:0@lo:400: 00000100:00100000:2.0:1789130812.000787:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508705536 00000100:00100000:2.0:1789130812.000815:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508705536 00000100:00100000:2.0:1789130812.000889:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789130812.000900:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8605450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+18:3626:x1876039508705536:12345-0@lo:400: 00000100:00100000:2.0:1789130812.001107:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8605450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+18:3626:x1876039508705536:12345-0@lo:400: Request processed in 208us (9723us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130812.001116:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789130812.001631:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddca181680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3626:1876039508705536:0@lo:400: 00000100:00100000:1.0:1789130812.001665:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789130812.001676:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddca0c7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508706048:0@lo:41: 00000100:00100000:1.0:1789130812.001722:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130812.001766:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508706048 00000100:00100000:1.0:1789130812.001771:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508706048 00000100:00100000:1.0:1789130812.001814:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789130812.001824:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddca0fb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508706048:12345-0@lo:41: 00000004:00000024:1.0:1789130812.001857:0:6505:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:1.0:1789130812.001897:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddca0fb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508706048:12345-0@lo:41: Request processed in 75us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130812.001904:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789130812.002480:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddca0c7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508706048:0@lo:41: 00010000:00010000:3.0:1789130812.306770:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130813.330968:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130814.355515:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130815.377614:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130816.402231:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789130817.105643:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789130817.105669:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddca0c4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508706176:0@lo:41: 00000100:00100000:2.0:1789130817.105784:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130817.105907:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508706176 00000100:00100000:1.0:1789130817.105915:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508706176 00000100:00100000:1.0:1789130817.105964:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789130817.105973:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddca0c4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1876039508706176:12345-0@lo:41: 00000004:00000024:1.0:1789130817.106007:0:6505:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:1.0:1789130817.106069:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddca0c4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1876039508706176:12345-0@lo:41: Request processed in 97us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130817.106077:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789130817.106120:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddca0c4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508706176:0@lo:41: 00000100:00100000:1.0:1789130817.106451:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddca0f92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3626:1876039508706688:0@lo:400: 00000100:00100000:1.0:1789130817.106518:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130817.106558:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789130817.106564:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddca0f8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1876039508706560:0@lo:400: 00000100:00100000:1.0:1789130817.106587:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130817.106611:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508706688 00000100:00100000:1.0:1789130817.106615:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508706688 00000100:00100000:1.0:1789130817.106643:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789130817.106650:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddca0fa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1876039508706688:12345-0@lo:400: 00000100:00100000:1.0:1789130817.106684:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddca0fa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1876039508706688:12345-0@lo:400: Request processed in 34us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130817.106691:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:1.0:1789130817.106719:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91ddca0f92c0 x1876039508706688/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130833 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789130817.106730:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddca0f92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3626:1876039508706688:0@lo:400: 00000100:00100000:1.0:1789130817.106748:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508706560 00000100:00100000:1.0:1789130817.106751:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508706560 00000100:00100000:1.0:1789130817.106770:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789130817.106776:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddca22a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1876039508706560:12345-0@lo:400: 00000100:00100000:1.0:1789130817.106807:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddca22a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1876039508706560:12345-0@lo:400: Request processed in 30us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130817.106813:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789130817.106844:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddca0f8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1876039508706560:0@lo:400: 00000100:00100000:0.0:1789130817.106986:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddca0fbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3627:1876039508706304:0@lo:400: 00000100:00100000:0.0:1789130817.107019:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130817.107043:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789130817.107049:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddca0f9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3627:1876039508706432:0@lo:400: 00000100:00100000:0.0:1789130817.107070:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130817.107363:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508706304 00000100:00100000:1.0:1789130817.107367:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508706304 00000100:00100000:1.0:1789130817.107403:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789130817.107410:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8604450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+18:3627:x1876039508706304:12345-0@lo:400: 00000100:00100000:1.0:1789130817.107448:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8604450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+18:3627:x1876039508706304:12345-0@lo:400: Request processed in 39us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130817.107454:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789130817.107498:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508706432 00000100:00100000:1.0:1789130817.107502:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508706432 00000100:00100000:1.0:1789130817.107522:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789130817.107529:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff750780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1876039508706432:12345-0@lo:400: 00000100:00100000:1.0:1789130817.107574:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff750780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1876039508706432:12345-0@lo:400: Request processed in 45us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130817.107580:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:1.0:1789130817.107608:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91ddca0f9680 x1876039508706432/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130833 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789130817.107617:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddca0f9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3627:1876039508706432:0@lo:400: 00000100:00100000:1.0:1789130817.107625:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddca0fbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3627:1876039508706304:0@lo:400: 00000100:00100000:1.0:1789130817.109887:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff752d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508706816:0@lo:41: 00000100:00100000:1.0:1789130817.109953:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130817.110044:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508706816 00000100:00100000:0.0:1789130817.110050:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508706816 00000100:00100000:0.0:1789130817.110094:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789130817.110103:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddca22a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508706816:12345-0@lo:41: 00000004:00000024:0.0:1789130817.110133:0:6505:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:0.0:1789130817.110177:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddca22a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508706816:12345-0@lo:41: Request processed in 76us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130817.110183:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789130817.110414:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff752d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508706816:0@lo:41: 00000020:01000004:1.0:1789130817.355507:0:8408:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1789130817.355516:0:8408:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:1.0:1789130817.355517:0:8408:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1789130817.355708:0:8408:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff91ddff4f9000 00000020:01000004:1.0:1789130817.355745:0:8408:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1789130817.355762:0:8408:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1789130817.355783:0:8408:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff91ddcf69b490) 00000020:00000080:1.0:1789130817.355802:0:8408:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1789130817.404047:0:8408:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1789130817.404117:0:8408:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00080000:01000000:3.0:1789130817.419257:0:8408:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1789130817.419783:0:8408:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1789130817.419799:0:8408:0:(osd_handler.c:8895:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789130817.419907:0:8408:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xf3fe2838e1fc1ef4 00000020:01000004:3.0:1789130817.419917:0:8408:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:3.0:1789130817.419944:0:8408:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.111@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789130817.419948:0:8408:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.111@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789130817.419955:0:8408:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1789130817.419961:0:8408:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1789130817.419975:0:8408:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff91ddff71ced8) 00000020:00000080:3.0:1789130817.419991:0:8408:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type ost with refcount 2 00000100:00100000:3.0:1789130817.422604:0:8408:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789130817.422879:0:8408:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1789130817.422886:0:8408:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00010000:00010000:1.0:1789130817.427738:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789130817.427755:0:8408:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1789130817.427767:0:8408:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1789130817.431015:0:8408:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1789130817.431036:0:8408:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1789130817.433984:0:8408:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789130817.434206:0:8408:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1789130817.434213:0:8408:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1789130817.435102:0:8408:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1789130817.435111:0:8408:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1789130817.482758:0:8408:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789130817.483384:0:8408:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1789130817.483393:0:8408:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1789130817.485960:0:8408:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1789130817.485978:0:8408:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1789130817.487790:0:8408:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1789130817.487803:0:8408:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1789130817.491954:0:8408:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789130817.492157:0:8408:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1789130817.492164:0:8408:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1789130817.492949:0:8408:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1789130817.492958:0:8408:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:1.0:1789130817.571501:0:8408:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789130817.571918:0:8408:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1789130817.572042:0:8408:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1789130817.577272:0:8408:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1789130817.577291:0:8408:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1789130817.580379:0:8408:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1789130817.580563:0:8408:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:3.0:1789130817.580571:0:8408:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.111@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1789130817.627080:0:8408:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.111@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789130817.627119:0:8408:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.111@tcp, index=0000, flags=0x20062 00000020:01000004:3.0:1789130817.627123:0:8408:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789130817.627125:0:8408:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789130817.627127:0:8408:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789130817.627128:0:8408:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789130817.627129:0:8408:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789130817.627130:0:8408:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789130817.627131:0:8408:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789130817.627133:0:8408:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789130817.627134:0:8408:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789130817.627136:0:8408:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789130817.627137:0:8408:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789130817.627140:0:8408:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:3.0:1789130817.627143:0:8408:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789130817.627144:0:8408:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789130817.627145:0:8408:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789130817.627146:0:8408:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789130817.627147:0:8408:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789130817.627148:0:8408:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789130817.627149:0:8408:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789130817.627150:0:8408:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789130817.627151:0:8408:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789130817.627152:0:8408:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789130817.627153:0:8408:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789130817.627188:0:8408:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1789130817.627207:0:8408:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff7c0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:8408:1876039508706944:0@lo:253: 00000100:00100000:3.0:1789130817.627286:0:8408:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130817.627423:0:8408:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddd8364240 going to sleep for 11 seconds 00000100:00100000:2.0:1789130817.627436:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508706944 00000100:00100000:2.0:1789130817.627445:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508706944 00000100:00100000:2.0:1789130817.627524:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789130817.627534:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8607c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+18:8408:x1876039508706944:12345-0@lo:253: 20000000:01000000:2.0:1789130817.627566:0:6492:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1789130817.627570:0:6492:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:2.0:1789130817.627575:0:6492:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:2.0:1789130817.627579:0:6492:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:2.0:1789130817.627755:0:6492:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789130817.627879:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:2.0:1789130817.627892:0:6492:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:2.0:1789130817.627918:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:2.0:1789130817.627925:0:6492:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:2.0:1789130817.627938:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:2.0:1789130817.627954:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:2.0:1789130817.628033:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:2.0:1789130817.628046:0:6492:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.111@tcp 20000000:01000000:2.0:1789130817.628049:0:6492:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.111@tcp (null) (null) (null) 00000040:00080000:2.0:1789130817.629313:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:2.0:1789130817.629330:0:6492:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1789130817.629355:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:2.0:1789130817.629361:0:6492:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.203.111@tcp (null) (null) 00000040:00080000:2.0:1789130817.629374:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:2.0:1789130817.629380:0:6492:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1789130817.629390:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:2.0:1789130817.629403:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:2.0:1789130817.629563:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].25, 224 off12680 20000000:01000000:2.0:1789130817.629578:0:6492:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.111@tcp 20000000:01000000:2.0:1789130817.629580:0:6492:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.111@tcp (null) (null) (null) 00000040:00080000:2.0:1789130817.629593:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].26, 88 off12768 20000000:01000000:2.0:1789130817.629598:0:6492:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1789130817.629609:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].27, 144 off12912 20000000:01000000:2.0:1789130817.629612:0:6492:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf003 lustre-OST0000_UUID 192.168.203.111@tcp (null) (null) 00000040:00080000:2.0:1789130817.629623:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].28, 152 off13064 20000000:01000000:2.0:1789130817.629628:0:6492:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1789130817.629639:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].29, 136 off13200 00000040:00080000:2.0:1789130817.629652:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].30, 224 off13424 00000040:00080000:2.0:1789130817.630010:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13448 20000000:01000000:2.0:1789130817.630021:0:6492:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.111@tcp 20000000:01000000:2.0:1789130817.630023:0:6492:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.111@tcp (null) (null) (null) 00000040:00080000:2.0:1789130817.630037:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13536 20000000:01000000:2.0:1789130817.630042:0:6492:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1789130817.631305:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13664 20000000:01000000:2.0:1789130817.631324:0:6492:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.203.111@tcp (null) (null) 00000040:00080000:2.0:1789130817.631341:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13808 20000000:01000000:2.0:1789130817.631348:0:6492:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1789130817.631362:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13936 00000040:00080000:2.0:1789130817.631378:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14160 20000000:01000000:2.0:1789130817.631394:0:6492:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1789130817.631397:0:6492:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1789130817.631401:0:6492:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1789130817.631441:0:6492:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:2.0:1789130817.631444:0:6492:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:1.0:1789130817.634347:0:8427:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 18 1->4: lustre sys.timeout 20000000:01000000:1.0:1789130817.634399:0:8427:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 18 2->4: lustre sys.timeout 00000040:00080000:1.0:1789130817.634415:0:8427:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 31 count 31 00000040:00080000:2.0:1789130817.638346:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].31, 224 off13648 00000040:00080000:2.0:1789130817.638379:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].32, 80 off13728 00000040:00080000:2.0:1789130817.638393:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].33, 224 off13952 20000000:01000000:2.0:1789130817.638405:0:6492:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1789130817.638408:0:6492:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1789130817.638822:0:8428:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 19 1->4: lustre sys.timeout 20000000:01000000:1.0:1789130817.638850:0:8428:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 19 2->4: lustre sys.timeout 00000040:00080000:1.0:1789130817.638867:0:8428:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:2.0:1789130817.646367:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:2.0:1789130817.646400:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:2.0:1789130817.646415:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:2.0:1789130817.646424:0:6492:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1789130817.646427:0:6492:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1789130817.647759:0:8429:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:2.0:1789130817.648133:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:2.0:1789130817.648161:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:2.0:1789130817.648179:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:2.0:1789130817.648191:0:6492:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1789130817.648193:0:6492:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789130817.648624:0:8430:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 20 1->4: lustre sys.timeout 20000000:01000000:3.0:1789130817.648645:0:8430:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 20 2->4: lustre sys.timeout 00000040:00080000:3.0:1789130817.648659:0:8430:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:2.0:1789130817.648903:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14384 00000040:00080000:2.0:1789130817.648938:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14464 00000040:00080000:2.0:1789130817.649053:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14688 10000000:01000000:2.0:1789130817.649073:0:6492:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1789130817.649095:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91ddc27e6800/0xf3fe2838e1fc1f02 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130817.649121:0:6492:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91ddc27e7e00/0xf3fe2838e1fc1dce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc1dc7 expref: 18 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130817.649129:0:6492:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91ddc0031a00/0xf3fe2838e1fc1e45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc1e3e expref: 18 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130817.649135:0:6492:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91ddc0030800/0xf3fe2838e1fc1e7d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc1e76 expref: 18 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130817.649142:0:6492:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91ddfa80ee00/0xf3fe2838e1fc1e99 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc1e92 expref: 18 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130817.649148:0:6492:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91dde19aa000/0xf3fe2838e1fc1ec3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc1ebc expref: 18 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130817.649156:0:6492:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91ddc27e6800/0xf3fe2838e1fc1f02 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130817.649196:0:6492:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91dde19aa000/0xf3fe2838e1fc1ec3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf3fe2838e1fc1ebc expref: 18 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130817.649212:0:6492:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91dde19aa000/0xf3fe2838e1fc1ec3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf3fe2838e1fc1ebc expref: 18 pid: 6494 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130817.649228:0:6492:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddca0c7c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6492:1876039508707072:0@lo:104: 00000100:00100000:2.0:1789130817.649313:0:6492:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789130817.649374:0:6492:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91ddfa80ee00/0xf3fe2838e1fc1e99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf3fe2838e1fc1e92 expref: 18 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130817.649383:0:6492:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91ddfa80ee00/0xf3fe2838e1fc1e99 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf3fe2838e1fc1e92 expref: 18 pid: 6494 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130817.649400:0:6492:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dde0b81680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6492:1876039508707200:0@lo:104: 00000100:00100000:2.0:1789130817.649436:0:6492:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789130817.649557:0:6492:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91ddc0030800/0xf3fe2838e1fc1e7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf3fe2838e1fc1e76 expref: 18 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130817.649566:0:6492:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91ddc0030800/0xf3fe2838e1fc1e7d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf3fe2838e1fc1e76 expref: 18 pid: 6492 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130817.649577:0:6492:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc5fe8f00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6492:1876039508707328:0@lo:104: 00000100:00100000:2.0:1789130817.649680:0:6492:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789130817.652488:0:6492:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91ddc0031a00/0xf3fe2838e1fc1e45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf3fe2838e1fc1e3e expref: 18 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130817.652506:0:6492:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91ddc0031a00/0xf3fe2838e1fc1e45 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf3fe2838e1fc1e3e expref: 18 pid: 6494 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130817.652522:0:6492:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc5fe8b40 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6492:1876039508707456:0@lo:104: 00000100:00100000:2.0:1789130817.652572:0:6492:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130817.652695:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508707072 00000100:00100000:0.0:1789130817.652703:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508707072 00000100:00100000:0.0:1789130817.652743:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508707200 00000100:00100000:0.0:1789130817.652746:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508707200 00000100:00100000:0.0:1789130817.652754:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508707328 00000100:00100000:0.0:1789130817.652776:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508707328 00000100:00100000:0.0:1789130817.652793:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789130817.652802:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dde0b80f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+5:6492:x1876039508707072:12345-0@lo:104: 00010000:00010000:0.0:1789130817.652815:0:6483:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff91ddc27e7600/0xf3fe2838e1fc1ebc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3fe2838e1fc1ec3 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130817.652875:0:6483:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789130817.652882:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dde0b80f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+5:6492:x1876039508707072:12345-0@lo:104: Request processed in 81us (3569us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130817.652889:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789130817.652906:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789130817.653056:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc5fea1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+4:6492:x1876039508707200:12345-0@lo:104: 00010000:00010000:0.0:1789130817.653069:0:6483:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff91ddfa80fa00/0xf3fe2838e1fc1e92 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3fe2838e1fc1e99 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130817.653109:0:6483:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789130817.653114:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc5fea1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+4:6492:x1876039508707200:12345-0@lo:104: Request processed in 203us (3679us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130817.653121:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789130817.653136:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789130817.653143:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc5fe9680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+3:6492:x1876039508707328:12345-0@lo:104: 00010000:00010000:0.0:1789130817.653151:0:6483:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff91ddc0031600/0xf3fe2838e1fc1e76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3fe2838e1fc1e7d expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130817.653187:0:6483:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1789130817.653193:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc5fe9680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+3:6492:x1876039508707328:12345-0@lo:104: Request processed in 51us (3513us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130817.653199:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:0.0:1789130817.653230:0:7442:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789130817.653237:0:7442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff91ddc27e7600/0xf3fe2838e1fc1ebc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3fe2838e1fc1ec3 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130817.653256:0:7442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddc27e7600 already unused, calling callback (ffffffffc124bc20) 10000000:00010000:0.0:1789130817.653260:0:7442:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff91ddc27e7600/0xf3fe2838e1fc1ebc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xf3fe2838e1fc1ec3 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130817.653268:0:7442:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff91ddc27e7600/0xf3fe2838e1fc1ebc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xf3fe2838e1fc1ec3 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789130817.653276:0:7442:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff91ddc27e7600/0xf3fe2838e1fc1ebc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xf3fe2838e1fc1ec3 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789130817.653282:0:7442:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789130817.653316:0:7442:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff91ddc27e7600/0xf3fe2838e1fc1ebc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc1ec3 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130817.653323:0:7442:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789130817.653346:0:7442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff91ddc27e7600/0xf3fe2838e1fc1ebc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc1ec3 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130817.653354:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff91ddc27e7600/0xf3fe2838e1fc1ebc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc1ec3 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130817.653367:0:7442:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789130817.653371:0:7442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff91ddfa80fa00/0xf3fe2838e1fc1e92 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3fe2838e1fc1e99 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130817.653378:0:7442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddfa80fa00 already unused, calling callback (ffffffffc124bc20) 10000000:00010000:0.0:1789130817.653381:0:7442:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff91ddfa80fa00/0xf3fe2838e1fc1e92 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xf3fe2838e1fc1e99 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130817.653394:0:7442:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff91ddfa80fa00/0xf3fe2838e1fc1e92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xf3fe2838e1fc1e99 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789130817.653400:0:7442:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff91ddfa80fa00/0xf3fe2838e1fc1e92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xf3fe2838e1fc1e99 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789130817.653406:0:7442:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789130817.653420:0:7442:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff91ddfa80fa00/0xf3fe2838e1fc1e92 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc1e99 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130817.653427:0:7442:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789130817.653441:0:7442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff91ddfa80fa00/0xf3fe2838e1fc1e92 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc1e99 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130817.653447:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff91ddfa80fa00/0xf3fe2838e1fc1e92 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc1e99 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130817.653479:0:7442:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789130817.653483:0:7442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff91ddc0031600/0xf3fe2838e1fc1e76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3fe2838e1fc1e7d expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130817.653489:0:7442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddc0031600 already unused, calling callback (ffffffffc124bc20) 10000000:00010000:0.0:1789130817.653492:0:7442:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff91ddc0031600/0xf3fe2838e1fc1e76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf3fe2838e1fc1e7d expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130817.653498:0:7442:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff91ddc0031600/0xf3fe2838e1fc1e76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf3fe2838e1fc1e7d expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789130817.653505:0:7442:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff91ddc0031600/0xf3fe2838e1fc1e76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf3fe2838e1fc1e7d expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789130817.653517:0:7442:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789130817.653534:0:7442:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff91ddc0031600/0xf3fe2838e1fc1e76 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc1e7d expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130817.653540:0:7442:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789130817.653546:0:7442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff91ddc0031600/0xf3fe2838e1fc1e76 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc1e7d expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130817.653553:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff91ddc0031600/0xf3fe2838e1fc1e76 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc1e7d expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130817.653564:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130817.653565:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130817.653567:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130817.653573:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789130817.653817:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff753840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3628:1876039508707584:0@lo:103: 00000100:00100000:2.0:1789130817.653851:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789130817.653904:0:6492:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91ddc27e7e00/0xf3fe2838e1fc1dce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf3fe2838e1fc1dc7 expref: 18 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130817.653926:0:6492:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91ddc27e7e00/0xf3fe2838e1fc1dce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf3fe2838e1fc1dc7 expref: 18 pid: 6494 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130817.653936:0:6492:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc5feb480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6492:1876039508707968:0@lo:104: 00000100:00100000:2.0:1789130817.653976:0:6492:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130817.654123:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508707584 00000100:00100000:3.0:1789130817.654134:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508707584 00010000:00010000:3.0:1789130817.654159:0:6487:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91dde19aa000/0xf3fe2838e1fc1ec3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3fe2838e1fc1ebc expref: 19 pid: 6494 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130817.654186:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789130817.654194:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc5fe9e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+19:3628:x1876039508707584:12345-0@lo:103: 00010000:00010000:3.0:1789130817.654205:0:6487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789130817.654210:0:6487:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91dde19aa000/0xf3fe2838e1fc1ec3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3fe2838e1fc1ebc expref: 19 pid: 6494 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130817.654221:0:6487:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91dde19aa000/0xf3fe2838e1fc1ec3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf3fe2838e1fc1ebc expref: 19 pid: 6494 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130817.654238:0:6487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789130817.654288:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc5fe9e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+19:3628:x1876039508707584:12345-0@lo:103: Request processed in 95us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130817.654296:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789130817.654408:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff753840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3628:1876039508707584:0@lo:103: 00000100:00100000:2.0:1789130817.654432:0:6492:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddff9d6e40 going to sleep for 11 seconds 00010000:00010000:2.0:1789130817.654443:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91dde19aa000/0xf3fe2838e1fc1ec3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf3fe2838e1fc1ebc expref: 18 pid: 6494 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130817.654453:0:6492:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddca0c7c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6492:1876039508707072:0@lo:104: 00000100:00100000:2.0:1789130817.654515:0:6492:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dde0b81680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6492:1876039508707200:0@lo:104: 00000100:00100000:2.0:1789130817.654524:0:6492:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc5fe8f00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6492:1876039508707328:0@lo:104: 00000100:00100000:0.0:1789130817.654720:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508707456 00000100:00100000:0.0:1789130817.654724:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508707456 00000100:00100000:0.0:1789130817.654743:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508707968 00000100:00100000:0.0:1789130817.654745:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508707968 00000100:00100000:0.0:1789130817.654757:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789130817.654762:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc5feb840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+4:6492:x1876039508707456:12345-0@lo:104: 00010000:00010000:0.0:1789130817.654772:0:6483:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff91ddfa939600/0xf3fe2838e1fc1e3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3fe2838e1fc1e45 expref: -99 pid: 7430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130817.654857:0:6483:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789130817.654863:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc5feb840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+4:6492:x1876039508707456:12345-0@lo:104: Request processed in 101us (2291us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130817.654869:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789130817.654882:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789130817.654894:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc5fe92c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+3:6492:x1876039508707968:12345-0@lo:104: 00010000:00010000:0.0:1789130817.654902:0:6483:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff91ddc0030400/0xf3fe2838e1fc1dc7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3fe2838e1fc1dce expref: -99 pid: 7430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130817.654943:0:6483:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789130817.654948:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc5fe92c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+3:6492:x1876039508707968:12345-0@lo:104: Request processed in 56us (973us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130817.654954:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789130817.655180:0:6492:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc5fe8b40 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6492:1876039508707456:0@lo:104: 00000100:00100000:2.0:1789130817.655189:0:6492:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc5feb480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6492:1876039508707968:0@lo:104: 00010000:00010000:2.0:1789130817.655222:0:6492:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91ddc27e6800/0xf3fe2838e1fc1f02 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130817.655264:0:6489:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789130817.655273:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff91ddfa939600/0xf3fe2838e1fc1e3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3fe2838e1fc1e45 expref: -99 pid: 7430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130817.655281:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddfa939600 already unused, calling callback (ffffffffc124bc20) 00010000:00010000:0.0:1789130817.655289:0:6488:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:00010000:1.0:1789130817.655291:0:6489:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff91ddfa939600/0xf3fe2838e1fc1e3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf3fe2838e1fc1e45 expref: -99 pid: 7430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130817.655296:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff91ddc0030400/0xf3fe2838e1fc1dc7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3fe2838e1fc1dce expref: -99 pid: 7430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130817.655302:0:6489:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff91ddfa939600/0xf3fe2838e1fc1e3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf3fe2838e1fc1e45 expref: -99 pid: 7430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130817.655305:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddc0030400 already unused, calling callback (ffffffffc124bc20) 10000000:00010000:0.0:1789130817.655311:0:6488:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff91ddc0030400/0xf3fe2838e1fc1dc7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf3fe2838e1fc1dce expref: -99 pid: 7430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789130817.655313:0:6489:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff91ddfa939600/0xf3fe2838e1fc1e3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf3fe2838e1fc1e45 expref: -99 pid: 7430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789130817.655329:0:6489:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789130817.655330:0:6488:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff91ddc0030400/0xf3fe2838e1fc1dc7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf3fe2838e1fc1dce expref: -99 pid: 7430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789130817.655338:0:6488:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff91ddc0030400/0xf3fe2838e1fc1dc7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf3fe2838e1fc1dce expref: -99 pid: 7430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789130817.655343:0:6488:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789130817.655364:0:6489:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff91ddfa939600/0xf3fe2838e1fc1e3e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc1e45 expref: -99 pid: 7430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130817.655366:0:6488:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff91ddc0030400/0xf3fe2838e1fc1dc7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc1dce expref: -99 pid: 7430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130817.655381:0:6489:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789130817.655383:0:6488:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789130817.655400:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff91ddfa939600/0xf3fe2838e1fc1e3e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc1e45 expref: -99 pid: 7430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130817.655408:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff91ddfa939600/0xf3fe2838e1fc1e3e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc1e45 expref: -99 pid: 7430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130817.655418:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130817.655421:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130817.655423:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789130817.655436:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddca229a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3627:1876039508708096:0@lo:103: 00000100:00100000:1.0:1789130817.655489:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130817.655500:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff753c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3628:1876039508708224:0@lo:103: 00000100:00100000:2.0:1789130817.655531:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130817.655537:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff751e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3625:1876039508707712:0@lo:103: 00000100:00100000:1.0:1789130817.655567:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130817.655588:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789130817.655595:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff752d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3625:1876039508707840:0@lo:103: 00000100:00100000:1.0:1789130817.655616:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130817.655646:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508708096 00000100:00100000:1.0:1789130817.655649:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508708096 00010000:00010000:1.0:1789130817.655668:0:6486:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91ddc0031a00/0xf3fe2838e1fc1e45 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3fe2838e1fc1e3e expref: 18 pid: 6494 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130817.655683:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508708224 00000100:00100000:1.0:1789130817.655686:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508708224 00010000:00010000:1.0:1789130817.655695:0:6486:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91ddc27e7e00/0xf3fe2838e1fc1dce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3fe2838e1fc1dc7 expref: 19 pid: 6494 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130817.655707:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508707712 00000100:00100000:1.0:1789130817.655710:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508707712 00010000:00010000:1.0:1789130817.655718:0:6486:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91ddfa80ee00/0xf3fe2838e1fc1e99 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3fe2838e1fc1e92 expref: 20 pid: 6494 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130817.655725:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff91ddc0030400/0xf3fe2838e1fc1dc7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc1dce expref: -99 pid: 7430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130817.655729:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508707840 00000100:00100000:1.0:1789130817.655733:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508707840 00010000:00010000:1.0:1789130817.655742:0:6486:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91ddc0030800/0xf3fe2838e1fc1e7d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3fe2838e1fc1e76 expref: 21 pid: 6492 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130817.655764:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff91ddc0030400/0xf3fe2838e1fc1dc7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc1dce expref: -99 pid: 7430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130817.655771:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789130817.655783:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddca229e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+21:3627:x1876039508708096:12345-0@lo:103: 00010000:00010000:0.0:1789130817.655786:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130817.655790:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130817.655792:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130817.655794:0:6486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789130817.655799:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130817.655803:0:6486:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91ddc0031a00/0xf3fe2838e1fc1e45 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3fe2838e1fc1e3e expref: 21 pid: 6494 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130817.655813:0:6486:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91ddc0031a00/0xf3fe2838e1fc1e45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf3fe2838e1fc1e3e expref: 21 pid: 6494 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130817.655826:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91ddc0031a00/0xf3fe2838e1fc1e45 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf3fe2838e1fc1e3e expref: 21 pid: 6494 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130817.655848:0:6486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789130817.655870:0:6485:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1789130817.655877:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddca229e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+20:3627:x1876039508708096:12345-0@lo:103: Request processed in 96us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130817.655880:0:6485:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:1.0:1789130817.655889:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789130817.655904:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789130817.655911:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc5feb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+19:3628:x1876039508708224:12345-0@lo:103: 00010000:00010000:1.0:1789130817.655918:0:6486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789130817.655922:0:6486:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91ddc27e7e00/0xf3fe2838e1fc1dce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3fe2838e1fc1dc7 expref: 19 pid: 6494 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130817.655930:0:6486:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91ddc27e7e00/0xf3fe2838e1fc1dce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf3fe2838e1fc1dc7 expref: 19 pid: 6494 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130817.655940:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91ddc27e7e00/0xf3fe2838e1fc1dce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf3fe2838e1fc1dc7 expref: 19 pid: 6494 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130817.655948:0:6486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789130817.655982:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc5feb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+18:3628:x1876039508708224:12345-0@lo:103: Request processed in 72us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130817.655988:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789130817.655999:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789130817.656005:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddca0fbc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+17:3625:x1876039508707712:12345-0@lo:103: 00010000:00010000:1.0:1789130817.656012:0:6486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789130817.656016:0:6486:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91ddfa80ee00/0xf3fe2838e1fc1e99 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3fe2838e1fc1e92 expref: 17 pid: 6494 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130817.656024:0:6486:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91ddfa80ee00/0xf3fe2838e1fc1e99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf3fe2838e1fc1e92 expref: 17 pid: 6494 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130817.656039:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91ddfa80ee00/0xf3fe2838e1fc1e99 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf3fe2838e1fc1e92 expref: 17 pid: 6494 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130817.656050:0:6486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789130817.656065:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff753c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3628:1876039508708224:0@lo:103: 00000100:00100000:2.0:1789130817.656233:0:6487:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1789130817.656256:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789130817.656263:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc4ca2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+16:3625:x1876039508707840:12345-0@lo:103: 00010000:00010000:2.0:1789130817.656272:0:6487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789130817.656277:0:6487:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91ddc0030800/0xf3fe2838e1fc1e7d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3fe2838e1fc1e76 expref: 16 pid: 6492 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130817.656286:0:6487:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91ddc0030800/0xf3fe2838e1fc1e7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf3fe2838e1fc1e76 expref: 16 pid: 6492 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130817.656303:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91ddc0030800/0xf3fe2838e1fc1e7d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf3fe2838e1fc1e76 expref: 16 pid: 6492 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130817.656315:0:6487:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91ddc27e6800/0xf3fe2838e1fc1f02 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130817.656323:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91ddc27e6800/0xf3fe2838e1fc1f02 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130817.656335:0:6487:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91ddc27e6800/0xf3fe2838e1fc1f02 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130817.656342:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91ddc27e6800/0xf3fe2838e1fc1f02 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130817.656349:0:6487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91ddc27e6800/0xf3fe2838e1fc1f02 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130817.656356:0:6487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91ddc27e6800/0xf3fe2838e1fc1f02 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130817.656363:0:6487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddc27e6800 already unused, calling callback (ffffffffc0c4e550) 00010000:00010000:2.0:1789130817.656368:0:6487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91ddc27e6800/0xf3fe2838e1fc1f02 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130817.656376:0:6487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91ddc27e6800/0xf3fe2838e1fc1f02 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130817.656398:0:6487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91ddc27e6800/0xf3fe2838e1fc1f02 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130817.656419:0:6487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789130817.656502:0:6492:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91ddc27e6800/0xf3fe2838e1fc1f02 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130817.656512:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91ddc27e6800/0xf3fe2838e1fc1f02 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130817.656519:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91ddc27e6800/0xf3fe2838e1fc1f02 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789130817.656532:0:6492:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1789130817.656941:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddca0fbc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+15:3625:x1876039508707712:12345-0@lo:103: Request processed in 934us (1371us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130817.656951:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789130817.656987:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddca229a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3627:1876039508708096:0@lo:103: 00000100:00100000:2.0:1789130817.657079:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc4ca2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+14:3625:x1876039508707840:12345-0@lo:103: Request processed in 815us (1460us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130817.657087:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789130817.657163:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff752d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3625:1876039508707840:0@lo:103: 00000100:00100000:0.0:1789130817.657175:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff751e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3625:1876039508707712:0@lo:103: 00000100:00100000:2.0:1789130817.669314:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8607c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+13:8408:x1876039508706944:12345-0@lo:253: Request processed in 41773us (42020us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130817.669331:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789130817.669419:0:8408:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff7c0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:8408:1876039508706944:0@lo:253: 10000000:01000000:3.0:1789130817.669435:0:8408:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1789130817.669438:0:8408:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789130817.669452:0:8408:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789130817.669607:0:8408:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789130817.669609:0:8408:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:3.0:1789130817.669610:0:8408:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789130817.669611:0:8408:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789130817.669613:0:8408:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789130817.669614:0:8408:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1789130817.669616:0:8408:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789130817.669617:0:8408:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789130817.669651:0:8408:0:(tgt_mount.c:101:server_register_mount()) register mount ffff91ddff4f9000 from lustre-OST0000 10000000:01000000:3.0:1789130817.669680:0:8408:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1789130817.669683:0:8408:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1789130817.669690:0:8408:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff91ddd10e8000 local copy 10000000:01000000:3.0:1789130817.669694:0:8408:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789130817.669728:0:8408:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff91ddfa939c00/0xf3fe2838e1fc1f09 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130817.669738:0:8408:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.111@tcp lock: ffff91ddfa939c00/0xf3fe2838e1fc1f09 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130817.669747:0:8408:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff91ddfa939c00/0xf3fe2838e1fc1f09 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130817.669764:0:8408:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff7c0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:8408:1876039508708352:0@lo:101: 00000100:00100000:3.0:1789130817.669799:0:8408:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130817.669862:0:8408:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddd8364cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789130817.669894:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508708352 00000100:00100000:0.0:1789130817.669900:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508708352 00000100:00100000:0.0:1789130817.669987:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789130817.669997:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8605850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+13:8408:x1876039508708352:12345-0@lo:101: 00010000:00010000:0.0:1789130817.670010:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130817.670022:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91ddfa80fa00/0xf3fe2838e1fc1f10 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3fe2838e1fc1f09 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130817.670045:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91ddfa80fa00/0xf3fe2838e1fc1f10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3fe2838e1fc1f09 expref: 14 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130817.670055:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91ddfa80fa00/0xf3fe2838e1fc1f10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc1f09 expref: 14 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130817.670075:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ddfa80fa00, rc 0) 00000100:00100000:0.0:1789130817.670150:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8605850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+14:8408:x1876039508708352:12345-0@lo:101: Request processed in 155us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130817.670164:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789130817.670357:0:8408:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff7c0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:8408:1876039508708352:0@lo:101: 00010000:00010000:3.0:1789130817.670369:0:8408:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff91ddfa939c00/0xf3fe2838e1fc1f09 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xf3fe2838e1fc1f10 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130817.670377:0:8408:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff91ddfa939c00/0xf3fe2838e1fc1f09 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xf3fe2838e1fc1f10 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130817.670511:0:8408:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff7c0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:8408:1876039508708480:0@lo:501: 00000100:00100000:2.0:1789130817.671646:0:8408:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130817.671713:0:8408:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddd8364cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789130817.671755:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508708480 00000100:00100000:0.0:1789130817.671761:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508708480 00000100:00100000:0.0:1789130817.671834:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789130817.671844:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8604850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+14:8408:x1876039508708480:12345-0@lo:501: 00000100:00100000:0.0:1789130817.671929:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8604850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+14:8408:x1876039508708480:12345-0@lo:501: Request processed in 86us (286us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789130817.671938:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789130817.671998:0:8408:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff7c0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:8408:1876039508708480:0@lo:501: 10000000:01000000:2.0:1789130817.672016:0:8408:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.111@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1789130817.672041:0:8408:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.111@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1789130817.672048:0:8408:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff91ddfa939c00/0xf3fe2838e1fc1f09 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xf3fe2838e1fc1f10 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130817.672057:0:8408:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff91ddfa939c00/0xf3fe2838e1fc1f09 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xf3fe2838e1fc1f10 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130817.672074:0:8408:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.111@tcp lock: ffff91ddfa939c00/0xf3fe2838e1fc1f09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xf3fe2838e1fc1f10 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130817.672095:0:8408:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789130817.672121:0:8408:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff91ddff4f9000 10000000:01000000:2.0:1789130817.672125:0:8408:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789130817.672139:0:8408:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1789130817.672142:0:8408:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789130817.672146:0:8408:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1789130817.672157:0:8408:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1789130817.672180:0:8408:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff91ddc27e7200/0xf3fe2838e1fc1f17 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130817.672187:0:8408:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff91ddc27e7200/0xf3fe2838e1fc1f17 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130817.672195:0:8408:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff91ddc27e7200/0xf3fe2838e1fc1f17 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130817.672209:0:8408:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc5fe9e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:8408:1876039508708608:0@lo:101: 00000100:00100000:2.0:1789130817.672235:0:8408:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789130817.672321:0:6489:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789130817.672328:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff91ddfa939c00/0xf3fe2838e1fc1f09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xf3fe2838e1fc1f10 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130817.672336:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddfa939c00 already unused, calling callback (ffffffffc124bc20) 10000000:00010000:3.0:1789130817.672340:0:6489:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff91ddfa939c00/0xf3fe2838e1fc1f09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xf3fe2838e1fc1f10 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130817.672348:0:6489:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff91ddfa939c00/0xf3fe2838e1fc1f09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xf3fe2838e1fc1f10 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789130817.672356:0:6489:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff91ddfa939c00/0xf3fe2838e1fc1f09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xf3fe2838e1fc1f10 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789130817.672362:0:6489:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789130817.672381:0:6489:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff91ddfa939c00/0xf3fe2838e1fc1f09 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xf3fe2838e1fc1f10 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130817.672388:0:6489:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789130817.672407:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff91ddfa939c00/0xf3fe2838e1fc1f09 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xf3fe2838e1fc1f10 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130817.672415:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff91ddfa939c00/0xf3fe2838e1fc1f09 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xf3fe2838e1fc1f10 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130817.672428:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130817.672430:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130817.672432:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789130817.672444:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789130817.672485:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff7c0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3626:1876039508708736:0@lo:103: 00000100:00100000:3.0:1789130817.672515:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130817.672546:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508708736 00000100:00100000:3.0:1789130817.672550:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508708736 00000100:00100000:3.0:1789130817.672578:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789130817.672585:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff7c2d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+14:3626:x1876039508708736:12345-0@lo:103: 00010000:00010000:3.0:1789130817.672595:0:6485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789130817.672608:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91ddfa80fa00/0xf3fe2838e1fc1f10 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf3fe2838e1fc1f09 expref: 14 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130817.672622:0:6485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789130817.672650:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff7c2d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+13:3626:x1876039508708736:12345-0@lo:103: Request processed in 65us (134us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130817.672657:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789130817.672685:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff7c0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3626:1876039508708736:0@lo:103: 00000100:00100000:2.0:1789130817.672981:0:8408:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddff9d6b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789130817.673050:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508708608 00000100:00100000:1.0:1789130817.673054:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508708608 00000100:00100000:1.0:1789130817.673086:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789130817.673092:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8604050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+13:8408:x1876039508708608:12345-0@lo:101: 00010000:00010000:1.0:1789130817.673101:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130817.673112:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91dde19aa600/0xf3fe2838e1fc1f1e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3fe2838e1fc1f17 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130817.673232:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91dde19aa600/0xf3fe2838e1fc1f1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3fe2838e1fc1f17 expref: 14 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130817.673253:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91dde19aa600/0xf3fe2838e1fc1f1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc1f17 expref: 14 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130817.673261:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dde19aa600, rc 0) 00000100:00100000:1.0:1789130817.673306:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8604050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+14:8408:x1876039508708608:12345-0@lo:101: Request processed in 214us (1069us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130817.673312:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789130817.673389:0:8408:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc5fe9e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:8408:1876039508708608:0@lo:101: 00010000:00010000:2.0:1789130817.673402:0:8408:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff91ddc27e7200/0xf3fe2838e1fc1f17 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc1f1e expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130817.673410:0:8408:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff91ddc27e7200/0xf3fe2838e1fc1f17 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3fe2838e1fc1f1e expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130817.673510:0:8408:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc5fe9e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:8408:1876039508708864:0@lo:501: 00000100:00100000:2.0:1789130817.673537:0:8408:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130817.673558:0:8408:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddff9d6b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789130817.673668:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508708864 00000100:00100000:1.0:1789130817.673681:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508708864 00000100:00100000:1.0:1789130817.673701:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789130817.673707:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8606850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+14:8408:x1876039508708864:12345-0@lo:501: 00000100:00100000:1.0:1789130817.673812:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8606850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+14:8408:x1876039508708864:12345-0@lo:501: Request processed in 104us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130817.673819:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789130817.673889:0:8408:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc5fe9e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:8408:1876039508708864:0@lo:501: 00000100:00100000:2.0:1789130817.673916:0:8408:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc5fe9e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:8408:1876039508708992:0@lo:503: 00000100:00100000:2.0:1789130817.673957:0:8408:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130817.673988:0:8408:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddff9d6b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789130817.674041:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508708992 00000100:00100000:1.0:1789130817.674046:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508708992 00000100:00100000:1.0:1789130817.674075:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789130817.674082:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8606450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+14:8408:x1876039508708992:12345-0@lo:503: 00000100:00100000:1.0:1789130817.674301:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8606450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+14:8408:x1876039508708992:12345-0@lo:503: Request processed in 218us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130817.674307:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789130817.674474:0:8408:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc5fe9e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:8408:1876039508708992:0@lo:503: 00000040:00080000:2.0:1789130817.674715:0:8408:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789130817.674788:0:8408:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc5fe9e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:8408:1876039508709120:0@lo:502: 00000100:00100000:2.0:1789130817.674823:0:8408:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130817.674848:0:8408:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddff9d6b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789130817.674979:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508709120 00000100:00100000:1.0:1789130817.674984:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508709120 00000100:00100000:1.0:1789130817.675006:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789130817.675012:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8607050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+14:8408:x1876039508709120:12345-0@lo:502: 00000100:00100000:1.0:1789130817.675103:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8607050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+14:8408:x1876039508709120:12345-0@lo:502: Request processed in 90us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130817.675110:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789130817.675311:0:8408:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc5fe9e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:8408:1876039508709120:0@lo:502: 00000040:00080000:2.0:1789130817.675640:0:8408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1789130817.675667:0:8408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1789130817.675682:0:8408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1789130817.675695:0:8408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1789130817.675709:0:8408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1789130817.675721:0:8408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1789130817.675744:0:8408:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc5fe9e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:8408:1876039508709248:0@lo:502: 00000100:00100000:2.0:1789130817.675783:0:8408:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130817.675805:0:8408:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddff9d6b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789130817.675863:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508709248 00000100:00100000:0.0:1789130817.675869:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508709248 00000100:00100000:0.0:1789130817.675905:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789130817.675913:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8605c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+14:8408:x1876039508709248:12345-0@lo:502: 00000100:00100000:0.0:1789130817.675994:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8605c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+14:8408:x1876039508709248:12345-0@lo:502: Request processed in 81us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130817.676001:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789130817.676611:0:8408:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc5fe9e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:8408:1876039508709248:0@lo:502: 00000040:00080000:2.0:1789130817.676670:0:8408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1789130817.676680:0:8408:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:0.0:1789130817.680747:0:8432:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789130817.680759:0:8432:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:0.0:1789130817.680767:0:8432:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789130817.680769:0:8432:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1789130817.680776:0:8432:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789130817.680792:0:8432:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff91ddcf4c4ed8) 00000020:00000080:0.0:1789130817.680835:0:8432:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000080:0.0:1789130817.680843:0:8432:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1789130817.680928:0:8432:0:(tgt_mount.c:153:server_get_mount()) get mount ffff91ddff4f9000 from lustre-OST0000, refs=2 00080000:01000000:0.0:1789130817.680938:0:8432:0:(osd_handler.c:8895:osd_obd_connect()) connect #1 00000020:00000080:0.0:1789130817.680946:0:8432:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xf3fe2838e1fc1f2c 00010000:00010000:0.0:1789130817.692119:0:8432:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:02000400:0.0:1789130817.692568:0:8432:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:0.0:1789130817.695128:0:8432:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1789130817.695974:0:8432:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:0.0:1789130817.700373:0:8432:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:0.0:1789130817.700774:0:8432:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:0.0:1789130817.710923:0:8432:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:0.0:1789130817.712165:0:8432:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1789130817.712177:0:8432:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789130817.712184:0:8432:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789130817.712186:0:8432:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1789130817.712190:0:8432:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789130817.712194:0:8432:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789130817.712195:0:8432:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789130817.712199:0:8432:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789130817.712201:0:8432:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789130817.712218:0:8432:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789130817.712222:0:8432:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789130817.712223:0:8432:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.timeout 00000040:00080000:0.0:1789130817.712226:0:8432:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1789130817.713226:0:8408:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:2.0:1789130817.713271:0:8408:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1789130817.713298:0:8408:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff91ddc27e7200/0xf3fe2838e1fc1f17 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc1f1e expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130817.713311:0:8408:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff91ddc27e7200/0xf3fe2838e1fc1f17 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc1f1e expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789130817.713319:0:8408:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91ddff4f9000 from 1 10000000:01000000:2.0:1789130817.713323:0:8408:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789130817.713357:0:8408:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff91ddc27e7e00/0xf3fe2838e1fc1f33 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130817.713370:0:8408:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff91ddc27e7e00/0xf3fe2838e1fc1f33 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130817.713381:0:8408:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff91ddc27e7e00/0xf3fe2838e1fc1f33 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130817.713410:0:8408:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc5fe9e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:8408:1876039508709376:0@lo:101: 00000100:00100000:2.0:1789130817.713529:0:8408:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130817.713572:0:8408:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddff9d6f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789130817.713922:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508709376 00000100:00100000:0.0:1789130817.713929:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508709376 00000100:00100000:0.0:1789130817.714021:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789130817.714033:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8603850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+14:8408:x1876039508709376:12345-0@lo:101: 00010000:00010000:0.0:1789130817.714047:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130817.714060:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91ddfa80e400/0xf3fe2838e1fc1f3a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3fe2838e1fc1f33 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130817.714086:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91ddfa80e400/0xf3fe2838e1fc1f3a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3fe2838e1fc1f33 expref: 15 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130817.714097:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91ddfa80e400/0xf3fe2838e1fc1f3a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc1f33 expref: 15 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130817.714119:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ddfa80e400, rc 0) 00000100:00100000:0.0:1789130817.714322:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8603850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+15:8408:x1876039508709376:12345-0@lo:101: Request processed in 291us (792us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130817.714330:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789130817.715042:0:8408:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc5fe9e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:8408:1876039508709376:0@lo:101: 00010000:00010000:3.0:1789130817.715192:0:8408:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff91ddc27e7e00/0xf3fe2838e1fc1f33 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc1f3a expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130817.715205:0:8408:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff91ddc27e7e00/0xf3fe2838e1fc1f33 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3fe2838e1fc1f3a expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130817.715319:0:8408:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff7c0780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:8408:1876039508709504:0@lo:501: 00000100:00100000:3.0:1789130817.715360:0:8408:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130817.715402:0:8408:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddc4cfbb40 going to sleep for 11 seconds 00000100:00100000:1.0:1789130817.717801:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508709504 00000100:00100000:1.0:1789130817.717813:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508709504 00000100:00100000:1.0:1789130817.717896:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789130817.717906:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8602c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+15:8408:x1876039508709504:12345-0@lo:501: 00000100:00100000:1.0:1789130817.718059:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8602c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+15:8408:x1876039508709504:12345-0@lo:501: Request processed in 154us (2697us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130817.718067:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789130817.718099:0:8408:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff7c0780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:8408:1876039508709504:0@lo:501: 00000100:00100000:3.0:1789130817.718159:0:8408:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff7c0780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:8408:1876039508709632:0@lo:503: 00000100:00100000:3.0:1789130817.718209:0:8408:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130817.718296:0:8408:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddc4cfbb40 going to sleep for 11 seconds 00000100:00100000:0.0:1789130817.718329:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508709632 00000100:00100000:0.0:1789130817.718334:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508709632 00000100:00100000:0.0:1789130817.718370:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789130817.718377:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8601450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+15:8408:x1876039508709632:12345-0@lo:503: 00000100:00100000:0.0:1789130817.718536:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8601450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+15:8408:x1876039508709632:12345-0@lo:503: Request processed in 158us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130817.718544:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789130817.718711:0:8408:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff7c0780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:8408:1876039508709632:0@lo:503: 00000040:00080000:2.0:1789130817.718996:0:8408:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789130817.719064:0:8408:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc5feb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:8408:1876039508709760:0@lo:502: 00000100:00100000:2.0:1789130817.719104:0:8408:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130817.719170:0:8408:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddff9d63c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789130817.719203:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508709760 00000100:00100000:1.0:1789130817.719207:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508709760 00000100:00100000:1.0:1789130817.719277:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789130817.719285:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8600450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+15:8408:x1876039508709760:12345-0@lo:502: 00000100:00100000:1.0:1789130817.719374:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8600450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+15:8408:x1876039508709760:12345-0@lo:502: Request processed in 89us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130817.719381:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789130817.719443:0:8408:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc5feb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:8408:1876039508709760:0@lo:502: 00000040:00080000:2.0:1789130817.719646:0:8408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1789130817.719671:0:8408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1789130817.719690:0:8408:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc5feb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:8408:1876039508709888:0@lo:502: 00000100:00100000:2.0:1789130817.719724:0:8408:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130817.719972:0:8408:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddff9d63c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789130817.720022:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508709888 00000100:00100000:0.0:1789130817.720027:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508709888 00000100:00100000:0.0:1789130817.720047:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789130817.720053:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8603c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+15:8408:x1876039508709888:12345-0@lo:502: 00000100:00100000:0.0:1789130817.720134:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8603c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+15:8408:x1876039508709888:12345-0@lo:502: Request processed in 80us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130817.720141:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789130817.720207:0:8408:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc5feb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:8408:1876039508709888:0@lo:502: 00000040:00080000:2.0:1789130817.720250:0:8408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1789130817.720257:0:8408:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1789130817.720596:0:8436:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789130817.720604:0:8436:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789130817.720606:0:8436:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789130817.720611:0:8436:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff91ddff4f9000 00000020:00000080:2.0:1789130817.720614:0:8436:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789130817.720629:0:8436:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789130817.720631:0:8436:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789130817.720633:0:8436:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1789130817.720635:0:8436:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1789130817.720729:0:8408:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1789130817.720755:0:8408:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789130817.720775:0:8408:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff91ddc27e7e00/0xf3fe2838e1fc1f33 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc1f3a expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130817.720787:0:8408:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff91ddc27e7e00/0xf3fe2838e1fc1f33 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc1f3a expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789130817.720837:0:8408:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789130817.720846:0:8408:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff91ddff4f9000 10000000:01000000:0.0:1789130817.720849:0:8408:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff91ddff4f9000 10000000:01000000:0.0:1789130817.720854:0:8408:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789130817.720860:0:8408:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff91ddff4f9000 from 1 10000000:01000000:0.0:1789130817.720862:0:8408:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789130817.720888:0:8408:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff91ddfa80fa00/0xf3fe2838e1fc1f41 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130817.720896:0:8408:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff91ddfa80fa00/0xf3fe2838e1fc1f41 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130817.720904:0:8408:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff91ddfa80fa00/0xf3fe2838e1fc1f41 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130817.720918:0:8408:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff751e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:8408:1876039508710016:0@lo:101: 00000100:00100000:0.0:1789130817.720952:0:8408:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130817.720961:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508710016 00000100:00100000:3.0:1789130817.720965:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508710016 00000100:00100000:0.0:1789130817.720975:0:8408:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddc4c51c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789130817.720997:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1789130817.721005:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8601850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+15:8408:x1876039508710016:12345-0@lo:101: 00010000:00010000:3.0:1789130817.721014:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130817.721025:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91ddfa939c00/0xf3fe2838e1fc1f48 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3fe2838e1fc1f41 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130817.721046:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91ddfa939c00/0xf3fe2838e1fc1f48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3fe2838e1fc1f41 expref: 16 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130817.721056:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91ddfa939c00/0xf3fe2838e1fc1f48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc1f41 expref: 16 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130817.721225:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ddfa939c00, rc 0) 00000100:00100000:3.0:1789130817.721276:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8601850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+16:8408:x1876039508710016:12345-0@lo:101: Request processed in 271us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130817.721282:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789130817.721296:0:8408:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff751e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:8408:1876039508710016:0@lo:101: 00010000:00010000:0.0:1789130817.721309:0:8408:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff91ddfa80fa00/0xf3fe2838e1fc1f41 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc1f48 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130817.721318:0:8408:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff91ddfa80fa00/0xf3fe2838e1fc1f41 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3fe2838e1fc1f48 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130817.721399:0:8408:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff751e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:8408:1876039508710144:0@lo:501: 00000100:00100000:0.0:1789130817.721424:0:8408:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130817.721444:0:8408:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddc4c51c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789130817.721518:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508710144 00000100:00100000:1.0:1789130817.721522:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508710144 00000100:00100000:1.0:1789130817.721549:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1789130817.721556:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8600850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+16:8408:x1876039508710144:12345-0@lo:501: 00000100:00100000:1.0:1789130817.721631:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8600850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+16:8408:x1876039508710144:12345-0@lo:501: Request processed in 75us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130817.721637:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789130817.721708:0:8408:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff751e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:8408:1876039508710144:0@lo:501: 00000100:00100000:2.0:1789130817.721730:0:8408:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc5feb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:8408:1876039508710272:0@lo:503: 00000100:00100000:2.0:1789130817.721760:0:8408:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130817.721781:0:8408:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddff9d69c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789130817.721816:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508710272 00000100:00100000:0.0:1789130817.721820:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508710272 00000100:00100000:0.0:1789130817.721838:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789130817.721850:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8600050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+16:8408:x1876039508710272:12345-0@lo:503: 00000100:00100000:0.0:1789130817.721929:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8600050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+16:8408:x1876039508710272:12345-0@lo:503: Request processed in 79us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130817.721935:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789130817.722026:0:8408:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc5feb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:8408:1876039508710272:0@lo:503: 00000040:00080000:2.0:1789130817.722236:0:8408:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789130817.722294:0:8408:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc5feb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:8408:1876039508710400:0@lo:502: 00000100:00100000:2.0:1789130817.722324:0:8408:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130817.722370:0:8408:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddff9d6600 going to sleep for 11 seconds 00000100:00100000:0.0:1789130817.722398:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508710400 00000100:00100000:0.0:1789130817.722401:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508710400 00000100:00100000:0.0:1789130817.722455:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789130817.722482:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8602850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+16:8408:x1876039508710400:12345-0@lo:502: 00000100:00100000:0.0:1789130817.722553:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8602850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+16:8408:x1876039508710400:12345-0@lo:502: Request processed in 71us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130817.722559:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1789130817.722636:0:8408:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc5feb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:8408:1876039508710400:0@lo:502: 00000040:00080000:2.0:1789130817.722785:0:8408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1789130817.722807:0:8408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1789130817.722819:0:8408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1789130817.722829:0:8408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1789130817.722840:0:8408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1789130817.722850:0:8408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1789130817.722860:0:8408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1789130817.722871:0:8408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1789130817.722882:0:8408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1789130817.722894:0:8408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1789130817.722906:0:8408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1789130817.722918:0:8408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1789130817.722932:0:8408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1789130817.722946:0:8408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1789130817.722957:0:8408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1789130817.722976:0:8408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1789130817.722987:0:8408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1789130817.722998:0:8408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1789130817.723008:0:8408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1789130817.723018:0:8408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1789130817.723029:0:8408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1789130817.723039:0:8408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1789130817.723049:0:8408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1789130817.723060:0:8408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1789130817.723073:0:8408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:2.0:1789130817.723084:0:8408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:2.0:1789130817.723095:0:8408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:2.0:1789130817.723115:0:8408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:2.0:1789130817.723126:0:8408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:2.0:1789130817.723139:0:8408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:2.0:1789130817.723152:0:8408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:2.0:1789130817.723163:0:8408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:2.0:1789130817.723175:0:8408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:2.0:1789130817.723188:0:8408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:2.0:1789130817.723202:0:8408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:2.0:1789130817.723213:0:8408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:2.0:1789130817.723225:0:8408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000100:00100000:2.0:1789130817.723259:0:8408:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc5feb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:8408:1876039508710528:0@lo:502: 00000100:00100000:2.0:1789130817.723297:0:8408:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130817.726878:0:8408:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddff9d6600 going to sleep for 11 seconds 00000100:00100000:1.0:1789130817.726938:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508710528 00000100:00100000:1.0:1789130817.726948:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508710528 00000100:00100000:1.0:1789130817.727006:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789130817.727017:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8602450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+16:8408:x1876039508710528:12345-0@lo:502: 00000100:00100000:1.0:1789130817.729812:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8602450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+16:8408:x1876039508710528:12345-0@lo:502: Request processed in 2789us (6506us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130817.729826:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1789130817.729962:0:8408:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc5feb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:8408:1876039508710528:0@lo:502: 00000040:00080000:0.0:1789130817.730052:0:8408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:0.0:1789130817.730065:0:8408:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:0.0:1789130817.730630:0:8437:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1789130817.730646:0:8437:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff91ddcf4c1a48) 00000020:00000080:0.0:1789130817.730667:0:8437:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:0.0:1789130817.730738:0:8437:0:(tgt_mount.c:153:server_get_mount()) get mount ffff91ddff4f9000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789130817.730742:0:8437:0:(tgt_mount.c:187:server_put_mount()) put mount ffff91ddff4f9000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789130817.730744:0:8437:0:(obd_mount.c:710:lustre_put_lsi()) put ffff91ddff4f9000 3 00010000:00080000:0.0:1789130817.730775:0:8437:0:(ldlm_lib.c:102:import_set_conn()) imp ffff91ddfce36800@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.111@tcp at head 00010000:00010000:0.0:1789130817.732361:0:8437:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-5 is initialized 00000020:00000080:0.0:1789130817.732583:0:8437:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1789130817.732621:0:8437:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789130817.732633:0:8437:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xf3fe2838e1fc1f56 00000100:00080000:0.0:1789130817.732642:0:8437:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789130817.732647:0:8437:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff91ddfce36800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:0.0:1789130817.732681:0:8437:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91ddff752d00 x1876039508710656/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789130817.732706:0:8437:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1789130817.735654:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff752d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3624:1876039508710656:0@lo:38: 00000100:00100000:1.0:1789130817.735726:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130817.735781:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508710656 00000100:00100000:1.0:1789130817.735787:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508710656 00000100:00100000:1.0:1789130817.735819:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789130817.735826:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddca0f9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3624:x1876039508710656:12345-0@lo:38: 00010000:00080000:1.0:1789130817.735861:0:6502:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 173 last 0 00000020:00000080:1.0:1789130817.735898:0:6502:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xf3fe2838e1fc1f5d 00000004:00100000:1.0:1789130817.735914:0:6502:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789130817.735947:0:6502:0:(import.c:65:import_set_state_nolock()) ffff91dcc1ee7800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789130817.735996:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddca0f9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1876039508710656:12345-0@lo:38: Request processed in 168us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130817.736003:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1789130817.736040:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91ddff752d00 x1876039508710656/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789130827 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789130817.736051:0:3624:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789130817.736058:0:3624:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:1.0:1789130817.736065:0:3624:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1789130817.736070:0:3624:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789130817.736072:0:3624:0:(import.c:65:import_set_state_nolock()) ffff91ddfce36800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789130817.736077:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff752d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3624:1876039508710656:0@lo:38: 00000020:01000004:1.0:1789130817.736213:0:8437:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1789130817.736226:0:8437:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff91ddcf698000) 00000020:00000080:1.0:1789130817.736252:0:8437:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:01000004:1.0:1789130817.736328:0:8437:0:(tgt_mount.c:153:server_get_mount()) get mount ffff91ddff4f9000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1789130817.736332:0:8437:0:(tgt_mount.c:187:server_put_mount()) put mount ffff91ddff4f9000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1789130817.736334:0:8437:0:(obd_mount.c:710:lustre_put_lsi()) put ffff91ddff4f9000 3 00010000:00080000:1.0:1789130817.736359:0:8437:0:(ldlm_lib.c:102:import_set_conn()) imp ffff91dcc1ee2800@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.111@tcp at head 00010000:00010000:1.0:1789130817.740954:0:8437:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-6 is initialized 00000020:00000080:1.0:1789130817.748776:0:8437:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:1.0:1789130817.748826:0:8437:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789130817.748839:0:8437:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xf3fe2838e1fc1f6b 00000100:00080000:1.0:1789130817.748849:0:8437:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789130817.748864:0:8437:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff91dcc1ee2800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:1.0:1789130817.748902:0:8437:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91ddca0f8780 x1876039508710784/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789130817.748930:0:8437:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1789130817.748995:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddca0f8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3624:1876039508710784:0@lo:38: 00000100:00100000:2.0:1789130817.749067:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130817.749331:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508710784 00000100:00100000:1.0:1789130817.749339:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508710784 00000100:00100000:1.0:1789130817.749376:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789130817.749383:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc5fe8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3624:x1876039508710784:12345-0@lo:38: 00010000:00080000:1.0:1789130817.749407:0:6500:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 173 last 0 00000020:00000080:1.0:1789130817.749437:0:6500:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xf3fe2838e1fc1f72 00000004:00100000:1.0:1789130817.749452:0:6500:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789130817.749511:0:6500:0:(import.c:65:import_set_state_nolock()) ffff91dcc1ee4000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789130817.749563:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc5fe8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1876039508710784:12345-0@lo:38: Request processed in 178us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130817.749571:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1789130817.749609:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91ddca0f8780 x1876039508710784/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789130827 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789130817.749632:0:3624:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789130817.749641:0:3624:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 1 00000100:00080000:1.0:1789130817.749648:0:3624:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1789130817.749652:0:3624:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1789130817.749654:0:3624:0:(import.c:65:import_set_state_nolock()) ffff91dcc1ee2800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789130817.749659:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddca0f8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3624:1876039508710784:0@lo:38: 00000040:00080000:0.0:1789130817.752060:0:8437:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:2.0:1789130817.753818:0:8408:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:2.0:1789130817.753864:0:8408:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789130817.753882:0:8408:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff91ddfa80fa00/0xf3fe2838e1fc1f41 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc1f48 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130817.753909:0:8408:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff91ddfa80fa00/0xf3fe2838e1fc1f41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc1f48 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789130817.753964:0:8408:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789130817.753966:0:8408:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789130817.753968:0:8408:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789130817.753969:0:8408:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789130817.753970:0:8408:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789130817.753972:0:8408:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789130817.753974:0:8408:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789130817.753975:0:8408:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789130817.753977:0:8408:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789130817.753979:0:8408:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789130817.753980:0:8408:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789130817.753984:0:8408:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:2.0:1789130817.753986:0:8408:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789130817.753987:0:8408:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789130817.753988:0:8408:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789130817.753989:0:8408:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789130817.753991:0:8408:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789130817.753992:0:8408:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789130817.753993:0:8408:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789130817.753994:0:8408:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789130817.753995:0:8408:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789130817.753996:0:8408:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789130817.753997:0:8408:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789130817.754024:0:8408:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1789130817.754043:0:8408:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc5fe8f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:8408:1876039508710912:0@lo:253: 00000100:00100000:2.0:1789130817.754111:0:8408:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130817.754148:0:8408:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddff9d63c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789130817.754258:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508710912 00000100:00100000:3.0:1789130817.754265:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508710912 00000100:00100000:3.0:1789130817.754310:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789130817.754319:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8603050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+16:8408:x1876039508710912:12345-0@lo:253: 20000000:01000000:3.0:1789130817.754345:0:6493:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1789130817.754364:0:6493:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1789130817.762635:0:6493:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789130817.762652:0:6493:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1789130817.763107:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8603050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+16:8408:x1876039508710912:12345-0@lo:253: Request processed in 8784us (8990us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130817.763120:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 20000000:01000000:1.0:1789130817.763704:0:6516:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1789130817.763710:0:6516:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1789130817.763731:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91dde19aa800/0xf3fe2838e1fc1f79 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130817.763758:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91ddc0030200/0xf3fe2838e1fc1e6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc1e68 expref: 15 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130817.763766:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91ddfa80e000/0xf3fe2838e1fc1e8b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc1e84 expref: 15 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130817.763773:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91dde19aa800/0xf3fe2838e1fc1f79 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130817.763822:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91ddfa80e000/0xf3fe2838e1fc1e8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf3fe2838e1fc1e84 expref: 15 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130817.763836:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91ddfa80e000/0xf3fe2838e1fc1e8b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf3fe2838e1fc1e84 expref: 15 pid: 6493 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130817.763850:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddca0f8780 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6516:1876039508711040:0@lo:104: 00000100:00100000:1.0:1789130817.763904:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789130817.763945:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91ddc0030200/0xf3fe2838e1fc1e6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf3fe2838e1fc1e68 expref: 15 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130817.763954:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91ddc0030200/0xf3fe2838e1fc1e6f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf3fe2838e1fc1e68 expref: 15 pid: 6494 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130817.763963:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddca0f92c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6516:1876039508711168:0@lo:104: 00000100:00100000:1.0:1789130817.763980:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddd2f29180 going to sleep for 11 seconds 00000100:00100000:0.0:1789130817.765009:0:6483:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1789130817.765037:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130817.765070:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508711040 00000100:00100000:0.0:1789130817.765076:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508711040 00000100:00100000:0.0:1789130817.765107:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508711168 00000100:00100000:0.0:1789130817.765110:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508711168 00000100:00100000:0.0:1789130817.765122:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789130817.765129:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddfcdf4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+4:6516:x1876039508711040:12345-0@lo:104: 00010000:00010000:0.0:1789130817.765145:0:6483:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff91ddc0030600/0xf3fe2838e1fc1e84 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3fe2838e1fc1e8b expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130817.765202:0:6483:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789130817.765208:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddfcdf4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+4:6516:x1876039508711040:12345-0@lo:104: Request processed in 80us (1305us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130817.765215:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789130817.765265:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789130817.765272:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff753c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+3:6516:x1876039508711168:12345-0@lo:104: 00010000:00010000:0.0:1789130817.765279:0:6483:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff91ddc0031400/0xf3fe2838e1fc1e68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3fe2838e1fc1e6f expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130817.765311:0:6483:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789130817.765315:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff753c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+3:6516:x1876039508711168:12345-0@lo:104: Request processed in 45us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130817.765320:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:0.0:1789130817.765336:0:6488:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789130817.765352:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff91ddc0030600/0xf3fe2838e1fc1e84 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3fe2838e1fc1e8b expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130817.765359:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddc0030600 already unused, calling callback (ffffffffc124bc20) 10000000:00010000:0.0:1789130817.765363:0:6488:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff91ddc0030600/0xf3fe2838e1fc1e84 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf3fe2838e1fc1e8b expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130817.765371:0:6488:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff91ddc0030600/0xf3fe2838e1fc1e84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf3fe2838e1fc1e8b expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789130817.765377:0:6488:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff91ddc0030600/0xf3fe2838e1fc1e84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf3fe2838e1fc1e8b expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789130817.765382:0:6488:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789130817.765412:0:6488:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff91ddc0030600/0xf3fe2838e1fc1e84 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc1e8b expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130817.765418:0:6488:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789130817.765432:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff91ddc0030600/0xf3fe2838e1fc1e84 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc1e8b expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130817.765438:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff91ddc0030600/0xf3fe2838e1fc1e84 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc1e8b expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130817.765451:0:6488:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789130817.765454:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff91ddc0031400/0xf3fe2838e1fc1e68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3fe2838e1fc1e6f expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130817.765484:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddc0031400 already unused, calling callback (ffffffffc124bc20) 10000000:00010000:0.0:1789130817.765487:0:6488:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff91ddc0031400/0xf3fe2838e1fc1e68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf3fe2838e1fc1e6f expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130817.765503:0:6488:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff91ddc0031400/0xf3fe2838e1fc1e68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf3fe2838e1fc1e6f expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789130817.765508:0:6488:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff91ddc0031400/0xf3fe2838e1fc1e68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf3fe2838e1fc1e6f expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789130817.765513:0:6488:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789130817.765526:0:6488:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff91ddc0031400/0xf3fe2838e1fc1e68 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc1e6f expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130817.765532:0:6488:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789130817.765545:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff91ddc0031400/0xf3fe2838e1fc1e68 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc1e6f expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130817.765551:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff91ddc0031400/0xf3fe2838e1fc1e68 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc1e6f expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130817.765566:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130817.765568:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130817.765569:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130817.765573:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789130817.765580:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789130817.765583:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff751a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3626:1876039508711296:0@lo:103: 00000100:00100000:0.0:1789130817.765587:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff7530c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3628:1876039508711424:0@lo:103: 00000100:00100000:0.0:1789130817.765617:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130817.765652:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508711424 00000100:00100000:3.0:1789130817.765656:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508711424 00010000:00010000:3.0:1789130817.765674:0:6486:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91ddc0030200/0xf3fe2838e1fc1e6f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3fe2838e1fc1e68 expref: 16 pid: 6494 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130817.765705:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789130817.765712:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff752580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+16:3628:x1876039508711424:12345-0@lo:103: 00010000:00010000:3.0:1789130817.765723:0:6486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789130817.765727:0:6486:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91ddc0030200/0xf3fe2838e1fc1e6f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3fe2838e1fc1e68 expref: 16 pid: 6494 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130817.765736:0:6486:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91ddc0030200/0xf3fe2838e1fc1e6f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf3fe2838e1fc1e68 expref: 16 pid: 6494 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130817.765752:0:6486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789130817.765784:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff752580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+16:3628:x1876039508711424:12345-0@lo:103: Request processed in 72us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130817.765789:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789130817.765808:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130817.765833:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508711296 00000100:00100000:3.0:1789130817.765836:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508711296 00010000:00010000:3.0:1789130817.765849:0:6485:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91ddfa80e000/0xf3fe2838e1fc1e8b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3fe2838e1fc1e84 expref: 16 pid: 6493 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130817.765887:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789130817.765894:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff7c0780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+16:3626:x1876039508711296:12345-0@lo:103: 00010000:00010000:3.0:1789130817.765901:0:6485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789130817.765905:0:6485:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91ddfa80e000/0xf3fe2838e1fc1e8b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3fe2838e1fc1e84 expref: 16 pid: 6493 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130817.765913:0:6485:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91ddfa80e000/0xf3fe2838e1fc1e8b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf3fe2838e1fc1e84 expref: 16 pid: 6493 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130817.765923:0:6485:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91dde19aa800/0xf3fe2838e1fc1f79 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130817.765930:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91dde19aa800/0xf3fe2838e1fc1f79 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789130817.765944:0:6485:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.008781586s 00010000:00010000:3.0:1789130817.765948:0:6485:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91dde19aa800/0xf3fe2838e1fc1f79 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130817.765954:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91dde19aa800/0xf3fe2838e1fc1f79 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130817.765961:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91dde19aa800/0xf3fe2838e1fc1f79 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130817.765966:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91dde19aa800/0xf3fe2838e1fc1f79 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130817.765970:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dde19aa800 already unused, calling callback (ffffffffc0c4e550) 00010000:00010000:3.0:1789130817.765974:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91dde19aa800/0xf3fe2838e1fc1f79 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130817.765986:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91dde19aa800/0xf3fe2838e1fc1f79 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130817.765994:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91dde19aa800/0xf3fe2838e1fc1f79 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130817.766003:0:6485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789130817.766031:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff7c0780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+16:3626:x1876039508711296:12345-0@lo:103: Request processed in 138us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130817.766037:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789130817.766067:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff751a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3626:1876039508711296:0@lo:103: 00000100:00100000:3.0:1789130817.766089:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff7530c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3628:1876039508711424:0@lo:103: 00010000:00010000:1.0:1789130817.766172:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91ddfa80e000/0xf3fe2838e1fc1e8b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf3fe2838e1fc1e84 expref: 15 pid: 6493 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130817.766185:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddca0f8780 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6516:1876039508711040:0@lo:104: 00010000:00010000:1.0:1789130817.766205:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91ddc0030200/0xf3fe2838e1fc1e6f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf3fe2838e1fc1e68 expref: 14 pid: 6494 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130817.766213:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddca0f92c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6516:1876039508711168:0@lo:104: 00010000:00010000:1.0:1789130817.766227:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91dde19aa800/0xf3fe2838e1fc1f79 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130817.766234:0:6516:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91dde19aa800/0xf3fe2838e1fc1f79 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130817.766250:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91dde19aa800/0xf3fe2838e1fc1f79 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130817.766257:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91dde19aa800/0xf3fe2838e1fc1f79 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130817.768641:0:8408:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc5fe8f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:8408:1876039508710912:0@lo:253: 10000000:01000000:2.0:1789130817.768661:0:8408:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1789130817.768665:0:8408:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789130817.768667:0:8408:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789130817.768682:0:8408:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789130817.768684:0:8408:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789130817.768685:0:8408:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789130817.768687:0:8408:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789130817.768689:0:8408:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789130817.768691:0:8408:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789130817.768692:0:8408:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789130817.768694:0:8408:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789130817.768695:0:8408:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789130817.768713:0:8408:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1789130817.780855:0:8408:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:2.0:1789130817.781007:0:8408:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1789130817.781202:0:8408:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:2.0:1789130817.781376:0:8408:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1789130817.781657:0:8408:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:10000000:2.0:1789130817.781786:0:8408:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:1.0:1789130817.787132:0:8408:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1789130817.802753:0:8408:0:(ofd_obd.c:543:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1789130817.802767:0:8408:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1789130817.802944:0:8408:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1789130817.803074:0:8408:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.111@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1789130817.803168:0:8408:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1789130817.803202:0:8408:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:1.0:1789130817.804633:0:8408:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789130817.804835:0:8408:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:1.0:1789130818.449886:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789130818.670422:0:8493:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789130818.671163:0:8493:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789130819.473692:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130820.497618:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130821.528994:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789130822.226691:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789130822.226740:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc5fea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508711552:0@lo:41: 00000100:00100000:2.0:1789130822.226802:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130822.226860:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc5fe9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508711680:0@lo:41: 00000100:00100000:2.0:1789130822.226881:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130822.226916:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508711552 00000100:00100000:2.0:1789130822.226922:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508711552 00000100:00100000:2.0:1789130822.226952:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508711680 00000100:00100000:2.0:1789130822.226955:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508711680 00000100:00100000:2.0:1789130822.226968:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789130822.226975:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc5feb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508711552:12345-0@lo:41: 00000004:00000024:2.0:1789130822.227006:0:6505:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446416384 avail 1300176896 00000100:00100000:2.0:1789130822.227073:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc5feb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508711552:12345-0@lo:41: Request processed in 98us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130822.227081:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789130822.227105:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789130822.227111:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc5fea940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1876039508711680:12345-0@lo:41: 00000004:00000024:2.0:1789130822.227125:0:6505:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:2.0:1789130822.228425:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc5fea940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1876039508711680:12345-0@lo:41: Request processed in 1306us (1535us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130822.228436:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789130822.228522:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc5fe9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508711680:0@lo:41: 00000100:00100000:2.0:1789130822.228552:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc5fea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508711552:0@lo:41: 00010000:00010000:2.0:1789130822.549510:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789130823.252072:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789130823.252100:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddca229e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3625:1876039508712192:0@lo:400: 00000100:00100000:1.0:1789130823.252132:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddca229a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508712320:0@lo:400: 00000100:00100000:2.0:1789130823.252169:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130823.252176:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130823.252231:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddca0f8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3625:1876039508711808:0@lo:400: 00000100:00100000:2.0:1789130823.252262:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130823.253529:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508712192 00000100:00100000:0.0:1789130823.253540:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508712192 00000100:00100000:0.0:1789130823.253591:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789130823.253601:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc5fea580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1876039508712192:12345-0@lo:400: 00000100:00100000:1.0:1789130823.253616:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508712320 00000100:00100000:1.0:1789130823.253622:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508712320 00000100:00100000:1.0:1789130823.253674:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789130823.253683:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc6bef0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508712320:12345-0@lo:400: 00000100:00100000:0.0:1789130823.253692:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc5fea580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1876039508712192:12345-0@lo:400: Request processed in 91us (1522us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130823.253701:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789130823.253731:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc6bef0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508712320:12345-0@lo:400: Request processed in 49us (1555us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130823.253737:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789130823.253746:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddca0fbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1876039508712064:0@lo:400: 00000100:00100000:1.0:1789130823.253761:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508711808 00000100:00100000:1.0:1789130823.253765:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508711808 00000100:00100000:0.0:1789130823.253783:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130823.253799:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1789130823.253808:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8601c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+14:3625:x1876039508711808:12345-0@lo:400: 00000100:00100000:0.0:1789130823.253810:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc6beda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3628:1876039508712576:0@lo:400: 00000100:00100000:1.0:1789130823.253848:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8601c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+14:3625:x1876039508711808:12345-0@lo:400: Request processed in 41us (1584us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130823.253853:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130823.253860:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1789130823.253882:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1789130823.253891:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508712064 00000100:00100000:0.0:1789130823.253891:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddca0f92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3628:1876039508711936:0@lo:400: 00000100:00100000:1.0:1789130823.253896:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508712064 00000100:00100000:1.0:1789130823.253916:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789130823.253921:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130823.253925:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff7530c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3628:x1876039508712064:12345-0@lo:400: 00000100:00100000:0.0:1789130823.253942:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc6bee580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3628:1876039508712448:0@lo:400: 00000100:00100000:1.0:1789130823.253960:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff7530c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3628:x1876039508712064:12345-0@lo:400: Request processed in 37us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130823.253968:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789130823.253975:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130823.254006:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddca0fbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1876039508712064:0@lo:400: 00000100:00100000:1.0:1789130823.254007:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddca229a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508712320:0@lo:400: 00000100:00100000:0.0:1789130823.254043:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508712576 00000100:00100000:0.0:1789130823.254047:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508712576 00000100:00100000:0.0:1789130823.254085:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508711936 00000100:00100000:0.0:1789130823.254089:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508711936 00000100:00100000:0.0:1789130823.254098:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508712448 00000100:00100000:0.0:1789130823.254101:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508712448 00000100:00100000:0.0:1789130823.254113:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789130823.254119:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff751a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3628:x1876039508712576:12345-0@lo:400: 00000100:00100000:0.0:1789130823.254154:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff751a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3628:x1876039508712576:12345-0@lo:400: Request processed in 35us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130823.254161:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789130823.254172:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789130823.254177:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff752d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1876039508711936:12345-0@lo:400: 00000100:00100000:0.0:1789130823.254229:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff752d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1876039508711936:12345-0@lo:400: Request processed in 52us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130823.254235:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789130823.254246:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789130823.254252:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff751e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3628:x1876039508712448:12345-0@lo:400: 00000100:00100000:0.0:1789130823.254278:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff751e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3628:x1876039508712448:12345-0@lo:400: Request processed in 26us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130823.254283:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:0.0:1789130823.254310:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91ddca229e00 x1876039508712192/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130839 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789130823.254321:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddca229e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3625:1876039508712192:0@lo:400: 00000100:00100000:0.0:1789130823.254331:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddca0f8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3625:1876039508711808:0@lo:400: 00010000:00080000:0.0:1789130823.254356:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91ddca0f92c0 x1876039508711936/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130839 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789130823.254364:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddca0f92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3628:1876039508711936:0@lo:400: 00010000:00080000:0.0:1789130823.254373:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91dcc6bee580 x1876039508712448/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130839 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789130823.254381:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc6bee580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3628:1876039508712448:0@lo:400: 00010000:00080000:0.0:1789130823.254389:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91dcc6beda40 x1876039508712576/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130839 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789130823.254396:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc6beda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3628:1876039508712576:0@lo:400: 00000100:00080000:1.0:1789130823.254844:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789130823.254850:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1789130823.569638:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789130823.577948:0:8783:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg311-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000020:00000004:1.0:1789130824.439120:0:8835:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789130824.439357:0:8835:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789130824.593676:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789130824.786919:0:6497:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789130824.786926:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff91ddfce33000 from 30 10000000:01000000:3.0:1789130824.786931:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789130824.786978:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff91ddfa939600/0xf3fe2838e1fc1f80 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130824.786990:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff91ddfa939600/0xf3fe2838e1fc1f80 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130824.787002:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff91ddfa939600/0xf3fe2838e1fc1f80 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130824.787027:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff7c0f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508712704:0@lo:101: 00000100:00100000:3.0:1789130824.787099:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130824.787174:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddfcfc26c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789130824.787340:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508712704 00000100:00100000:0.0:1789130824.787355:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508712704 00000100:00100000:0.0:1789130824.787419:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1789130824.787429:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8602050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+14:6497:x1876039508712704:12345-0@lo:101: 00010000:00010000:0.0:1789130824.787442:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130824.787455:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91ddfa80e800/0xf3fe2838e1fc1f87 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3fe2838e1fc1f80 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130824.787509:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91ddfa80e800/0xf3fe2838e1fc1f87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3fe2838e1fc1f80 expref: 15 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130824.787520:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91ddfa80e800/0xf3fe2838e1fc1f87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc1f80 expref: 15 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130824.787530:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ddfa80e800, rc 0) 00000100:00100000:0.0:1789130824.787581:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8602050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+15:6497:x1876039508712704:12345-0@lo:101: Request processed in 152us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130824.787588:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789130824.788031:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff7c0f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508712704:0@lo:101: 00010000:00010000:3.0:1789130824.788048:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff91ddfa939600/0xf3fe2838e1fc1f80 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc1f87 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130824.788058:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff91ddfa939600/0xf3fe2838e1fc1f80 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3fe2838e1fc1f87 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130824.788119:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff7c0f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508712832:0@lo:501: 00000100:00100000:3.0:1789130824.788150:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130824.788183:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddfcfc26c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789130824.788876:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508712832 00000100:00100000:0.0:1789130824.788883:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508712832 00000100:00100000:0.0:1789130824.788929:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1789130824.788937:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8600c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+15:6497:x1876039508712832:12345-0@lo:501: 00000100:00100000:0.0:1789130824.789081:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8600c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+15:6497:x1876039508712832:12345-0@lo:501: Request processed in 144us (929us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130824.789089:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789130824.789184:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff7c0f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508712832:0@lo:501: 00000100:00100000:2.0:1789130824.789240:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc5fe9a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508712960:0@lo:503: 00000100:00100000:2.0:1789130824.789287:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130824.789321:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddf5cf19c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789130824.789386:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508712960 00000100:00100000:1.0:1789130824.789391:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508712960 00000100:00100000:1.0:1789130824.789431:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789130824.789448:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8601050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+15:6497:x1876039508712960:12345-0@lo:503: 00000100:00100000:1.0:1789130824.789596:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8601050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+15:6497:x1876039508712960:12345-0@lo:503: Request processed in 150us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130824.789602:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789130824.789759:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc5fe9a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508712960:0@lo:503: 00000100:00100000:3.0:1789130824.790507:0:8855:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff7c1680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:8855:1876039508713088:0@lo:502: 00000100:00100000:3.0:1789130824.790553:0:8855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130824.790586:0:8855:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddfcfc2480 going to sleep for 11 seconds 00000100:00100000:1.0:1789130824.790699:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508713088 00000100:00100000:1.0:1789130824.790704:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508713088 00000100:00100000:1.0:1789130824.790740:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789130824.790747:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8603450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+15:8855:x1876039508713088:12345-0@lo:502: 00000100:00100000:1.0:1789130824.790843:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8603450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+15:8855:x1876039508713088:12345-0@lo:502: Request processed in 95us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130824.790850:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789130824.790934:0:8855:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff7c1680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:8855:1876039508713088:0@lo:502: 00000100:00100000:0.0:1789130824.790978:0:8855:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff753840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:8855:1876039508713216:0@lo:502: 00000100:00100000:0.0:1789130824.791013:0:8855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130824.791038:0:8855:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddff84c600 going to sleep for 11 seconds 00000100:00100000:1.0:1789130824.791323:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508713216 00000100:00100000:1.0:1789130824.791328:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508713216 00000100:00100000:1.0:1789130824.791359:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789130824.791366:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddf5cc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+15:8855:x1876039508713216:12345-0@lo:502: 00000100:00100000:1.0:1789130824.791515:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddf5cc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+15:8855:x1876039508713216:12345-0@lo:502: Request processed in 148us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130824.791522:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1789130824.792553:0:8855:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff753840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:8855:1876039508713216:0@lo:502: 00000040:00080000:2.0:1789130824.792599:0:8855:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1789130824.794778:0:6497:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1789130824.794817:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789130824.794829:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff91ddfa939600/0xf3fe2838e1fc1f80 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc1f87 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130824.794841:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff91ddfa939600/0xf3fe2838e1fc1f80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc1f87 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789130824.794945:0:6497:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789130824.794949:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff91ddfce33000 from 5 10000000:01000000:2.0:1789130824.794965:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789130824.795004:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff91ddc27e7600/0xf3fe2838e1fc1f8e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130824.795012:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff91ddc27e7600/0xf3fe2838e1fc1f8e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130824.795022:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff91ddc27e7600/0xf3fe2838e1fc1f8e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130824.795045:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc5fe9a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508713344:0@lo:101: 00000100:00100000:2.0:1789130824.795106:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130824.795152:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddf5cf19c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789130824.795978:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508713344 00000100:00100000:1.0:1789130824.795987:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508713344 00000100:00100000:1.0:1789130824.796033:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789130824.796044:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddf5cc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+15:6497:x1876039508713344:12345-0@lo:101: 00010000:00010000:1.0:1789130824.796056:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130824.796070:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91dde19ab400/0xf3fe2838e1fc1f95 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3fe2838e1fc1f8e expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130824.796092:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91dde19ab400/0xf3fe2838e1fc1f95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3fe2838e1fc1f8e expref: 16 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130824.796110:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91dde19ab400/0xf3fe2838e1fc1f95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc1f8e expref: 16 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130824.796119:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dde19ab400, rc 0) 00000100:00100000:1.0:1789130824.796397:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddf5cc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+16:6497:x1876039508713344:12345-0@lo:101: Request processed in 354us (1290us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130824.796412:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1789130824.797098:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc5fe9a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508713344:0@lo:101: 00010000:00010000:2.0:1789130824.797116:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff91ddc27e7600/0xf3fe2838e1fc1f8e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc1f95 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130824.797126:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff91ddc27e7600/0xf3fe2838e1fc1f8e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3fe2838e1fc1f95 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130824.797184:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc5fe9a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508713472:0@lo:256: 00000100:00100000:2.0:1789130824.797666:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130824.797703:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddf5cf19c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789130824.797802:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508713472 00000100:00100000:3.0:1789130824.797808:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508713472 00000100:00100000:3.0:1789130824.797852:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1789130824.797860:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddf5cc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+16:6497:x1876039508713472:12345-0@lo:256: 20000000:01000000:3.0:1789130824.797876:0:6493:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789130824.797892:0:6493:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789130824.797895:0:6493:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:3.0:1789130824.797985:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddf5cc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+16:6497:x1876039508713472:12345-0@lo:256: Request processed in 125us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130824.797992:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789130824.798115:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc5fe9a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508713472:0@lo:256: 10000000:01000000:1.0:1789130824.798169:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789130824.798177:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff91ddc27e7600/0xf3fe2838e1fc1f8e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc1f95 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130824.798185:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff91ddc27e7600/0xf3fe2838e1fc1f8e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc1f95 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789130824.798203:0:6497:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1789130824.798214:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 25 10000000:01000000:1.0:1789130824.798217:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1789130824.798239:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff91dde19aba00/0xf3fe2838e1fc1f9c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130824.798247:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff91dde19aba00/0xf3fe2838e1fc1f9c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130824.798255:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff91dde19aba00/0xf3fe2838e1fc1f9c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130824.798268:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc6bec000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508713600:0@lo:101: 00000100:00100000:1.0:1789130824.798303:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130824.798372:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddc302a000 going to sleep for 11 seconds 00000100:00100000:0.0:1789130824.799142:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508713600 00000100:00100000:0.0:1789130824.799150:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508713600 00000100:00100000:0.0:1789130824.799202:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789130824.799218:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddf5cc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+16:6497:x1876039508713600:12345-0@lo:101: 00010000:00010000:0.0:1789130824.799228:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130824.799243:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91ddfa80ee00/0xf3fe2838e1fc1fa3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3fe2838e1fc1f9c expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130824.799262:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91ddfa80ee00/0xf3fe2838e1fc1fa3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3fe2838e1fc1f9c expref: 17 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130824.799273:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91ddfa80ee00/0xf3fe2838e1fc1fa3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc1f9c expref: 17 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130824.799281:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ddfa80ee00, rc 0) 00000100:00100000:0.0:1789130824.799332:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddf5cc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+17:6497:x1876039508713600:12345-0@lo:101: Request processed in 115us (1028us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130824.799339:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789130824.799488:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc6bec000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508713600:0@lo:101: 00010000:00010000:1.0:1789130824.799503:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff91dde19aba00/0xf3fe2838e1fc1f9c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc1fa3 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130824.799512:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff91dde19aba00/0xf3fe2838e1fc1f9c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3fe2838e1fc1fa3 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130824.799570:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc6bec000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508713728:0@lo:501: 00000100:00100000:1.0:1789130824.799600:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130824.799630:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddc302a000 going to sleep for 11 seconds 00000100:00100000:0.0:1789130824.799687:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508713728 00000100:00100000:0.0:1789130824.799691:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508713728 00000100:00100000:0.0:1789130824.799722:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789130824.799728:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddf5cc6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+17:6497:x1876039508713728:12345-0@lo:501: 00000100:00100000:0.0:1789130824.799838:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddf5cc6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+17:6497:x1876039508713728:12345-0@lo:501: Request processed in 109us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130824.799845:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789130824.799969:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc6bec000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508713728:0@lo:501: 00000100:00100000:2.0:1789130824.799999:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc5fe8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508713856:0@lo:503: 00000100:00100000:2.0:1789130824.800040:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130824.800058:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddf5cf1300 going to sleep for 11 seconds 00000100:00100000:3.0:1789130824.800448:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508713856 00000100:00100000:3.0:1789130824.800454:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508713856 00000100:00100000:3.0:1789130824.800518:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789130824.800567:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddf5cc4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+17:6497:x1876039508713856:12345-0@lo:503: 00000100:00100000:3.0:1789130824.800661:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddf5cc4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+17:6497:x1876039508713856:12345-0@lo:503: Request processed in 136us (619us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130824.800667:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789130824.800781:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc5fe8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508713856:0@lo:503: 00000100:00100000:2.0:1789130824.801556:0:8856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc5fe8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:8856:1876039508713984:0@lo:502: 00000100:00100000:2.0:1789130824.801606:0:8856:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130824.801640:0:8856:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddf5cf1b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789130824.802179:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508713984 00000100:00100000:3.0:1789130824.802186:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508713984 00000100:00100000:3.0:1789130824.802248:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789130824.802256:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddf5cc5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+17:8856:x1876039508713984:12345-0@lo:502: 00000100:00100000:3.0:1789130824.802377:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddf5cc5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+17:8856:x1876039508713984:12345-0@lo:502: Request processed in 121us (770us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130824.802385:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789130824.802504:0:8856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc5fe8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:8856:1876039508713984:0@lo:502: 00000020:01000000:0.0:1789130824.802536:0:8856:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789130824.802543:0:8856:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1789130824.802555:0:8856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789130824.802557:0:8856:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1789130824.802562:0:8856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789130824.802566:0:8856:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.111@tcp to nid 0x20000c0a8cb6f (192.168.203.111@tcp) 00000020:01000000:0.0:1789130824.802592:0:8856:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1789130824.802595:0:8856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789130824.802609:0:8856:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff91ddcf4c3490) 00000020:00000080:0.0:1789130824.802630:0:8856:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:0.0:1789130824.802636:0:8856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789130824.802709:0:8856:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:0.0:1789130824.802716:0:8856:0:(osd_handler.c:8895:osd_obd_connect()) connect #4 00000020:00000080:0.0:1789130824.802721:0:8856:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xf3fe2838e1fc1fb1 00010000:00080000:0.0:1789130824.802751:0:8856:0:(ldlm_lib.c:102:import_set_conn()) imp ffff91ddff6eb000@lustre-OST0000-osc-MDT0001: add connection 192.168.203.111@tcp at head 00010000:00010000:0.0:1789130824.802978:0:8856:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-7 is initialized 00000040:01000000:1.0:1789130824.817425:0:8856:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1789130824.817450:0:8856:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:1.0:1789130824.817675:0:8856:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789130824.817899:0:8856:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789130824.817988:0:8856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:1.0:1789130824.818076:0:8856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:1.0:1789130824.819771:0:8857:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789130824.819778:0:8857:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1789130824.820506:0:8856:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789130824.820520:0:8856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789130824.820560:0:8856:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1789130824.820582:0:8856:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf3fe2838e1fc1fb8 00000100:00080000:1.0:1789130824.820593:0:8856:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789130824.820599:0:8856:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff91ddff6eb000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:1.0:1789130824.820634:0:8856:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91dcc6bec780 x1876039508714112/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789130824.820663:0:8856:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1789130824.820721:0:8856:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789130824.820725:0:8856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789130824.820727:0:8856:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1789130824.820730:0:8856:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789130824.820734:0:8856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789130824.820735:0:8856:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789130824.820738:0:8856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789130824.820740:0:8856:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1789130824.820768:0:8856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc6beed00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:8856:1876039508714240:0@lo:502: 00000100:00100000:1.0:1789130824.820841:0:8856:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130824.820875:0:8856:0:(client.c:2715:ptlrpc_set_wait()) set ffff91dde1db5600 going to sleep for 11 seconds 00000100:00100000:0.0:1789130824.821026:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508714240 00000100:00100000:0.0:1789130824.821033:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508714240 00000100:00100000:0.0:1789130824.821069:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789130824.821079:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddf5cc7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+17:8856:x1876039508714240:12345-0@lo:502: 00000100:00100000:0.0:1789130824.821201:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddf5cc7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+17:8856:x1876039508714240:12345-0@lo:502: Request processed in 112us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130824.821209:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789130824.821252:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff752940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1876039508714496:0@lo:400: 00000100:00100000:0.0:1789130824.821281:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130824.821306:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddca0f8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3626:1876039508715008:0@lo:400: 00000100:00100000:0.0:1789130824.821337:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130824.821359:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789130824.821364:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff753840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3626:1876039508714368:0@lo:400: 00000100:00100000:0.0:1789130824.821382:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130824.821403:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddca0f92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3626:1876039508714880:0@lo:400: 00000100:00100000:0.0:1789130824.821421:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130824.821451:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff750000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3627:1876039508714624:0@lo:400: 00000100:00100000:0.0:1789130824.821494:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130824.821508:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789130824.821512:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff7512c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1876039508714752:0@lo:400: 00000100:00100000:0.0:1789130824.821532:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130824.821557:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508714496 00000100:00100000:0.0:1789130824.821561:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508714496 00000100:00100000:0.0:1789130824.821578:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508714752 00000100:00100000:0.0:1789130824.821580:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508714752 00000100:00100000:0.0:1789130824.821606:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789130824.821613:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddca0fbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1876039508714496:12345-0@lo:400: 00000100:00100000:0.0:1789130824.821651:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddca0fbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1876039508714496:12345-0@lo:400: Request processed in 38us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130824.821657:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789130824.821669:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789130824.821675:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddffa821c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1876039508714752:12345-0@lo:400: 00000100:00100000:0.0:1789130824.821703:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddffa821c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1876039508714752:12345-0@lo:400: Request processed in 29us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130824.821708:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789130824.821723:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508715008 00000100:00100000:0.0:1789130824.821726:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508715008 00000100:00100000:0.0:1789130824.821742:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508714368 00000100:00100000:0.0:1789130824.821744:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508714368 00000100:00100000:0.0:1789130824.821752:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508714880 00000100:00100000:0.0:1789130824.821754:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508714880 00000100:00100000:0.0:1789130824.821761:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508714624 00000100:00100000:0.0:1789130824.821763:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508714624 00000100:00100000:0.0:1789130824.821782:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789130824.821786:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddffa80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1876039508715008:12345-0@lo:400: 00000100:00100000:0.0:1789130824.821822:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddffa80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1876039508715008:12345-0@lo:400: Request processed in 35us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130824.821829:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789130824.821840:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789130824.821846:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddffa80780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1876039508714368:12345-0@lo:400: 00000100:00100000:0.0:1789130824.821871:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddffa80780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1876039508714368:12345-0@lo:400: Request processed in 26us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130824.821877:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789130824.821887:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789130824.821893:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddffa82d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1876039508714880:12345-0@lo:400: 00000100:00100000:0.0:1789130824.821919:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddffa82d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1876039508714880:12345-0@lo:400: Request processed in 26us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130824.821924:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789130824.821934:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789130824.821940:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddffa83c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1876039508714624:12345-0@lo:400: 00000100:00100000:0.0:1789130824.821965:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddffa83c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1876039508714624:12345-0@lo:400: Request processed in 25us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130824.821971:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789130824.822008:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff7512c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1876039508714752:0@lo:400: 00010000:00080000:0.0:1789130824.822020:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91ddff750000 x1876039508714624/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130840 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789130824.822029:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff750000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3627:1876039508714624:0@lo:400: 00010000:00080000:0.0:1789130824.822055:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91ddff753840 x1876039508714368/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130840 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789130824.822072:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff753840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3626:1876039508714368:0@lo:400: 00010000:00080000:0.0:1789130824.822083:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91ddca0f92c0 x1876039508714880/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130840 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789130824.822091:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddca0f92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3626:1876039508714880:0@lo:400: 00000100:00100000:0.0:1789130824.822099:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff752940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1876039508714496:0@lo:400: 00010000:00080000:0.0:1789130824.822107:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91ddca0f8780 x1876039508715008/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130840 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789130824.822114:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddca0f8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3626:1876039508715008:0@lo:400: 00000100:00100000:3.0:1789130824.822452:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc6bec780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3624:1876039508714112:0@lo:8: 00000100:00100000:3.0:1789130824.822524:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130824.822636:0:8856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc6beed00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:8856:1876039508714240:0@lo:502: 00000020:01000000:1.0:1789130824.822667:0:8856:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789130824.822672:0:8856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789130824.822675:0:8856:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.timeout 00000040:00080000:1.0:1789130824.822679:0:8856:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 34 count 34 00000100:00100000:0.0:1789130824.822864:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508714112 00000100:00100000:0.0:1789130824.822869:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508714112 00000100:00100000:0.0:1789130824.822891:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789130824.822897:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff7c0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3624:x1876039508714112:12345-0@lo:8: 00010000:00080000:0.0:1789130824.822920:0:8414:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 180 last 0 00000020:00000080:0.0:1789130824.822944:0:8414:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf3fe2838e1fc1fbf 00002000:00100000:0.0:1789130824.822981:0:8414:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff91ddff6e8800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113984 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:0.0:1789130824.822985:0:8414:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00000001:00000004:0.0:1789130824.822989:0:8414:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1789130824.823044:0:8414:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1789130824.823310:0:8414:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:0.0:1789130824.823334:0:8414:0:(import.c:65:import_set_state_nolock()) ffff91ddff6ed800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789130824.823379:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff7c0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3624:x1876039508714112:12345-0@lo:8: Request processed in 481us (854us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130824.823386:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000020:01000000:3.0:1789130824.823483:0:6497:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 25-33 (rc=0) 10000000:01000000:3.0:1789130824.823525:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1789130824.823535:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff91dde19aba00/0xf3fe2838e1fc1f9c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc1fa3 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130824.823545:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff91dde19aba00/0xf3fe2838e1fc1f9c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc1fa3 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789130824.823555:0:6497:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789130824.823563:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff91dded7b6800 from 30 10000000:01000000:3.0:1789130824.823566:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789130824.823596:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff91ddfa938c00/0xf3fe2838e1fc1fc6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130824.823603:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff91ddfa938c00/0xf3fe2838e1fc1fc6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130824.823611:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff91ddfa938c00/0xf3fe2838e1fc1fc6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130824.823625:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff7c3840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508715136:0@lo:101: 00000100:00100000:3.0:1789130824.823656:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130824.823689:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddfcfc2540 going to sleep for 11 seconds 00010000:00080000:3.0:1789130824.823716:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91dcc6bec780 x1876039508714112/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789130834 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130824.823725:0:3624:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789130824.823732:0:3624:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 1 00000100:00080000:3.0:1789130824.823739:0:3624:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1789130824.823744:0:3624:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1789130824.823746:0:3624:0:(import.c:65:import_set_state_nolock()) ffff91ddff6eb000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1789130824.823756:0:3624:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1789130824.823761:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc6bec780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3624:1876039508714112:0@lo:8: 00000004:00080000:1.0:1789130824.825528:0:8857:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1789130824.825599:0:8857:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 180743139814ns, next at 0ns, rc = 0 00080000:00080000:1.0:1789130824.825607:0:8857:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:0.0:1789130824.826162:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508715136 00000100:00100000:0.0:1789130824.826171:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508715136 00000100:00100000:0.0:1789130824.826814:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789130824.826826:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddf5cc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+17:6497:x1876039508715136:12345-0@lo:101: 00010000:00010000:0.0:1789130824.826843:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130824.826859:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91ddc0031400/0xf3fe2838e1fc1fcd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3fe2838e1fc1fc6 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130824.826885:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91ddc0031400/0xf3fe2838e1fc1fcd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3fe2838e1fc1fc6 expref: 18 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130824.826895:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91ddc0031400/0xf3fe2838e1fc1fcd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc1fc6 expref: 18 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130824.826905:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ddc0031400, rc 0) 00000100:00100000:0.0:1789130824.826979:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddf5cc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+18:6497:x1876039508715136:12345-0@lo:101: Request processed in 155us (3320us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130824.826986:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789130824.827065:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff7c3840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508715136:0@lo:101: 00010000:00010000:3.0:1789130824.827083:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff91ddfa938c00/0xf3fe2838e1fc1fc6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc1fcd expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130824.827091:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff91ddfa938c00/0xf3fe2838e1fc1fc6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3fe2838e1fc1fcd expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130824.827167:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff7c3840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508715264:0@lo:501: 00000100:00100000:3.0:1789130824.827216:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130824.829976:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddfcfc2540 going to sleep for 11 seconds 00000100:00100000:1.0:1789130824.830031:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508715264 00000100:00100000:1.0:1789130824.830039:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508715264 00000100:00100000:2.0:1789130824.830093:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789130824.830103:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddf5cc6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+18:6497:x1876039508715264:12345-0@lo:501: 00000100:00100000:2.0:1789130824.830255:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddf5cc6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+18:6497:x1876039508715264:12345-0@lo:501: Request processed in 153us (3038us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130824.830262:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789130824.830620:0:8858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc5fe8780 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8858:1876039508715392:0@lo:700: 00000100:00100000:2.0:1789130824.830653:0:8858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130824.830668:0:8858:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddf5cf1780 going to sleep for 11 seconds 00000100:00100000:3.0:1789130824.830970:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508715392 00000100:00100000:3.0:1789130824.830975:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508715392 00000100:00100000:3.0:1789130824.831019:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789130824.831025:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc5fead00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:8858:x1876039508715392:12345-0@lo:700: 00000100:00100000:3.0:1789130824.831052:0:8423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff7c1e00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8423:1876039508715520:0@lo:700: 00000100:00100000:3.0:1789130824.831080:0:8423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130824.831095:0:8423:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddfcfc2f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789130824.831149:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508715520 00000100:00100000:3.0:1789130824.831152:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508715520 00000100:00100000:3.0:1789130824.831174:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789130824.831179:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff7c1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0001:lustre-MDT0000-lwp-OST0000_UUID+5:8423:x1876039508715520:12345-0@lo:700: 00000100:00100000:3.0:1789130824.831319:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff7c3840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508715264:0@lo:501: 00000100:00100000:3.0:1789130824.831366:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff7c3840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508715648:0@lo:503: 00000100:00100000:3.0:1789130824.831398:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130824.831417:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddfcfc2540 going to sleep for 11 seconds 00000100:00100000:3.0:1789130824.831427:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508715648 00000100:00100000:3.0:1789130824.831429:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508715648 00000100:00100000:3.0:1789130824.831445:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1789130824.831450:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddf5cc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+18:6497:x1876039508715648:12345-0@lo:503: 00000100:00100000:3.0:1789130824.831547:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddf5cc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+18:6497:x1876039508715648:12345-0@lo:503: Request processed in 96us (147us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130824.831562:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1789130824.831597:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff7c3840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508715648:0@lo:503: 00000004:00080000:3.0:1789130824.831795:0:7432:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:3.0:1789130824.831879:0:8859:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff7c3840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:8859:1876039508715776:0@lo:502: 00000100:00100000:3.0:1789130824.831908:0:8859:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130824.831924:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508715776 00000100:00100000:3.0:1789130824.831926:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508715776 00000100:00100000:3.0:1789130824.831941:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1789130824.831946:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddf5cc4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+18:8859:x1876039508715776:12345-0@lo:502: 00000100:00100000:3.0:1789130824.832008:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddf5cc4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+18:8859:x1876039508715776:12345-0@lo:502: Request processed in 61us (98us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130824.832015:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1789130824.832038:0:8859:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddfcfc2c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789130824.832047:0:8859:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff7c3840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:8859:1876039508715776:0@lo:502: 00000100:00100000:3.0:1789130824.832078:0:8859:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff7c3840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:8859:1876039508715904:0@lo:502: 00000100:00100000:3.0:1789130824.832104:0:8859:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130824.832119:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508715904 00000100:00100000:3.0:1789130824.832121:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508715904 00000100:00100000:3.0:1789130824.832134:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1789130824.832139:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddf5cc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+18:8859:x1876039508715904:12345-0@lo:502: 00000100:00100000:3.0:1789130824.832185:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddf5cc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+18:8859:x1876039508715904:12345-0@lo:502: Request processed in 44us (79us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130824.832204:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1789130824.832232:0:8859:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddfcfc2c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789130824.832244:0:8859:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff7c3840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:8859:1876039508715904:0@lo:502: 00000040:00080000:3.0:1789130824.832267:0:8859:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1789130824.832318:0:6497:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1789130824.832337:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789130824.832345:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff91ddfa938c00/0xf3fe2838e1fc1fc6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc1fcd expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130824.832354:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff91ddfa938c00/0xf3fe2838e1fc1fc6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc1fcd expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789130824.832362:0:6497:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789130824.832365:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff91dded7b6800 from 5 10000000:01000000:3.0:1789130824.832367:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789130824.832399:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff91ddfd0b4c00/0xf3fe2838e1fc1fd4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130824.832407:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff91ddfd0b4c00/0xf3fe2838e1fc1fd4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130824.832414:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff91ddfd0b4c00/0xf3fe2838e1fc1fd4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130824.832425:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff7c3840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508716032:0@lo:101: 00000100:00100000:3.0:1789130824.832447:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130824.832478:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddfcfc2c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789130824.832490:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508716032 00000100:00100000:3.0:1789130824.832493:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508716032 00000100:00100000:3.0:1789130824.832510:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1789130824.832516:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddf5cc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+18:6497:x1876039508716032:12345-0@lo:101: 00010000:00010000:3.0:1789130824.832524:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130824.832541:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91ddfd0b5200/0xf3fe2838e1fc1fdb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3fe2838e1fc1fd4 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130824.832561:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91ddfd0b5200/0xf3fe2838e1fc1fdb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3fe2838e1fc1fd4 expref: 19 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130824.832571:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91ddfd0b5200/0xf3fe2838e1fc1fdb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc1fd4 expref: 19 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130824.832579:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ddfd0b5200, rc 0) 00000100:00100000:3.0:1789130824.832608:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddf5cc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+19:6497:x1876039508716032:12345-0@lo:101: Request processed in 93us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130824.832613:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1789130824.832641:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff7c3840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508716032:0@lo:101: 00010000:00010000:3.0:1789130824.832652:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff91ddfd0b4c00/0xf3fe2838e1fc1fd4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc1fdb expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130824.832660:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff91ddfd0b4c00/0xf3fe2838e1fc1fd4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3fe2838e1fc1fdb expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130824.832706:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff7c3840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508716160:0@lo:256: 00000100:00100000:3.0:1789130824.832733:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130824.832746:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddfcfc2c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789130824.832760:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508716160 00000100:00100000:3.0:1789130824.832764:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508716160 00000100:00100000:3.0:1789130824.832780:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789130824.832785:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddf5cc4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+19:6497:x1876039508716160:12345-0@lo:256: 20000000:01000000:3.0:1789130824.832795:0:6493:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789130824.832811:0:6493:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789130824.832817:0:6493:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:3.0:1789130824.832888:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddf5cc4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+19:6497:x1876039508716160:12345-0@lo:256: Request processed in 102us (153us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130824.832894:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789130824.832922:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff7c3840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508716160:0@lo:256: 10000000:01000000:3.0:1789130824.832957:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789130824.832963:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff91ddfd0b4c00/0xf3fe2838e1fc1fd4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc1fdb expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130824.832969:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff91ddfd0b4c00/0xf3fe2838e1fc1fd4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc1fdb expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789130824.832975:0:6497:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1789130824.832977:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:3.0:1789130824.832980:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1789130824.832992:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff91ddfd0b5000/0xf3fe2838e1fc1fe2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130824.832999:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff91ddfd0b5000/0xf3fe2838e1fc1fe2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130824.833005:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff91ddfd0b5000/0xf3fe2838e1fc1fe2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130824.833015:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff7c3840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508716288:0@lo:101: 00000100:00100000:3.0:1789130824.833041:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130824.833053:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddfcfc2c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789130824.833064:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508716288 00000100:00100000:3.0:1789130824.833066:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508716288 00000100:00100000:3.0:1789130824.833082:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1789130824.833094:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddf5cc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+19:6497:x1876039508716288:12345-0@lo:101: 00010000:00010000:3.0:1789130824.833101:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130824.833108:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91ddfd0b5400/0xf3fe2838e1fc1fe9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3fe2838e1fc1fe2 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130824.833119:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91ddfd0b5400/0xf3fe2838e1fc1fe9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3fe2838e1fc1fe2 expref: 20 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130824.833128:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91ddfd0b5400/0xf3fe2838e1fc1fe9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc1fe2 expref: 20 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130824.833134:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ddfd0b5400, rc 0) 00000100:00100000:3.0:1789130824.833160:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddf5cc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+20:6497:x1876039508716288:12345-0@lo:101: Request processed in 67us (117us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130824.833166:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1789130824.833203:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff7c3840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508716288:0@lo:101: 00010000:00010000:3.0:1789130824.833217:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff91ddfd0b5000/0xf3fe2838e1fc1fe2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc1fe9 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130824.833224:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff91ddfd0b5000/0xf3fe2838e1fc1fe2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3fe2838e1fc1fe9 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130824.833264:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff7c3840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508716416:0@lo:501: 00000100:00100000:3.0:1789130824.833288:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130824.833300:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddfcfc2c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789130824.833310:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508716416 00000100:00100000:3.0:1789130824.833313:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508716416 00000100:00100000:3.0:1789130824.833329:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1789130824.833334:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddcf4fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+20:6497:x1876039508716416:12345-0@lo:501: 00000100:00100000:3.0:1789130824.833426:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddcf4fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+20:6497:x1876039508716416:12345-0@lo:501: Request processed in 91us (137us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130824.833433:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1789130824.833479:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff7c3840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508716416:0@lo:501: 00000100:00100000:3.0:1789130824.833501:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff7c3840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508716544:0@lo:503: 00000100:00100000:3.0:1789130824.833533:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130824.833545:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddfcfc2c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789130824.833556:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508716544 00000100:00100000:3.0:1789130824.833560:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508716544 00000100:00100000:3.0:1789130824.833578:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1789130824.833583:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddcf4fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+20:6497:x1876039508716544:12345-0@lo:503: 00000100:00100000:3.0:1789130824.833649:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddcf4fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+20:6497:x1876039508716544:12345-0@lo:503: Request processed in 64us (114us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130824.833655:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1789130824.833692:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff7c3840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508716544:0@lo:503: 00000100:00080000:2.0:1789130824.834262:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789130824.834659:0:8860:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddffa80f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:8860:1876039508716672:0@lo:502: 00000100:00100000:0.0:1789130824.834705:0:8860:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130824.834743:0:8860:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddff84ce40 going to sleep for 11 seconds 00000100:00100000:2.0:1789130824.834793:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508716672 00000100:00100000:2.0:1789130824.834798:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508716672 00000100:00100000:2.0:1789130824.834835:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1789130824.834842:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddcf4fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+20:8860:x1876039508716672:12345-0@lo:502: 00000100:00100000:2.0:1789130824.834931:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddcf4fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+20:8860:x1876039508716672:12345-0@lo:502: Request processed in 89us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130824.834938:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1789130824.835018:0:8860:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddffa80f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:8860:1876039508716672:0@lo:502: 00000020:01000000:0.0:1789130824.835043:0:8860:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789130824.835050:0:8860:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1789130824.835055:0:8860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789130824.835058:0:8860:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1789130824.835063:0:8860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789130824.835066:0:8860:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.111@tcp to nid 0x20000c0a8cb6f (192.168.203.111@tcp) 00000020:01000000:0.0:1789130824.835086:0:8860:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1789130824.835094:0:8860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789130824.835909:0:8860:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff91de01a04ed8) 00000020:00000080:0.0:1789130824.835945:0:8860:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:0.0:1789130824.835956:0:8860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789130824.836043:0:8860:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1789130824.836049:0:8860:0:(osd_handler.c:8895:osd_obd_connect()) connect #6 00000020:00000080:0.0:1789130824.836056:0:8860:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf3fe2838e1fc1ff7 00010000:00080000:0.0:1789130824.836085:0:8860:0:(ldlm_lib.c:102:import_set_conn()) imp ffff91de01a0f800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.111@tcp at head 00010000:00010000:0.0:1789130824.839610:0:8860:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-8 is initialized 40000000:02000000:3.0:1789130824.843022:0:6508:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost 00000040:01000000:0.0:1789130824.843658:0:8860:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1789130824.843679:0:8860:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1789130824.843853:0:8860:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789130824.844051:0:8860:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789130824.844144:0:8860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:0.0:1789130824.844244:0:8860:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:2.0:1789130824.844812:0:8861:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789130824.844817:0:8861:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1789130824.849654:0:8860:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789130824.849677:0:8860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789130824.849836:0:8860:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1789130824.849871:0:8860:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf3fe2838e1fc1ffe 00000100:00080000:1.0:1789130824.849888:0:8860:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789130824.849896:0:8860:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff91de01a0f800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:1.0:1789130824.849977:0:8860:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91dcc6beed00 x1876039508716800/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789130824.850040:0:8860:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:2.0:1789130824.850095:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc6beed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3624:1876039508716800:0@lo:8: 00000100:00100000:2.0:1789130824.850199:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:1.0:1789130824.850203:0:8860:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789130824.850210:0:8860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789130824.850213:0:8860:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1789130824.850217:0:8860:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789130824.850222:0:8860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789130824.850225:0:8860:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789130824.850230:0:8860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789130824.850232:0:8860:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1789130824.850241:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508716800 00000100:00100000:0.0:1789130824.850251:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508716800 00000100:00100000:1.0:1789130824.850273:0:8860:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc6befc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:8860:1876039508716928:0@lo:502: 00000100:00100000:0.0:1789130824.850300:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789130824.850310:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc5febc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3624:x1876039508716800:12345-0@lo:8: 00010000:00080000:0.0:1789130824.850344:0:8417:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 180 last 0 00000100:00100000:1.0:1789130824.850362:0:8860:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:0.0:1789130824.850378:0:8417:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf3fe2838e1fc2005 00002000:00100000:0.0:1789130824.850397:0:8417:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff91de01a0a800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113984 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1789130824.850402:0:8417:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000100:00100000:1.0:1789130824.850403:0:8860:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddd0683780 going to sleep for 11 seconds 00002000:00100000:0.0:1789130824.850406:0:8417:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:2.0:1789130824.850441:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508716928 00000100:00100000:2.0:1789130824.850446:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508716928 00000100:00100000:2.0:1789130824.850500:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00002000:00080000:0.0:1789130824.850505:0:8417:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00100000:2.0:1789130824.850507:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddcf4f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+20:8860:x1876039508716928:12345-0@lo:502: 00000100:00080000:0.0:1789130824.850531:0:8417:0:(import.c:65:import_set_state_nolock()) ffff91de01a0a000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789130824.850589:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc5febc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3624:x1876039508716800:12345-0@lo:8: Request processed in 280us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130824.850596:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789130824.850617:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddcf4f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+20:8860:x1876039508716928:12345-0@lo:502: Request processed in 110us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130824.850623:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00010000:00080000:0.0:1789130824.850659:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91dcc6beed00 x1876039508716800/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789130834 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789130824.850669:0:3624:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789130824.850677:0:3624:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1789130824.850684:0:3624:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789130824.850689:0:3624:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1789130824.850692:0:3624:0:(import.c:65:import_set_state_nolock()) ffff91de01a0f800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789130824.850709:0:3624:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789130824.850714:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc6beed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3624:1876039508716800:0@lo:8: 00000100:00100000:1.0:1789130824.850961:0:8860:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc6befc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:8860:1876039508716928:0@lo:502: 00000020:01000000:1.0:1789130824.850996:0:8860:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789130824.851003:0:8860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789130824.851005:0:8860:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.timeout 00000040:00080000:1.0:1789130824.851009:0:8860:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:1.0:1789130824.851086:0:6497:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:1.0:1789130824.851116:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1789130824.851128:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff91ddfd0b5000/0xf3fe2838e1fc1fe2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc1fe9 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130824.851140:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff91ddfd0b5000/0xf3fe2838e1fc1fe2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc1fe9 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789130824.851152:0:6497:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1789130824.851155:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff91ddd10e8000 from 1 10000000:01000000:1.0:1789130824.851158:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789130824.851201:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff91dde19aa800/0xf3fe2838e1fc200c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130824.851210:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff91dde19aa800/0xf3fe2838e1fc200c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130824.851228:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff91dde19aa800/0xf3fe2838e1fc200c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130824.851243:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc6befc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508717056:0@lo:101: 00000100:00100000:1.0:1789130824.851298:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1789130824.851360:0:8861:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:1.0:1789130824.851361:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddd0683780 going to sleep for 11 seconds 00000100:00100000:0.0:1789130824.851498:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508717056 00000100:00100000:0.0:1789130824.851506:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508717056 00000100:00100000:0.0:1789130824.851559:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1789130824.851569:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddcf4fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+20:6497:x1876039508717056:12345-0@lo:101: 00010000:00010000:0.0:1789130824.851579:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130824.851596:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91ddc0030600/0xf3fe2838e1fc2013 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3fe2838e1fc200c expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130824.851621:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91ddc0030600/0xf3fe2838e1fc2013 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3fe2838e1fc200c expref: 21 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130824.851633:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91ddc0030600/0xf3fe2838e1fc2013 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc200c expref: 21 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130824.851643:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ddc0030600, rc 0) 00000100:00100000:0.0:1789130824.851701:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddcf4fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+21:6497:x1876039508717056:12345-0@lo:101: Request processed in 133us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130824.851707:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1789130824.851753:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc6befc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508717056:0@lo:101: 00010000:00010000:0.0:1789130824.851777:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff91dde19aa800/0xf3fe2838e1fc200c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc2013 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130824.851787:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff91dde19aa800/0xf3fe2838e1fc200c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3fe2838e1fc2013 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130824.851858:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddffa80f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508717184:0@lo:501: 00000100:00100000:0.0:1789130824.851902:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130824.851946:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508717184 00000100:00100000:2.0:1789130824.851951:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508717184 00000100:00100000:2.0:1789130824.851980:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1789130824.852382:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddcf4f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+21:6497:x1876039508717184:12345-0@lo:501: 00000100:00100000:0.0:1789130824.852699:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddff8aa480 going to sleep for 11 seconds 00000004:00080000:1.0:1789130824.852993:0:8861:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 180770531778ns, next at 0ns, rc = 0 00080000:00080000:1.0:1789130824.853017:0:8861:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:2.0:1789130824.853254:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddcf4f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+21:6497:x1876039508717184:12345-0@lo:501: Request processed in 1264us (1348us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789130824.853263:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1789130824.853319:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddffa80f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508717184:0@lo:501: 10000000:01000000:0.0:1789130824.853356:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789130824.853365:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff91dde19aa800/0xf3fe2838e1fc200c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc2013 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130824.853374:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff91dde19aa800/0xf3fe2838e1fc200c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc2013 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130824.856579:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff7c1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0001:lustre-MDT0000-lwp-OST0000_UUID+5:8423:x1876039508715520:12345-0@lo:700: Request processed in 25393us (25491us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130824.856607:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789130824.857082:0:8423:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91ddff7c1e00 x1876039508715520/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789130840 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130824.857098:0:8423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff7c1e00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8423:1876039508715520:0@lo:700: 40000000:02000000:3.0:1789130824.857112:0:8423:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] 00000004:00080000:2.0:1789130824.858147:0:8862:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:2.0:1789130824.858175:0:8862:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc5fe9a40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8862:1876039508717440:0@lo:7: 00000100:00100000:2.0:1789130824.858249:0:8862:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130824.858304:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508717440 00000100:00100000:2.0:1789130824.858311:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508717440 00000100:00100000:2.0:1789130824.858368:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789130824.858377:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc5fe83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8862:x1876039508717440:12345-0@lo:7: 00000100:00100000:0.0:1789130824.859086:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc5fe8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1876039508717312:0@lo:13: 00000100:00100000:0.0:1789130824.859126:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789130824.863498:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789130824.863538:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508717312 00000100:00100000:2.0:1789130824.863547:0:8418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508717312 00000100:00100000:2.0:1789130824.863780:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789130824.863791:0:8418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddffa80f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3627:x1876039508717312:12345-0@lo:13: 00002000:00000024:2.0:1789130824.863831:0:8418:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923816448 avail 3692294144 00000100:00100000:2.0:1789130824.863925:0:8418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddffa80f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3627:x1876039508717312:12345-0@lo:13: Request processed in 136us (4798us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130824.863933:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1789130824.864113:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91dcc5fe8000 x1876039508717312/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789130840 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789130824.864134:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc5fe8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1876039508717312:0@lo:13: 00002000:00080000:2.0:1789130824.867980:0:8416:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:2.0:1789130824.867991:0:8416:0:(ofd_dev.c:1222:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:2.0:1789130824.868069:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc5fe83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8862:x1876039508717440:12345-0@lo:7: Request processed in 9688us (9815us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130824.868079:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789130824.868115:0:8862:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddd12f0d80 going to sleep for 11 seconds 00010000:00080000:2.0:1789130824.868139:0:8862:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91dcc5fe9a40 x1876039508717440/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789130840 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789130824.868153:0:8862:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc5fe9a40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8862:1876039508717440:0@lo:7: 00000004:00080000:2.0:1789130824.868167:0:8862:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:2.0:1789130824.868213:0:8862:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc5fe9a40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8862:1876039508717568:0@lo:5: 00000100:00100000:2.0:1789130824.868246:0:8862:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130824.868278:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508717568 00000100:00100000:2.0:1789130824.868284:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508717568 00000004:00080000:0.0:1789130824.868720:0:6479:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:2.0:1789130824.869916:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789130824.869934:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc5fe8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8862:x1876039508717568:12345-0@lo:5: 00002000:00080000:2.0:1789130824.869964:0:8417:0:(ofd_dev.c:1654:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1789130824.869968:0:8417:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1789130824.870265:0:8862:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddd831e300 going to sleep for 11 seconds 00000001:00080000:3.0:1789130824.875056:0:8410:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:3.0:1789130824.875077:0:8410:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1789130824.875084:0:8410:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:0.0:1789130824.875342:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc5fe8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:8862:x1876039508717568:12345-0@lo:5: Request processed in 5409us (7090us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1789130824.875354:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1789130824.875703:0:8862:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91dcc5fe9a40 x1876039508717568/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789130840 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130824.875732:0:8862:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1789130824.875742:0:8862:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc5fe9a40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8862:1876039508717568:0@lo:5: 00000004:00080000:3.0:1789130824.875765:0:8862:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:3.0:1789130824.875845:0:8862:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff7c1e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8862:1876039508717696:0@lo:700: 00000100:00100000:3.0:1789130824.875917:0:8862:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130824.875981:0:8862:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddfcfc2f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789130824.879181:0:8424:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 2 min 2 max 16 00000100:00100000:2.0:1789130824.879215:0:8424:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_002' 00000100:00100000:0.0:1789130824.880018:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508717696 00000100:00100000:0.0:1789130824.880033:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508717696 00000100:00100000:2.0:1789130824.880179:0:8864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789130824.880212:0:8864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff7c3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8862:x1876039508717696:12345-0@lo:700: 00000100:00100000:3.0:1789130824.890400:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc5fead00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:8858:x1876039508715392:12345-0@lo:700: Request processed in 59359us (59730us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130824.890419:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1789130824.890431:0:8858:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91dcc5fe8780 x1876039508715392/t0(0) o700->lustre-OST0000-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789130840 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789130824.890451:0:8858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc5fe8780 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8858:1876039508715392:0@lo:700: 00000100:00100000:2.0:1789130824.904278:0:8864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff7c3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8862:x1876039508717696:12345-0@lo:700: Request processed in 24071us (28346us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130824.904297:0:8864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789130824.904572:0:8862:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91ddff7c1e00 x1876039508717696/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789130840 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1789130824.904573:0:8858:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:3.0:1789130824.904605:0:8862:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff7c1e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8862:1876039508717696:0@lo:700: 00000100:00100000:2.0:1789130824.904621:0:8858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc5fe8f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8858:1876039508717952:0@lo:7: 00000100:00100000:2.0:1789130824.904694:0:8858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130824.904762:0:8858:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddd831e180 going to sleep for 11 seconds 00000100:00100000:2.0:1789130824.904790:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508717952 00000100:00100000:2.0:1789130824.904798:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508717952 00000100:00100000:1.0:1789130824.904945:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789130824.904962:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc5fe8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508717824:0@lo:13: 00000100:00100000:1.0:1789130824.905001:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130824.905222:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789130824.905234:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc5fea1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8858:x1876039508717952:12345-0@lo:7: 00000100:00100000:3.0:1789130824.905707:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508717824 00000100:00100000:3.0:1789130824.905719:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508717824 00000100:00100000:3.0:1789130824.905768:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789130824.905778:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc6bee1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3627:x1876039508717824:12345-0@lo:13: 00002000:00000024:3.0:1789130824.905803:0:8419:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923816448 avail 3692294144 00000100:00100000:3.0:1789130824.905882:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc6bee1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3627:x1876039508717824:12345-0@lo:13: Request processed in 105us (880us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130824.905890:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789130824.905935:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91dcc5fe8780 x1876039508717824/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789130840 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130824.905956:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc5fe8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508717824:0@lo:13: 00000004:02000040:3.0:1789130824.909090:0:8862:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 00002000:00080000:2.0:1789130824.922880:0:8416:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:2.0:1789130824.922890:0:8416:0:(ofd_dev.c:1222:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x1:0x0] 00000100:00100000:2.0:1789130824.922983:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc5fea1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8858:x1876039508717952:12345-0@lo:7: Request processed in 17749us (18285us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130824.922994:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1789130824.926732:0:8858:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91dcc5fe8f00 x1876039508717952/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789130840 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789130824.926750:0:8858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc5fe8f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8858:1876039508717952:0@lo:7: 00000004:00080000:0.0:1789130824.926776:0:8858:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x1:0x0] 00000100:00100000:0.0:1789130824.926830:0:8858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddffa81680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8858:1876039508718080:0@lo:5: 00000100:00100000:0.0:1789130824.926885:0:8858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130824.926932:0:8858:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddff8aa480 going to sleep for 11 seconds 00000100:00100000:2.0:1789130824.927683:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508718080 00000100:00100000:2.0:1789130824.927691:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508718080 00000100:00100000:2.0:1789130824.927843:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789130824.927853:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddffa80b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8858:x1876039508718080:12345-0@lo:5: 00002000:00080000:2.0:1789130824.927879:0:8417:0:(ofd_dev.c:1654:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:2.0:1789130824.927937:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddffa80b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8858:x1876039508718080:12345-0@lo:5: Request processed in 85us (1051us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130824.927954:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1789130824.928015:0:8858:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91ddffa81680 x1876039508718080/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789130840 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130824.928027:0:8858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddffa81680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8858:1876039508718080:0@lo:5: 00000004:00080000:3.0:1789130824.928036:0:8858:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x1:0x0] from OST, last_created [0x280000400:0x1:0x0]last_used is [0x280000400:0x1:0x0] 00000100:00100000:3.0:1789130824.928061:0:8858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff7c1e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8858:1876039508718208:0@lo:5: 00000100:00100000:3.0:1789130824.928089:0:8858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130824.928172:0:8862:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc6becf00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8862:1876039508718336:0@lo:5: 00000100:00100000:3.0:1789130824.929069:0:8858:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddfcfc2f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789130824.929136:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508718208 00000100:00100000:0.0:1789130824.929141:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508718208 00000100:00100000:0.0:1789130824.931962:0:8862:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130824.931996:0:8862:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddd0683240 going to sleep for 11 seconds 00000100:00100000:2.0:1789130824.933018:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508718336 00000100:00100000:2.0:1789130824.933028:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508718336 00000100:00100000:1.0:1789130824.933227:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789130824.933572:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddffa83840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:8862:x1876039508718336:12345-0@lo:5: 00002000:00080000:1.0:1789130824.940949:0:8414:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:1.0:1789130824.940982:0:8414:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2 00000100:00100000:1.0:1789130824.944533:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddffa83840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8862:x1876039508718336:12345-0@lo:5: Request processed in 10959us (12566us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1789130824.944549:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789130824.944588:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789130824.944601:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff7c0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8858:x1876039508718208:12345-0@lo:5: 00002000:00080000:1.0:1789130824.944648:0:8414:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 2 00010000:00080000:0.0:1789130824.945420:0:8862:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91dcc6becf00 x1876039508718336/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789130840 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789130824.945444:0:8862:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc6becf00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8862:1876039508718336:0@lo:5: 00000004:00080000:0.0:1789130824.945476:0:8862:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x1:0x0]-[0x280000401:0x21:0x0] 00000100:00100000:1.0:1789130824.949230:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff7c0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:8858:x1876039508718208:12345-0@lo:5: Request processed in 4624us (21130us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1789130824.949259:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1789130824.949667:0:8858:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91ddff7c1e00 x1876039508718208/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789130840 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789130824.949689:0:8858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff7c1e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8858:1876039508718208:0@lo:5: 00000004:00080000:0.0:1789130824.949709:0:8858:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:1.0:1789130824.951095:0:8858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc6bed680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8858:1876039508718464:0@lo:900: 00000100:00100000:1.0:1789130824.951187:0:8858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130824.957735:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508718464 00000100:00100000:3.0:1789130824.957749:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508718464 00000100:00100000:3.0:1789130824.957813:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789130824.957934:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc6becb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:8858:x1876039508718464:12345-0@lo:900: 00000100:00100000:1.0:1789130824.958070:0:8858:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddd2f299c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789130824.960870:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc6becb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:8858:x1876039508718464:12345-0@lo:900: Request processed in 3041us (9676us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130824.960884:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789130824.962920:0:8858:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91dcc6bed680 x1876039508718464/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789130840 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789130824.962944:0:8858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc6bed680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8858:1876039508718464:0@lo:900: 00000001:00080000:3.0:1789130825.297850:0:8410:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000001:00080000:3.0:1789130825.297875:0:8410:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:2.0:1789130825.618184:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130826.641760:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789130827.083037:0:8946:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789130827.083293:0:8946:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1789130827.345578:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789130827.345601:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc5fe9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1876039508718592:0@lo:41: 00000100:00100000:2.0:1789130827.345665:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130827.345750:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508718592 00000100:00100000:2.0:1789130827.345757:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508718592 00000100:00100000:2.0:1789130827.345799:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789130827.345808:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc5feb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1876039508718592:12345-0@lo:41: 00000004:00000024:2.0:1789130827.345840:0:6505:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:2.0:1789130827.345896:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc5feb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1876039508718592:12345-0@lo:41: Request processed in 89us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130827.345903:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789130827.345944:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc5fe9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1876039508718592:0@lo:41: 00000100:00100000:1.0:1789130827.346333:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789130827.346346:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff7c3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508718720:0@lo:41: 00000100:00100000:1.0:1789130827.346379:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130827.346558:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508718720 00000100:00100000:0.0:1789130827.346564:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508718720 00000100:00100000:0.0:1789130827.346601:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789130827.346608:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc6bed680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1876039508718720:12345-0@lo:41: 00000004:00000024:0.0:1789130827.346627:0:6505:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1789130827.346663:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc6bed680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1876039508718720:12345-0@lo:41: Request processed in 56us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130827.346669:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789130827.348868:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff7c3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508718720:0@lo:41: 00010000:00010000:1.0:1789130827.666718:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789130827.793633:0:8994:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789130827.793650:0:8994:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:3.0:1789130828.691556:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130829.714606:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789130829.907724:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc5feb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1876039508718848:0@lo:13: 00000100:00100000:3.0:1789130829.907831:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130829.907997:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508718848 00000100:00100000:2.0:1789130829.908007:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508718848 00000100:00100000:2.0:1789130829.908080:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789130829.908094:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff7c2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1876039508718848:12345-0@lo:13: 00002000:00000024:2.0:1789130829.908136:0:8419:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789130829.908201:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff7c2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1876039508718848:12345-0@lo:13: Request processed in 112us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130829.908238:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1789130829.908408:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789130829.908442:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91dcc5feb480 x1876039508718848/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789130845 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130829.908455:0:3627:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1789130829.908512:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc5feb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1876039508718848:0@lo:13: 00000100:00100000:1.0:1789130829.911630:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc6bed2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3625:1876039508719104:0@lo:400: 00000100:00100000:1.0:1789130829.911739:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130829.911786:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc6bef840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3625:1876039508719616:0@lo:400: 00000100:00100000:1.0:1789130829.911812:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130829.911841:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789130829.911847:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc6bec3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508719232:0@lo:400: 00000100:00100000:1.0:1789130829.911882:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130829.911902:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc6bee940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3625:1876039508719744:0@lo:400: 00000100:00100000:1.0:1789130829.911924:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130829.911962:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508719104 00000100:00100000:1.0:1789130829.911971:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508719104 00000100:00100000:1.0:1789130829.912019:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508719616 00000100:00100000:1.0:1789130829.912022:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508719616 00000100:00100000:1.0:1789130829.912048:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508719744 00000100:00100000:1.0:1789130829.912051:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508719744 00000100:00100000:1.0:1789130829.912068:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789130829.912087:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc6beed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1876039508719104:12345-0@lo:400: 00000100:00100000:1.0:1789130829.912148:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc6beed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1876039508719104:12345-0@lo:400: Request processed in 62us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130829.912166:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789130829.912186:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789130829.912192:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc6bec780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1876039508719616:12345-0@lo:400: 00000100:00100000:1.0:1789130829.912218:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc6bec780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1876039508719616:12345-0@lo:400: Request processed in 27us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130829.912237:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789130829.912248:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789130829.912253:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc6beda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1876039508719744:12345-0@lo:400: 00000100:00100000:1.0:1789130829.912280:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc6beda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1876039508719744:12345-0@lo:400: Request processed in 27us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130829.912286:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789130829.912310:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508719232 00000100:00100000:1.0:1789130829.912314:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508719232 00000100:00100000:1.0:1789130829.912340:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789130829.912347:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc6bec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508719232:12345-0@lo:400: 00000100:00100000:1.0:1789130829.912379:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc6bec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508719232:12345-0@lo:400: Request processed in 32us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130829.912385:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789130829.912427:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc6bec3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508719232:0@lo:400: 00010000:00080000:1.0:1789130829.912440:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91dcc6bee940 x1876039508719744/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130845 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789130829.912451:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc6bee940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3625:1876039508719744:0@lo:400: 00010000:00080000:1.0:1789130829.912498:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91dcc6bed2c0 x1876039508719104/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130845 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789130829.912507:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc6bed2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3625:1876039508719104:0@lo:400: 00010000:00080000:1.0:1789130829.912516:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91dcc6bef840 x1876039508719616/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130845 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789130829.912525:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc6bef840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3625:1876039508719616:0@lo:400: 00000100:00080000:1.0:1789130829.912556:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789130829.912560:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789130829.912787:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc6becf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3627:1876039508719360:0@lo:400: 00000100:00100000:3.0:1789130829.912826:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130829.912857:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc6befc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508719872:0@lo:400: 00000100:00100000:3.0:1789130829.912881:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130829.912928:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789130829.912935:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc6bef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3627:1876039508718976:0@lo:400: 00000100:00100000:3.0:1789130829.912965:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130829.912995:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc6bede00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1876039508719488:0@lo:400: 00000100:00100000:3.0:1789130829.913019:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130829.913050:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508719872 00000100:00100000:3.0:1789130829.913056:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508719872 00000100:00100000:3.0:1789130829.913095:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789130829.913102:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff7c30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508719872:12345-0@lo:400: 00000100:00100000:3.0:1789130829.913142:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff7c30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508719872:12345-0@lo:400: Request processed in 41us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130829.913149:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1789130829.913191:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91dcc6befc00 x1876039508719872/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789130845 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130829.913200:0:3627:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967299 gen 2 00000100:00100000:3.0:1789130829.913212:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc6befc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508719872:0@lo:400: 00000100:00080000:1.0:1789130829.913324:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789130829.913334:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508719488 00000100:00100000:1.0:1789130829.913337:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508719488 00000100:00100000:1.0:1789130829.913370:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789130829.913377:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff7c1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1876039508719488:12345-0@lo:400: 00000100:00100000:1.0:1789130829.913417:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff7c1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1876039508719488:12345-0@lo:400: Request processed in 41us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130829.913424:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789130829.913439:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508719360 00000100:00100000:1.0:1789130829.913442:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508719360 00000100:00100000:1.0:1789130829.913488:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789130829.913495:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff7c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1876039508719360:12345-0@lo:400: 00000100:00100000:1.0:1789130829.913523:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff7c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1876039508719360:12345-0@lo:400: Request processed in 29us (697us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130829.913530:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789130829.913556:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc6bede00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1876039508719488:0@lo:400: 00010000:00080000:1.0:1789130829.913567:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91dcc6becf00 x1876039508719360/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130845 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789130829.913591:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc6becf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3627:1876039508719360:0@lo:400: 00000100:00100000:0.0:1789130829.914344:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508718976 00000100:00100000:0.0:1789130829.914352:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508718976 00000100:00100000:0.0:1789130829.914402:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1789130829.914410:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddcf4f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+21:3627:x1876039508718976:12345-0@lo:400: 00000100:00100000:0.0:1789130829.914509:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddcf4f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+21:3627:x1876039508718976:12345-0@lo:400: Request processed in 99us (1544us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130829.914516:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1789130829.914645:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc6bef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3627:1876039508718976:0@lo:400: 00000100:00100000:0.0:1789130830.420954:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc5fe9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1876039508720000:0@lo:13: 00000100:00100000:0.0:1789130830.421058:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130830.422194:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508720000 00000100:00100000:2.0:1789130830.422210:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508720000 00000100:00100000:2.0:1789130830.422273:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789130830.422285:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddffa83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1876039508720000:12345-0@lo:13: 00002000:00000024:2.0:1789130830.422321:0:8419:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789130830.422638:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddffa83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1876039508720000:12345-0@lo:13: Request processed in 354us (1579us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130830.422647:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1789130830.425195:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91dcc5fe9e00 x1876039508720000/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789130846 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130830.425231:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc5fe9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1876039508720000:0@lo:13: 00010000:00010000:3.0:1789130830.746006:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130831.762818:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789130832.466880:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789130832.466912:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc6bef840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508720128:0@lo:41: 00000100:00100000:1.0:1789130832.467001:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130832.467093:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508720128 00000100:00100000:1.0:1789130832.467103:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508720128 00000100:00100000:1.0:1789130832.467171:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789130832.467182:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc6bed2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508720128:12345-0@lo:41: 00000004:00000024:1.0:1789130832.467232:0:6505:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1789130832.467284:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc6bed2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508720128:12345-0@lo:41: Request processed in 103us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130832.467292:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789130832.467359:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc6bef840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508720128:0@lo:41: 00000100:00100000:0.0:1789130832.469258:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc6bef840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1876039508720256:0@lo:41: 00000100:00100000:0.0:1789130832.469580:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130832.470049:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508720256 00000100:00100000:1.0:1789130832.470061:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508720256 00000100:00100000:1.0:1789130832.470124:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789130832.470135:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddffa82580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1876039508720256:12345-0@lo:41: 00000004:00000024:1.0:1789130832.470187:0:6505:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:1.0:1789130832.470260:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddffa82580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1876039508720256:12345-0@lo:41: Request processed in 127us (681us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130832.470269:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789130832.470588:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc6bef840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1876039508720256:0@lo:41: 00010000:00010000:2.0:1789130832.785665:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130833.815044:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130834.841203:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789130835.027773:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff7c1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1876039508720384:0@lo:13: 00000100:00100000:0.0:1789130835.027867:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130835.031636:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff7c03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3628:1876039508720512:0@lo:400: 00000100:00100000:3.0:1789130835.031757:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130835.036906:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508720512 00000100:00100000:2.0:1789130835.036925:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508720512 00000100:00100000:2.0:1789130835.037103:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1789130835.037117:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddcf4fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+21:3628:x1876039508720512:12345-0@lo:400: 00000100:00100000:2.0:1789130835.037270:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddcf4fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+21:3628:x1876039508720512:12345-0@lo:400: Request processed in 155us (5517us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130835.037279:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1789130835.037492:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff7c2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3625:1876039508720640:0@lo:400: 00000100:00100000:2.0:1789130835.037551:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130835.037852:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff7c3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1876039508720768:0@lo:400: 00000100:00100000:0.0:1789130835.037894:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130835.037952:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddca180780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3626:1876039508721280:0@lo:400: 00000100:00100000:0.0:1789130835.037979:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130835.038033:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508720384 00000100:00100000:0.0:1789130835.038040:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508720384 00000100:00100000:0.0:1789130835.038093:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789130835.038103:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddffa81a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1876039508720384:12345-0@lo:13: 00002000:00000024:0.0:1789130835.038147:0:8419:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789130835.038200:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddffa81a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1876039508720384:12345-0@lo:13: Request processed in 99us (10333us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130835.038227:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789130835.038255:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508720640 00000100:00100000:0.0:1789130835.038260:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508720640 00000100:00100000:0.0:1789130835.038288:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508721280 00000100:00100000:0.0:1789130835.038291:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508721280 00000100:00100000:0.0:1789130835.038324:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789130835.038332:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc5fe9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1876039508720640:12345-0@lo:400: 00000100:00100000:0.0:1789130835.038366:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc5fe9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1876039508720640:12345-0@lo:400: Request processed in 35us (815us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130835.038372:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789130835.038384:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789130835.038390:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddffa82940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1876039508721280:12345-0@lo:400: 00000100:00100000:0.0:1789130835.038418:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddffa82940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1876039508721280:12345-0@lo:400: Request processed in 29us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130835.038424:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:0.0:1789130835.038441:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789130835.038447:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789130835.038502:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91ddca180780 x1876039508721280/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130851 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789130835.038530:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddca180780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3626:1876039508721280:0@lo:400: 00010000:00080000:0.0:1789130835.038573:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91ddff7c1e00 x1876039508720384/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789130851 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789130835.038590:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff7c1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1876039508720384:0@lo:13: 00000100:00100000:0.0:1789130835.040297:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff7c21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3627:1876039508720896:0@lo:400: 00000100:00100000:0.0:1789130835.041084:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130835.042785:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508720768 00000100:00100000:3.0:1789130835.042819:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508720768 00000100:00100000:3.0:1789130835.042912:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789130835.042925:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddffa830c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1876039508720768:12345-0@lo:400: 00000100:00100000:3.0:1789130835.043038:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddffa830c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1876039508720768:12345-0@lo:400: Request processed in 116us (5143us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130835.043046:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789130835.043133:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff7c3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1876039508720768:0@lo:400: 00000100:00100000:3.0:1789130835.043424:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff7c03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3628:1876039508720512:0@lo:400: 00000100:00100000:3.0:1789130835.043436:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddca181a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1876039508721024:0@lo:400: 00000100:00100000:3.0:1789130835.043505:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130835.043545:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508721024 00000100:00100000:3.0:1789130835.043549:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508721024 00000100:00100000:3.0:1789130835.043576:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789130835.043582:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddca1821c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3628:x1876039508721024:12345-0@lo:400: 00000100:00100000:3.0:1789130835.043617:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddca1821c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3628:x1876039508721024:12345-0@lo:400: Request processed in 34us (112us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130835.043624:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789130835.043651:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddca181a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1876039508721024:0@lo:400: 00000100:00100000:0.0:1789130835.046925:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508720896 00000100:00100000:0.0:1789130835.046946:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508720896 00000100:00100000:0.0:1789130835.047032:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789130835.047043:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddffa803c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1876039508720896:12345-0@lo:400: 00000100:00100000:0.0:1789130835.047172:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddffa803c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1876039508720896:12345-0@lo:400: Request processed in 124us (6086us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130835.047181:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:0.0:1789130835.047246:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91ddff7c21c0 x1876039508720896/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130851 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789130835.047263:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff7c21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3627:1876039508720896:0@lo:400: 00000100:00100000:0.0:1789130835.047275:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddca180f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508721408:0@lo:400: 00000100:00100000:0.0:1789130835.047408:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130835.047450:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508721408 00000100:00100000:0.0:1789130835.047454:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508721408 00000100:00100000:0.0:1789130835.047513:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789130835.047578:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddffa812c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508721408:12345-0@lo:400: 00000100:00100000:0.0:1789130835.047670:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddffa812c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508721408:12345-0@lo:400: Request processed in 150us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130835.047677:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1789130835.047695:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789130835.048437:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91ddca180f00 x1876039508721408/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789130851 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789130835.048453:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddca180f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508721408:0@lo:400: 00010000:00080000:2.0:1789130835.051627:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91ddff7c2580 x1876039508720640/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130851 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789130835.051651:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff7c2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3625:1876039508720640:0@lo:400: 00000100:00100000:2.0:1789130835.051666:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddca181680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3625:1876039508721152:0@lo:400: 00000100:00100000:2.0:1789130835.051952:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130835.052096:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508721152 00000100:00100000:2.0:1789130835.052117:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508721152 00000100:00100000:2.0:1789130835.052215:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789130835.052227:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc5feb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1876039508721152:12345-0@lo:400: 00000100:00100000:2.0:1789130835.052307:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc5feb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1876039508721152:12345-0@lo:400: Request processed in 83us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130835.052437:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:2.0:1789130835.052502:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789130835.052667:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91ddca181680 x1876039508721152/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130851 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789130835.052681:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddca181680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3625:1876039508721152:0@lo:400: 00000100:00100000:0.0:1789130835.538619:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789130835.538658:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc5fe8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508721536:0@lo:13: 00000100:00100000:0.0:1789130835.538752:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130835.538931:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508721536 00000100:00100000:2.0:1789130835.538941:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508721536 00000100:00100000:2.0:1789130835.539012:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789130835.539024:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddffa81e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508721536:12345-0@lo:13: 00002000:00000024:2.0:1789130835.539054:0:8419:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789130835.539130:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddffa81e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508721536:12345-0@lo:13: Request processed in 96us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130835.539139:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1789130835.539299:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91dcc5fe8f00 x1876039508721536/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789130851 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789130835.539823:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc5fe8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508721536:0@lo:13: 00010000:00010000:1.0:1789130835.861251:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130836.885166:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789130837.585675:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddffa81680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508721664:0@lo:41: 00000100:00100000:2.0:1789130837.585946:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130837.586090:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508721664 00000100:00100000:3.0:1789130837.586108:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508721664 00000100:00100000:3.0:1789130837.586176:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789130837.586188:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc5fe8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508721664:12345-0@lo:41: 00000004:00000024:3.0:1789130837.586233:0:6506:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:3.0:1789130837.586306:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc5fe8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508721664:12345-0@lo:41: Request processed in 119us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130837.586315:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789130837.586388:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddffa81680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508721664:0@lo:41: 00000100:00100000:3.0:1789130837.591180:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddffa81680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508721792:0@lo:41: 00000100:00100000:3.0:1789130837.591288:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130837.591402:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508721792 00000100:00100000:2.0:1789130837.591413:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508721792 00000100:00100000:2.0:1789130837.591509:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789130837.591523:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddca181a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508721792:12345-0@lo:41: 00000004:00000024:2.0:1789130837.591572:0:6506:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:2.0:1789130837.591800:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddca181a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508721792:12345-0@lo:41: Request processed in 279us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130837.591821:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789130837.592026:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddffa81680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508721792:0@lo:41: 00010000:00010000:1.0:1789130837.906934:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789130837.917923:0:9492:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789130837.917929:0:9492:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:2.0:1789130837.917930:0:9492:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1789130837.918094:0:9492:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff91ddff549800 00000020:01000004:2.0:1789130837.918128:0:9492:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1789130837.918147:0:9492:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1789130837.918239:0:9492:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff91dcc6f59a48) 00000020:00000080:2.0:1789130837.918263:0:9492:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1789130837.965653:0:9492:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1789130837.966217:0:9492:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00080000:01000000:2.0:1789130837.996626:0:9492:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1789130837.997542:0:9492:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1789130837.997562:0:9492:0:(osd_handler.c:8895:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789130837.997579:0:9492:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xf3fe2838e1fc2021 00000020:01000004:2.0:1789130837.997587:0:9492:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:2.0:1789130837.997615:0:9492:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.111@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789130837.997619:0:9492:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.111@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789130837.997627:0:9492:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1789130837.999219:0:9492:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:2.0:1789130837.999233:0:9492:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.111@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1789130838.034044:0:9492:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.111@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789130838.034091:0:9492:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.111@tcp, index=0001, flags=0x20062 00000020:01000004:2.0:1789130838.034095:0:9492:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789130838.037217:0:9492:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789130838.037221:0:9492:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789130838.037223:0:9492:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789130838.037224:0:9492:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789130838.037227:0:9492:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789130838.037229:0:9492:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789130838.037231:0:9492:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789130838.037233:0:9492:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789130838.037234:0:9492:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789130838.037235:0:9492:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789130838.037241:0:9492:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:2.0:1789130838.037254:0:9492:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789130838.037255:0:9492:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789130838.037257:0:9492:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789130838.037258:0:9492:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789130838.037259:0:9492:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789130838.037260:0:9492:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789130838.037261:0:9492:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789130838.037262:0:9492:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789130838.037263:0:9492:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789130838.037264:0:9492:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789130838.037265:0:9492:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789130838.037345:0:9492:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1789130838.037375:0:9492:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc5fe8f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:9492:1876039508721920:0@lo:253: 00000100:00100000:2.0:1789130838.037527:0:9492:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130838.037585:0:9492:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddf5cf1e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789130838.038535:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508721920 00000100:00100000:1.0:1789130838.038550:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508721920 00000100:00100000:1.0:1789130838.038700:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1789130838.038711:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddcf4fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+21:9492:x1876039508721920:12345-0@lo:253: 20000000:01000000:1.0:1789130838.038749:0:6493:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1789130838.038753:0:6493:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:1.0:1789130838.038758:0:6493:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:1.0:1789130838.038762:0:6493:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:1.0:1789130838.039050:0:6493:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789130838.039203:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 20000000:01000000:1.0:1789130838.039234:0:6493:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:1.0:1789130838.039253:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 128 off8544 20000000:01000000:1.0:1789130838.039259:0:6493:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:1.0:1789130838.039271:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 112 off8656 00000040:00080000:1.0:1789130838.039285:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8880 00000040:00080000:1.0:1789130838.039366:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 20000000:01000000:1.0:1789130838.039381:0:6493:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.111@tcp 20000000:01000000:1.0:1789130838.039383:0:6493:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.111@tcp (null) (null) (null) 00000040:00080000:1.0:1789130838.039398:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 88 off14232 20000000:01000000:1.0:1789130838.039403:0:6493:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1789130838.039416:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 144 off14376 20000000:01000000:1.0:1789130838.039423:0:6493:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.203.111@tcp (null) (null) 00000040:00080000:1.0:1789130838.044783:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 152 off14528 20000000:01000000:1.0:1789130838.044819:0:6493:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1789130838.044852:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 136 off14664 00000040:00080000:1.0:1789130838.044872:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14888 00000040:00080000:1.0:1789130838.045004:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].34, 224 off14176 20000000:01000000:1.0:1789130838.045023:0:6493:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.111@tcp 20000000:01000000:1.0:1789130838.045025:0:6493:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.111@tcp (null) (null) (null) 00000040:00080000:1.0:1789130838.045040:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].35, 88 off14264 20000000:01000000:1.0:1789130838.045045:0:6493:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1789130838.045073:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].36, 144 off14408 20000000:01000000:1.0:1789130838.045079:0:6493:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf003 lustre-OST0001_UUID 192.168.203.111@tcp (null) (null) 00000040:00080000:1.0:1789130838.045091:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].37, 152 off14560 20000000:01000000:1.0:1789130838.045096:0:6493:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1789130838.045121:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].38, 136 off14696 00000040:00080000:1.0:1789130838.045136:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].39, 224 off14920 00000040:00080000:1.0:1789130838.045855:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14912 20000000:01000000:1.0:1789130838.045871:0:6493:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.111@tcp 20000000:01000000:1.0:1789130838.045872:0:6493:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.111@tcp (null) (null) (null) 00000040:00080000:1.0:1789130838.045887:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 88 off15000 20000000:01000000:1.0:1789130838.045892:0:6493:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1789130838.045905:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 128 off15128 20000000:01000000:1.0:1789130838.045909:0:6493:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.203.111@tcp (null) (null) 00000040:00080000:1.0:1789130838.045921:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].42, 144 off15272 20000000:01000000:1.0:1789130838.045927:0:6493:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1789130838.045939:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].43, 128 off15400 00000040:00080000:1.0:1789130838.045955:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].44, 224 off15624 20000000:01000000:1.0:1789130838.045967:0:6493:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1789130838.045970:0:6493:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1789130838.045973:0:6493:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1789130838.046016:0:6493:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:1.0:1789130838.046018:0:6493:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789130838.050329:0:9498:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 25 1->4: lustre sys.timeout 20000000:01000000:2.0:1789130838.050399:0:9498:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 25 2->4: lustre sys.timeout 00000040:00080000:2.0:1789130838.050416:0:9498:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 40 count 40 00000040:00080000:3.0:1789130838.052669:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].40, 224 off15144 00000040:00080000:3.0:1789130838.052703:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].41, 80 off15224 00000040:00080000:3.0:1789130838.052718:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].42, 224 off15448 20000000:01000000:3.0:1789130838.052729:0:6493:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1789130838.052731:0:6493:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789130838.053287:0:9499:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 26 1->4: lustre sys.timeout 20000000:01000000:3.0:1789130838.053306:0:9499:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 26 2->4: lustre sys.timeout 00000040:00080000:3.0:1789130838.053321:0:9499:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 40 count 40 00000040:00080000:1.0:1789130838.053546:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 224 off15112 00000040:00080000:1.0:1789130838.053568:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 80 off15192 00000040:00080000:1.0:1789130838.053582:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 224 off15416 20000000:01000000:1.0:1789130838.053592:0:6493:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1789130838.053594:0:6493:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1789130838.054035:0:9500:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 27 1->4: lustre sys.timeout 20000000:01000000:1.0:1789130838.054064:0:9500:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 27 2->4: lustre sys.timeout 00000040:00080000:1.0:1789130838.054074:0:9500:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:3.0:1789130838.054233:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:3.0:1789130838.054253:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 80 off9712 00000040:00080000:3.0:1789130838.054268:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9936 20000000:01000000:3.0:1789130838.054277:0:6493:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1789130838.054279:0:6493:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:3.0:1789130838.054999:0:9501:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 5 count 5 00000040:00080000:1.0:1789130838.055156:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9104 00000040:00080000:1.0:1789130838.055177:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 80 off9184 00000040:00080000:1.0:1789130838.055219:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9408 20000000:01000000:1.0:1789130838.055230:0:6493:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1789130838.055232:0:6493:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1789130838.055617:0:9502:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 36 marker 28 1->4: lustre sys.timeout 20000000:01000000:1.0:1789130838.055637:0:9502:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 38 marker 28 2->4: lustre sys.timeout 00000040:00080000:1.0:1789130838.055672:0:9502:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000040:00080000:3.0:1789130838.055800:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].45, 224 off15848 00000040:00080000:3.0:1789130838.055818:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].46, 80 off15928 00000040:00080000:3.0:1789130838.055832:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].47, 224 off16152 10000000:01000000:3.0:1789130838.055850:0:6493:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1789130838.055870:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91ddfd0b5c00/0xf3fe2838e1fc2028 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130838.055887:0:6493:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91dde19aa600/0xf3fe2838e1fc1f1e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc1f17 expref: 21 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130838.055895:0:6493:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91ddfa939c00/0xf3fe2838e1fc1f48 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc1f41 expref: 21 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130838.055901:0:6493:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91ddfa80e800/0xf3fe2838e1fc1f87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc1f80 expref: 21 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130838.055915:0:6493:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91ddfa80ee00/0xf3fe2838e1fc1fa3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc1f9c expref: 21 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130838.055921:0:6493:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91ddc0031400/0xf3fe2838e1fc1fcd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc1fc6 expref: 21 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130838.055928:0:6493:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91ddfd0b5400/0xf3fe2838e1fc1fe9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc1fe2 expref: 21 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130838.055935:0:6493:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91ddc0030600/0xf3fe2838e1fc2013 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc200c expref: 21 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130838.055944:0:6493:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91ddfd0b5c00/0xf3fe2838e1fc2028 lrc: 10/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130838.055981:0:6493:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91ddc0030600/0xf3fe2838e1fc2013 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf3fe2838e1fc200c expref: 21 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130838.055996:0:6493:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91ddc0030600/0xf3fe2838e1fc2013 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf3fe2838e1fc200c expref: 21 pid: 6493 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130838.056011:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddca180f00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6493:1876039508722048:0@lo:104: 00000100:00100000:3.0:1789130838.056072:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130838.056151:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508722048 00010000:00010000:3.0:1789130838.056155:0:6493:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91ddfd0b5400/0xf3fe2838e1fc1fe9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf3fe2838e1fc1fe2 expref: 21 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130838.056168:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508722048 00010000:00010000:3.0:1789130838.056172:0:6493:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91ddfd0b5400/0xf3fe2838e1fc1fe9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf3fe2838e1fc1fe2 expref: 21 pid: 6493 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130838.056184:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7891a40 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6493:1876039508722176:0@lo:104: 00000100:00100000:2.0:1789130838.056249:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789130838.056261:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddca180780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+3:6493:x1876039508722048:12345-0@lo:104: 00010000:00010000:2.0:1789130838.056282:0:6484:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff91dde19aa800/0xf3fe2838e1fc200c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3fe2838e1fc2013 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130838.056296:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789130838.056320:0:6493:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91ddc0031400/0xf3fe2838e1fc1fcd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf3fe2838e1fc1fc6 expref: 21 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130838.056329:0:6493:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91ddc0031400/0xf3fe2838e1fc1fcd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf3fe2838e1fc1fc6 expref: 21 pid: 6492 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130838.056338:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7892940 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6493:1876039508722304:0@lo:104: 00000100:00100000:3.0:1789130838.056381:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130838.056451:0:6483:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:0.0:1789130838.056495:0:6483:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00010000:00010000:2.0:1789130838.056852:0:6484:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789130838.056862:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddca180780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+3:6493:x1876039508722048:12345-0@lo:104: Request processed in 601us (787us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130838.056872:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789130838.056896:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508722176 00000100:00100000:2.0:1789130838.056901:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508722176 00000100:00100000:2.0:1789130838.056919:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508722304 00000100:00100000:2.0:1789130838.056922:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508722304 00000100:00100000:2.0:1789130838.056952:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789130838.056957:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc78930c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+4:6493:x1876039508722176:12345-0@lo:104: 00010000:00010000:2.0:1789130838.056966:0:6484:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff91ddfd0b5000/0xf3fe2838e1fc1fe2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3fe2838e1fc1fe9 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130838.057044:0:7442:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789130838.057052:0:7442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff91dde19aa800/0xf3fe2838e1fc200c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3fe2838e1fc2013 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130838.057061:0:7442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dde19aa800 already unused, calling callback (ffffffffc124bc20) 10000000:00010000:0.0:1789130838.057065:0:7442:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff91dde19aa800/0xf3fe2838e1fc200c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xf3fe2838e1fc2013 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130838.057074:0:7442:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff91dde19aa800/0xf3fe2838e1fc200c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xf3fe2838e1fc2013 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789130838.057082:0:7442:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff91dde19aa800/0xf3fe2838e1fc200c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xf3fe2838e1fc2013 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789130838.057089:0:7442:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789130838.057141:0:7442:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff91dde19aa800/0xf3fe2838e1fc200c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc2013 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130838.057148:0:7442:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789130838.057175:0:7442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff91dde19aa800/0xf3fe2838e1fc200c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc2013 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130838.057196:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff91dde19aa800/0xf3fe2838e1fc200c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc2013 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130838.057207:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130838.057209:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130838.057211:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789130838.057237:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddffa81680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3627:1876039508722432:0@lo:103: 00000100:00100000:1.0:1789130838.057648:0:9503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789130838.057663:0:9503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7890000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+4:6493:x1876039508722304:12345-0@lo:104: 00010000:00010000:1.0:1789130838.057679:0:9503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff91ddfa938c00/0xf3fe2838e1fc1fc6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3fe2838e1fc1fcd expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130838.060990:0:6493:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91ddfa80ee00/0xf3fe2838e1fc1fa3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf3fe2838e1fc1f9c expref: 21 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130838.061008:0:6493:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91ddfa80ee00/0xf3fe2838e1fc1fa3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf3fe2838e1fc1f9c expref: 21 pid: 6492 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130838.061023:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7890780 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6493:1876039508722560:0@lo:104: 00000100:00100000:3.0:1789130838.061075:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130838.061120:0:6483:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 3 min 2 max 56 00000100:00100000:3.0:1789130838.061128:0:6483:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_003' 00010000:00010000:3.0:1789130838.061154:0:6493:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91ddfa80e800/0xf3fe2838e1fc1f87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf3fe2838e1fc1f80 expref: 21 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130838.061162:0:6493:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91ddfa80e800/0xf3fe2838e1fc1f87 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf3fe2838e1fc1f80 expref: 21 pid: 6493 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130838.061171:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7893c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6493:1876039508722688:0@lo:104: 00000100:00100000:3.0:1789130838.061194:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789130838.061360:0:6493:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91ddfa939c00/0xf3fe2838e1fc1f48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf3fe2838e1fc1f41 expref: 21 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130838.061390:0:6493:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91ddfa939c00/0xf3fe2838e1fc1f48 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf3fe2838e1fc1f41 expref: 21 pid: 6493 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130838.061399:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7890f00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6493:1876039508722816:0@lo:104: 00000100:00100000:3.0:1789130838.061425:0:6493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789130838.061444:0:6493:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91dde19aa600/0xf3fe2838e1fc1f1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf3fe2838e1fc1f17 expref: 21 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130838.061482:0:6493:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91dde19aa600/0xf3fe2838e1fc1f1e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf3fe2838e1fc1f17 expref: 21 pid: 6493 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130838.061490:0:6493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7891680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6493:1876039508722944:0@lo:104: 00000100:00100000:3.0:1789130838.061510:0:6493:0:(client.c:2715:ptlrpc_set_wait()) set ffff91dcc6ab6900 going to sleep for 11 seconds 00000100:00100000:3.0:1789130838.061532:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddca180f00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6493:1876039508722048:0@lo:104: 00010000:00010000:2.0:1789130838.062966:0:6484:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789130838.062985:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc78930c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+4:6493:x1876039508722176:12345-0@lo:104: Request processed in 6022us (6687us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130838.062999:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789130838.063052:0:6484:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1789130838.063081:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130838.064245:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508722560 00000100:00100000:2.0:1789130838.064259:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508722560 00000100:00100000:2.0:1789130838.064378:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508722688 00000100:00100000:2.0:1789130838.064382:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508722688 00000100:00100000:2.0:1789130838.064396:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508722816 00000100:00100000:2.0:1789130838.064398:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508722816 00000100:00100000:2.0:1789130838.064406:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508722944 00000100:00100000:2.0:1789130838.064408:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508722944 00000100:00100000:2.0:1789130838.064425:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789130838.064433:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7892d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+7:6493:x1876039508722560:12345-0@lo:104: 00010000:00010000:2.0:1789130838.064453:0:6484:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff91dde19aba00/0xf3fe2838e1fc1f9c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3fe2838e1fc1fa3 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130838.064565:0:6484:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789130838.064571:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7892d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+7:6493:x1876039508722560:12345-0@lo:104: Request processed in 138us (3497us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130838.064578:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789130838.064596:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789130838.064601:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc78921c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+6:6493:x1876039508722688:12345-0@lo:104: 00000100:00100000:0.0:1789130838.064786:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130838.064996:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508722432 00000100:00100000:0.0:1789130838.065001:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508722432 00010000:00010000:0.0:1789130838.065026:0:6487:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91ddc0030600/0xf3fe2838e1fc2013 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3fe2838e1fc200c expref: 22 pid: 6493 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130838.065050:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789130838.065056:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff7c2580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+22:3627:x1876039508722432:12345-0@lo:103: 00010000:00010000:0.0:1789130838.065069:0:6487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789130838.065075:0:6487:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91ddc0030600/0xf3fe2838e1fc2013 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3fe2838e1fc200c expref: 22 pid: 6493 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130838.065391:0:6484:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff91ddfa939600/0xf3fe2838e1fc1f80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3fe2838e1fc1f87 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130838.065442:0:6484:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1789130838.065447:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc78921c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+6:6493:x1876039508722688:12345-0@lo:104: Request processed in 846us (4253us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130838.065454:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789130838.065500:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789130838.065507:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc6adc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+5:6493:x1876039508722816:12345-0@lo:104: 00010000:00010000:2.0:1789130838.065514:0:6484:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff91ddfa80fa00/0xf3fe2838e1fc1f41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3fe2838e1fc1f48 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130838.065542:0:6484:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1789130838.065546:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc6adc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+5:6493:x1876039508722816:12345-0@lo:104: Request processed in 42us (4121us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130838.065551:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789130838.065561:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789130838.065566:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc5fe92c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+4:6493:x1876039508722944:12345-0@lo:104: 00010000:00010000:2.0:1789130838.065574:0:6484:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff91ddc27e7200/0xf3fe2838e1fc1f17 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3fe2838e1fc1f1e expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130838.065606:0:6484:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1789130838.065610:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc5fe92c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+4:6493:x1876039508722944:12345-0@lo:104: Request processed in 44us (2530us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130838.065615:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:0.0:1789130838.065960:0:6487:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91ddc0030600/0xf3fe2838e1fc2013 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf3fe2838e1fc200c expref: 22 pid: 6493 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130838.065988:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91ddc0030600/0xf3fe2838e1fc2013 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf3fe2838e1fc200c expref: 22 pid: 6493 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130838.066010:0:6487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789130838.066056:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff7c2580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+21:3627:x1876039508722432:12345-0@lo:103: Request processed in 1000us (1270us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130838.066078:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00010000:0.0:1789130838.066247:0:7442:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1789130838.066256:0:7442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff91ddfd0b5000/0xf3fe2838e1fc1fe2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3fe2838e1fc1fe9 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130838.066265:0:7442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddfd0b5000 already unused, calling callback (ffffffffc124bc20) 10000000:00010000:0.0:1789130838.066269:0:7442:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff91ddfd0b5000/0xf3fe2838e1fc1fe2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xf3fe2838e1fc1fe9 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130838.066279:0:7442:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff91ddfd0b5000/0xf3fe2838e1fc1fe2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xf3fe2838e1fc1fe9 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789130838.066287:0:7442:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff91ddfd0b5000/0xf3fe2838e1fc1fe2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xf3fe2838e1fc1fe9 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789130838.066295:0:7442:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1789130838.066401:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7891a40 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6493:1876039508722176:0@lo:104: 00000100:00100000:3.0:1789130838.066419:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7890780 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6493:1876039508722560:0@lo:104: 00000100:00100000:3.0:1789130838.066429:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7893c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6493:1876039508722688:0@lo:104: 00000100:00100000:3.0:1789130838.066440:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7890f00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6493:1876039508722816:0@lo:104: 00000100:00100000:3.0:1789130838.066480:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7891680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6493:1876039508722944:0@lo:104: 00010000:00010000:0.0:1789130838.066726:0:7442:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff91ddfd0b5000/0xf3fe2838e1fc1fe2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc1fe9 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130838.066736:0:7442:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789130838.066762:0:7442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff91ddfd0b5000/0xf3fe2838e1fc1fe2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc1fe9 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130838.066769:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff91ddfd0b5000/0xf3fe2838e1fc1fe2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc1fe9 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130838.066784:0:7442:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1789130838.066787:0:7442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff91dde19aba00/0xf3fe2838e1fc1f9c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3fe2838e1fc1fa3 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130838.066806:0:7442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dde19aba00 already unused, calling callback (ffffffffc124bc20) 10000000:00010000:0.0:1789130838.066809:0:7442:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff91dde19aba00/0xf3fe2838e1fc1f9c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xf3fe2838e1fc1fa3 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130838.066816:0:7442:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff91dde19aba00/0xf3fe2838e1fc1f9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xf3fe2838e1fc1fa3 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789130838.066822:0:7442:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff91dde19aba00/0xf3fe2838e1fc1f9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xf3fe2838e1fc1fa3 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789130838.066827:0:7442:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789130838.066848:0:7442:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff91dde19aba00/0xf3fe2838e1fc1f9c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc1fa3 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130838.066854:0:7442:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789130838.066868:0:7442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff91dde19aba00/0xf3fe2838e1fc1f9c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc1fa3 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130838.066874:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff91dde19aba00/0xf3fe2838e1fc1f9c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc1fa3 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130838.066885:0:7442:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789130838.066888:0:7442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff91ddfa939600/0xf3fe2838e1fc1f80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3fe2838e1fc1f87 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130838.066893:0:7442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddfa939600 already unused, calling callback (ffffffffc124bc20) 10000000:00010000:0.0:1789130838.066896:0:7442:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff91ddfa939600/0xf3fe2838e1fc1f80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xf3fe2838e1fc1f87 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130838.066914:0:7442:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff91ddfa939600/0xf3fe2838e1fc1f80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xf3fe2838e1fc1f87 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789130838.066920:0:7442:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff91ddfa939600/0xf3fe2838e1fc1f80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xf3fe2838e1fc1f87 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789130838.066925:0:7442:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789130838.066938:0:7442:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff91ddfa939600/0xf3fe2838e1fc1f80 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc1f87 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130838.066943:0:7442:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789130838.066948:0:7442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff91ddfa939600/0xf3fe2838e1fc1f80 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc1f87 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130838.066953:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff91ddfa939600/0xf3fe2838e1fc1f80 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc1f87 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130838.066963:0:7442:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789130838.066966:0:7442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff91ddfa80fa00/0xf3fe2838e1fc1f41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3fe2838e1fc1f48 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130838.066970:0:7442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddfa80fa00 already unused, calling callback (ffffffffc124bc20) 10000000:00010000:0.0:1789130838.066973:0:7442:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff91ddfa80fa00/0xf3fe2838e1fc1f41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf3fe2838e1fc1f48 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130838.066979:0:7442:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff91ddfa80fa00/0xf3fe2838e1fc1f41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf3fe2838e1fc1f48 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789130838.066985:0:7442:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff91ddfa80fa00/0xf3fe2838e1fc1f41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf3fe2838e1fc1f48 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789130838.066996:0:7442:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789130838.067008:0:7442:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff91ddfa80fa00/0xf3fe2838e1fc1f41 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc1f48 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130838.067013:0:7442:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789130838.067018:0:7442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff91ddfa80fa00/0xf3fe2838e1fc1f41 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc1f48 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130838.067025:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff91ddfa80fa00/0xf3fe2838e1fc1f41 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc1f48 expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130838.067034:0:7442:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789130838.067038:0:7442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff91ddc27e7200/0xf3fe2838e1fc1f17 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3fe2838e1fc1f1e expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130838.067043:0:7442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddc27e7200 already unused, calling callback (ffffffffc124bc20) 10000000:00010000:0.0:1789130838.067046:0:7442:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff91ddc27e7200/0xf3fe2838e1fc1f17 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf3fe2838e1fc1f1e expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130838.067054:0:7442:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff91ddc27e7200/0xf3fe2838e1fc1f17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf3fe2838e1fc1f1e expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789130838.067060:0:7442:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff91ddc27e7200/0xf3fe2838e1fc1f17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf3fe2838e1fc1f1e expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789130838.067064:0:7442:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789130838.067076:0:7442:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff91ddc27e7200/0xf3fe2838e1fc1f17 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc1f1e expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130838.067082:0:7442:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789130838.067111:0:7442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff91ddc27e7200/0xf3fe2838e1fc1f17 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc1f1e expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130838.067119:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff91ddc27e7200/0xf3fe2838e1fc1f17 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc1f1e expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130838.067129:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130838.067131:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130838.067133:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789130838.067160:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff7c03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3625:1876039508723200:0@lo:103: 00000100:00100000:0.0:1789130838.067224:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130838.067281:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789130838.067288:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff7c3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3625:1876039508723328:0@lo:103: 00000100:00100000:0.0:1789130838.067486:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130838.067536:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508723200 00000100:00100000:0.0:1789130838.067545:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508723200 00010000:00010000:0.0:1789130838.067576:0:8431:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91ddfa80ee00/0xf3fe2838e1fc1fa3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3fe2838e1fc1f9c expref: 21 pid: 6492 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130838.067604:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508723328 00000100:00100000:0.0:1789130838.067607:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508723328 00010000:00010000:0.0:1789130838.067702:0:8431:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91ddfa80e800/0xf3fe2838e1fc1f87 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3fe2838e1fc1f80 expref: 22 pid: 6493 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130838.067729:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789130838.067740:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddca0f92c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+22:3625:x1876039508723200:12345-0@lo:103: 00010000:00010000:0.0:1789130838.067755:0:8431:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789130838.067761:0:8431:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91ddfa80ee00/0xf3fe2838e1fc1fa3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3fe2838e1fc1f9c expref: 22 pid: 6492 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130838.067785:0:8431:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91ddfa80ee00/0xf3fe2838e1fc1fa3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf3fe2838e1fc1f9c expref: 22 pid: 6492 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130838.067805:0:8431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91ddfa80ee00/0xf3fe2838e1fc1fa3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf3fe2838e1fc1f9c expref: 22 pid: 6492 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130838.067823:0:8431:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789130838.067863:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddca0f92c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+21:3625:x1876039508723200:12345-0@lo:103: Request processed in 125us (639us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130838.067871:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789130838.067891:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789130838.067898:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff752940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+20:3625:x1876039508723328:12345-0@lo:103: 00010000:00010000:0.0:1789130838.067906:0:8431:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789130838.067911:0:8431:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91ddfa80e800/0xf3fe2838e1fc1f87 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3fe2838e1fc1f80 expref: 20 pid: 6493 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130838.067921:0:8431:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91ddfa80e800/0xf3fe2838e1fc1f87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf3fe2838e1fc1f80 expref: 20 pid: 6493 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130838.067933:0:8431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91ddfa80e800/0xf3fe2838e1fc1f87 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf3fe2838e1fc1f80 expref: 20 pid: 6493 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130838.067942:0:8431:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789130838.067967:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff752940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+19:3625:x1876039508723328:12345-0@lo:103: Request processed in 70us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130838.067973:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789130838.068023:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff7c3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3625:1876039508723328:0@lo:103: 00000100:00100000:0.0:1789130838.068032:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff7c03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3625:1876039508723200:0@lo:103: 00000100:00100000:0.0:1789130838.068068:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff7c1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3627:1876039508723456:0@lo:103: 00000100:00100000:2.0:1789130838.068277:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff7c21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3628:1876039508723072:0@lo:103: 00000100:00100000:0.0:1789130838.068340:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130838.068379:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddffa81680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3627:1876039508722432:0@lo:103: 00000100:00100000:0.0:1789130838.068402:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508723456 00000100:00100000:0.0:1789130838.068406:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508723456 00010000:00010000:0.0:1789130838.068423:0:8431:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91ddfa939c00/0xf3fe2838e1fc1f48 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3fe2838e1fc1f41 expref: 19 pid: 6493 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130838.068443:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789130838.068449:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc33adc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+19:3627:x1876039508723456:12345-0@lo:103: 00010000:00010000:0.0:1789130838.068475:0:8431:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789130838.068480:0:8431:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91ddfa939c00/0xf3fe2838e1fc1f48 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3fe2838e1fc1f41 expref: 19 pid: 6493 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130838.068488:0:8431:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91ddfa939c00/0xf3fe2838e1fc1f48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf3fe2838e1fc1f41 expref: 19 pid: 6493 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130838.068499:0:8431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91ddfa939c00/0xf3fe2838e1fc1f48 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf3fe2838e1fc1f41 expref: 19 pid: 6493 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130838.068509:0:8431:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789130838.068536:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc33adc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+18:3627:x1876039508723456:12345-0@lo:103: Request processed in 88us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130838.068543:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789130838.068593:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff7c1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3627:1876039508723456:0@lo:103: 00010000:00010000:1.0:1789130838.068687:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130838.068697:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130838.068766:0:9503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789130838.068778:0:9503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7890000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+3:6493:x1876039508722304:12345-0@lo:104: Request processed in 11116us (12393us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130838.068789:0:9503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00010000:0.0:1789130838.069200:0:7442:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789130838.069209:0:7442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff91ddfa938c00/0xf3fe2838e1fc1fc6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3fe2838e1fc1fcd expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130838.069234:0:7442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddfa938c00 already unused, calling callback (ffffffffc124bc20) 10000000:00010000:0.0:1789130838.069239:0:7442:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff91ddfa938c00/0xf3fe2838e1fc1fc6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf3fe2838e1fc1fcd expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130838.069247:0:7442:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff91ddfa938c00/0xf3fe2838e1fc1fc6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf3fe2838e1fc1fcd expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789130838.069254:0:7442:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff91ddfa938c00/0xf3fe2838e1fc1fc6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf3fe2838e1fc1fcd expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789130838.069260:0:7442:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789130838.069310:0:7442:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff91ddfa938c00/0xf3fe2838e1fc1fc6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc1fcd expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130838.069316:0:7442:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789130838.069333:0:7442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff91ddfa938c00/0xf3fe2838e1fc1fc6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc1fcd expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130838.069340:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff91ddfa938c00/0xf3fe2838e1fc1fc6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc1fcd expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130838.069367:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130838.069369:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130838.069371:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789130838.069380:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789130838.069392:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff752580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3626:1876039508723712:0@lo:103: 00000100:00100000:0.0:1789130838.069436:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130838.069505:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508723712 00000100:00100000:0.0:1789130838.069512:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508723712 00010000:00010000:0.0:1789130838.069544:0:6487:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91ddc0031400/0xf3fe2838e1fc1fcd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3fe2838e1fc1fc6 expref: 18 pid: 6492 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130838.069571:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789130838.069578:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff752940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+18:3626:x1876039508723712:12345-0@lo:103: 00010000:00010000:0.0:1789130838.069587:0:6487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789130838.069591:0:6487:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91ddc0031400/0xf3fe2838e1fc1fcd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3fe2838e1fc1fc6 expref: 18 pid: 6492 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130838.069601:0:6487:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91ddc0031400/0xf3fe2838e1fc1fcd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf3fe2838e1fc1fc6 expref: 18 pid: 6492 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130838.069615:0:6487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789130838.069794:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff752940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+18:3626:x1876039508723712:12345-0@lo:103: Request processed in 216us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130838.069804:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789130838.069841:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff752580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3626:1876039508723712:0@lo:103: 00010000:00010000:3.0:1789130838.070193:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91ddc0031400/0xf3fe2838e1fc1fcd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf3fe2838e1fc1fc6 expref: 17 pid: 6492 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130838.070208:0:6493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7892940 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6493:1876039508722304:0@lo:104: 00010000:00010000:3.0:1789130838.070250:0:6493:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91ddfd0b5c00/0xf3fe2838e1fc2028 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130838.070844:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130838.070943:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddca0f8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3628:1876039508723584:0@lo:103: 00000100:00100000:2.0:1789130838.070983:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130838.071083:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508723072 00000100:00100000:0.0:1789130838.071160:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508723072 00010000:00010000:0.0:1789130838.071193:0:8431:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91ddfd0b5400/0xf3fe2838e1fc1fe9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3fe2838e1fc1fe2 expref: 17 pid: 6493 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130838.071261:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508723584 00000100:00100000:0.0:1789130838.071265:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508723584 00010000:00010000:0.0:1789130838.071278:0:8431:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91dde19aa600/0xf3fe2838e1fc1f1e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3fe2838e1fc1f17 expref: 18 pid: 6493 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130838.071419:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789130838.071433:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc5fe9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+18:3628:x1876039508723072:12345-0@lo:103: 00010000:00010000:2.0:1789130838.071449:0:6487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789130838.071455:0:6487:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91ddfd0b5400/0xf3fe2838e1fc1fe9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3fe2838e1fc1fe2 expref: 18 pid: 6493 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130838.071515:0:6487:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91ddfd0b5400/0xf3fe2838e1fc1fe9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf3fe2838e1fc1fe2 expref: 18 pid: 6493 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130838.071533:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91ddfd0b5400/0xf3fe2838e1fc1fe9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf3fe2838e1fc1fe2 expref: 18 pid: 6493 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130838.071547:0:6487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789130838.071588:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc5fe9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+17:3628:x1876039508723072:12345-0@lo:103: Request processed in 160us (746us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130838.071596:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789130838.071616:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789130838.071635:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc5fe9680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+16:3628:x1876039508723584:12345-0@lo:103: 00010000:00010000:2.0:1789130838.071661:0:6487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789130838.071666:0:6487:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91dde19aa600/0xf3fe2838e1fc1f1e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3fe2838e1fc1f17 expref: 16 pid: 6493 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130838.071674:0:6487:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91dde19aa600/0xf3fe2838e1fc1f1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf3fe2838e1fc1f17 expref: 16 pid: 6493 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130838.071684:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91dde19aa600/0xf3fe2838e1fc1f1e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf3fe2838e1fc1f17 expref: 16 pid: 6493 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130838.071704:0:6487:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91ddfd0b5c00/0xf3fe2838e1fc2028 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130838.071714:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91ddfd0b5c00/0xf3fe2838e1fc2028 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130838.071742:0:6487:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91ddfd0b5c00/0xf3fe2838e1fc2028 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130838.071749:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91ddfd0b5c00/0xf3fe2838e1fc2028 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130838.071754:0:6487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91ddfd0b5c00/0xf3fe2838e1fc2028 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130838.071761:0:6487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91ddfd0b5c00/0xf3fe2838e1fc2028 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130838.071768:0:6487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddfd0b5c00 already unused, calling callback (ffffffffc0c4e550) 00010000:00010000:2.0:1789130838.071772:0:6487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91ddfd0b5c00/0xf3fe2838e1fc2028 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130838.071781:0:6487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91ddfd0b5c00/0xf3fe2838e1fc2028 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130838.071795:0:6487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91ddfd0b5c00/0xf3fe2838e1fc2028 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130838.071808:0:6487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789130838.071830:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc5fe9680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+15:3628:x1876039508723584:12345-0@lo:103: Request processed in 197us (847us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130838.071844:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789130838.071880:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff7c21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3628:1876039508723072:0@lo:103: 00000100:00100000:2.0:1789130838.071889:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddca0f8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3628:1876039508723584:0@lo:103: 00010000:00010000:3.0:1789130838.075059:0:6493:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91ddfd0b5c00/0xf3fe2838e1fc2028 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130838.075107:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91ddfd0b5c00/0xf3fe2838e1fc2028 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130838.075116:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91ddfd0b5c00/0xf3fe2838e1fc2028 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789130838.075139:0:6493:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1789130838.084447:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddcf4fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+14:9492:x1876039508721920:12345-0@lo:253: Request processed in 45722us (46904us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130838.084493:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1789130838.084695:0:9492:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc5fe8f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:9492:1876039508721920:0@lo:253: 10000000:01000000:2.0:1789130838.084723:0:9492:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1789130838.084728:0:9492:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789130838.084729:0:9492:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789130838.084730:0:9492:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789130838.084731:0:9492:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:2.0:1789130838.084732:0:9492:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789130838.084734:0:9492:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789130838.084735:0:9492:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789130838.084738:0:9492:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1789130838.084740:0:9492:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789130838.084742:0:9492:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789130838.084777:0:9492:0:(tgt_mount.c:101:server_register_mount()) register mount ffff91ddff549800 from lustre-OST0001 10000000:01000000:2.0:1789130838.084816:0:9492:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1789130838.084819:0:9492:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1789130838.084831:0:9492:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff91ddd10e8000 local copy 10000000:01000000:2.0:1789130838.084835:0:9492:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789130838.084886:0:9492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff91ddc27e7800/0xf3fe2838e1fc202f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130838.084898:0:9492:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.111@tcp lock: ffff91ddc27e7800/0xf3fe2838e1fc202f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130838.084909:0:9492:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff91ddc27e7800/0xf3fe2838e1fc202f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130838.084932:0:9492:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc5fe8f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:9492:1876039508723840:0@lo:101: 00000100:00100000:2.0:1789130838.085001:0:9492:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130838.085045:0:9492:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddff84c840 going to sleep for 11 seconds 00000100:00100000:0.0:1789130838.085131:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508723840 00000100:00100000:0.0:1789130838.085140:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508723840 00000100:00100000:0.0:1789130838.085198:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1789130838.085209:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddcf4fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+14:9492:x1876039508723840:12345-0@lo:101: 00010000:00010000:0.0:1789130838.085233:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130838.085248:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91ddc0030600/0xf3fe2838e1fc2036 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3fe2838e1fc202f expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130838.085275:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91ddc0030600/0xf3fe2838e1fc2036 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3fe2838e1fc202f expref: 15 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130838.085285:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91ddc0030600/0xf3fe2838e1fc2036 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc202f expref: 15 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130838.085295:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ddc0030600, rc 0) 00000100:00100000:0.0:1789130838.085353:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddcf4fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+15:9492:x1876039508723840:12345-0@lo:101: Request processed in 146us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130838.085359:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1789130838.085434:0:9492:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc5fe8f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:9492:1876039508723840:0@lo:101: 00010000:00010000:1.0:1789130838.085486:0:9492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff91ddc27e7800/0xf3fe2838e1fc202f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xf3fe2838e1fc2036 expref: -99 pid: 9492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130838.085497:0:9492:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff91ddc27e7800/0xf3fe2838e1fc202f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xf3fe2838e1fc2036 expref: -99 pid: 9492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130838.085629:0:9492:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc6bee580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:9492:1876039508723968:0@lo:501: 00000100:00100000:1.0:1789130838.085688:0:9492:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130838.085736:0:9492:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddff7a83c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789130838.085740:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508723968 00000100:00100000:3.0:1789130838.085748:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508723968 00000100:00100000:3.0:1789130838.085793:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1789130838.085802:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddcf4f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+15:9492:x1876039508723968:12345-0@lo:501: 00000100:00100000:3.0:1789130838.085897:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddcf4f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+15:9492:x1876039508723968:12345-0@lo:501: Request processed in 97us (208us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789130838.085904:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1789130838.085938:0:9492:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc6bee580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:9492:1876039508723968:0@lo:501: 10000000:01000000:1.0:1789130838.085961:0:9492:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.111@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1789130838.085996:0:9492:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.111@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1789130838.086002:0:9492:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff91ddc27e7800/0xf3fe2838e1fc202f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xf3fe2838e1fc2036 expref: -99 pid: 9492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130838.086010:0:9492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff91ddc27e7800/0xf3fe2838e1fc202f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xf3fe2838e1fc2036 expref: -99 pid: 9492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130838.086017:0:9492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.111@tcp lock: ffff91ddc27e7800/0xf3fe2838e1fc202f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xf3fe2838e1fc2036 expref: -99 pid: 9492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130838.086044:0:9492:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1789130838.086072:0:9492:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff91ddff549800 10000000:01000000:1.0:1789130838.086077:0:9492:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789130838.086082:0:9492:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1789130838.086085:0:9492:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789130838.086089:0:9492:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1789130838.086092:0:9492:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1789130838.086129:0:9492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff91dde19aa200/0xf3fe2838e1fc203d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130838.086138:0:9492:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff91dde19aa200/0xf3fe2838e1fc203d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130838.086146:0:9492:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff91dde19aa200/0xf3fe2838e1fc203d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130838.086158:0:9492:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc6bee580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:9492:1876039508724096:0@lo:101: 00010000:00010000:2.0:1789130838.086209:0:6489:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789130838.086218:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff91ddc27e7800/0xf3fe2838e1fc202f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xf3fe2838e1fc2036 expref: -99 pid: 9492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130838.086227:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddc27e7800 already unused, calling callback (ffffffffc124bc20) 10000000:00010000:2.0:1789130838.086231:0:6489:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff91ddc27e7800/0xf3fe2838e1fc202f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xf3fe2838e1fc2036 expref: -99 pid: 9492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130838.086241:0:6489:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff91ddc27e7800/0xf3fe2838e1fc202f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xf3fe2838e1fc2036 expref: -99 pid: 9492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789130838.086248:0:6489:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff91ddc27e7800/0xf3fe2838e1fc202f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xf3fe2838e1fc2036 expref: -99 pid: 9492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789130838.086255:0:6489:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789130838.086283:0:6489:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff91ddc27e7800/0xf3fe2838e1fc202f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xf3fe2838e1fc2036 expref: -99 pid: 9492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130838.086290:0:6489:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789130838.086348:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc5fe8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3626:1876039508724224:0@lo:103: 00010000:00010000:2.0:1789130838.086391:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff91ddc27e7800/0xf3fe2838e1fc202f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xf3fe2838e1fc2036 expref: -99 pid: 9492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130838.086399:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff91ddc27e7800/0xf3fe2838e1fc202f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xf3fe2838e1fc2036 expref: -99 pid: 9492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130838.086415:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130838.086417:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130838.086419:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789130838.095247:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130838.095308:0:9492:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130838.095411:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508724096 00000100:00100000:3.0:1789130838.095426:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508724096 00000100:00100000:3.0:1789130838.095533:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1789130838.095545:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddcf4f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+15:9492:x1876039508724096:12345-0@lo:101: 00010000:00010000:3.0:1789130838.095567:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130838.095591:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91ddfd0b5c00/0xf3fe2838e1fc2044 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3fe2838e1fc203d expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130838.095652:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91ddfd0b5c00/0xf3fe2838e1fc2044 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3fe2838e1fc203d expref: 16 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130838.095665:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91ddfd0b5c00/0xf3fe2838e1fc2044 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc203d expref: 16 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130838.095676:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ddfd0b5c00, rc 0) 00000100:00100000:3.0:1789130838.095738:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddcf4f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+16:9492:x1876039508724096:12345-0@lo:101: Request processed in 196us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130838.095747:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1789130838.096483:0:9492:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddff7a8a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789130838.096526:0:9492:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc6bee580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:9492:1876039508724096:0@lo:101: 00010000:00010000:3.0:1789130838.096552:0:9492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff91dde19aa200/0xf3fe2838e1fc203d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc2044 expref: -99 pid: 9492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130838.096565:0:9492:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff91dde19aa200/0xf3fe2838e1fc203d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3fe2838e1fc2044 expref: -99 pid: 9492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130838.096730:0:9492:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7892940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:9492:1876039508724352:0@lo:501: 00000100:00100000:3.0:1789130838.096779:0:9492:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130838.096803:0:9492:0:(client.c:2715:ptlrpc_set_wait()) set ffff91dcc6ab6b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789130838.096828:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508724352 00000100:00100000:3.0:1789130838.096835:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508724352 00000100:00100000:3.0:1789130838.096878:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1789130838.096888:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddcf4fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+16:9492:x1876039508724352:12345-0@lo:501: 00000100:00100000:2.0:1789130838.097346:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508724224 00000100:00100000:2.0:1789130838.097369:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508724224 00000100:00100000:2.0:1789130838.097413:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789130838.097421:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff752580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+17:3626:x1876039508724224:12345-0@lo:103: 00010000:00010000:2.0:1789130838.097434:0:6487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789130838.097480:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91ddc0030600/0xf3fe2838e1fc2036 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf3fe2838e1fc202f expref: 17 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130838.097499:0:6487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789130838.097536:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff752580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+16:3626:x1876039508724224:12345-0@lo:103: Request processed in 117us (2300us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130838.097543:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789130838.097676:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddcf4fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+15:9492:x1876039508724352:12345-0@lo:501: Request processed in 790us (896us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130838.097693:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1789130838.097801:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc5fe8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3626:1876039508724224:0@lo:103: 00000100:00100000:2.0:1789130838.097924:0:9492:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7892940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:9492:1876039508724352:0@lo:501: 00000100:00100000:2.0:1789130838.097964:0:9492:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc5fe8f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:9492:1876039508724480:0@lo:503: 00000100:00100000:2.0:1789130838.098011:0:9492:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130838.098036:0:9492:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddff84c000 going to sleep for 11 seconds 00000100:00100000:3.0:1789130838.098080:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508724480 00000100:00100000:3.0:1789130838.098084:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508724480 00000100:00100000:3.0:1789130838.098215:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1789130838.098222:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddcf7c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+15:9492:x1876039508724480:12345-0@lo:503: 00000100:00100000:3.0:1789130838.098330:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddcf7c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+15:9492:x1876039508724480:12345-0@lo:503: Request processed in 108us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130838.098336:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1789130838.098446:0:9492:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc5fe8f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:9492:1876039508724480:0@lo:503: 00000040:00080000:0.0:1789130838.098779:0:9492:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789130838.098866:0:9492:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff753840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:9492:1876039508724608:0@lo:502: 00000100:00100000:0.0:1789130838.098913:0:9492:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130838.099142:0:9492:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddf5cf1900 going to sleep for 11 seconds 00000100:00100000:2.0:1789130838.099239:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508724608 00000100:00100000:2.0:1789130838.099244:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508724608 00000100:00100000:2.0:1789130838.099276:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1789130838.099284:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddcf7c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+15:9492:x1876039508724608:12345-0@lo:502: 00000100:00100000:2.0:1789130838.099529:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddcf7c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+15:9492:x1876039508724608:12345-0@lo:502: Request processed in 244us (615us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130838.099536:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1789130838.099676:0:9492:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff753840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:9492:1876039508724608:0@lo:502: 00000040:00080000:0.0:1789130838.100013:0:9492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1789130838.100047:0:9492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1789130838.100062:0:9492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1789130838.100076:0:9492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1789130838.100180:0:9492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1789130838.100209:0:9492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1789130838.100253:0:9492:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff753840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:9492:1876039508724736:0@lo:502: 00000100:00100000:0.0:1789130838.100383:0:9492:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130838.100503:0:9492:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddf5cf1900 going to sleep for 11 seconds 00000100:00100000:2.0:1789130838.100638:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508724736 00000100:00100000:2.0:1789130838.100646:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508724736 00000100:00100000:2.0:1789130838.100799:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1789130838.100820:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddcf7cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+15:9492:x1876039508724736:12345-0@lo:502: 00000100:00100000:0.0:1789130838.103009:0:9492:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff753840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:9492:1876039508724736:0@lo:502: 00000040:00080000:0.0:1789130838.103175:0:9492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1789130838.103194:0:9492:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 8 00000100:00100000:2.0:1789130838.103978:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddcf7cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+15:9492:x1876039508724736:12345-0@lo:502: Request processed in 276us (772us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130838.104007:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000020:01000000:3.0:1789130838.106275:0:9505:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789130838.106292:0:9505:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:3.0:1789130838.106300:0:9505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789130838.106303:0:9505:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1789130838.106320:0:9505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789130838.106344:0:9505:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff91ddff719a48) 00000020:00000080:3.0:1789130838.106379:0:9505:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type obdfilter with refcount 2 00000020:00000080:3.0:1789130838.106387:0:9505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789130838.106506:0:9505:0:(tgt_mount.c:153:server_get_mount()) get mount ffff91ddff549800 from lustre-OST0001, refs=2 00080000:01000000:3.0:1789130838.106517:0:9505:0:(osd_handler.c:8895:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789130838.106525:0:9505:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xf3fe2838e1fc2052 00010000:00010000:3.0:1789130838.113032:0:9505:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:02000400:3.0:1789130838.113902:0:9505:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:3.0:1789130838.117000:0:9505:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1789130838.117926:0:9505:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:3.0:1789130838.122750:0:9505:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:3.0:1789130838.122974:0:9505:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:3.0:1789130838.129234:0:9505:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0001: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:0.0:1789130838.134042:0:9505:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1789130838.134060:0:9505:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789130838.134069:0:9505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789130838.134071:0:9505:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1789130838.134080:0:9505:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789130838.134105:0:9505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789130838.134107:0:9505:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789130838.134112:0:9505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789130838.134114:0:9505:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789130838.134135:0:9505:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789130838.134138:0:9505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789130838.134140:0:9505:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000040:00080000:0.0:1789130838.134144:0:9505:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1789130838.136452:0:9492:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:3.0:1789130838.136540:0:9492:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1789130838.136571:0:9492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff91dde19aa200/0xf3fe2838e1fc203d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc2044 expref: -99 pid: 9492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130838.136586:0:9492:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff91dde19aa200/0xf3fe2838e1fc203d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc2044 expref: -99 pid: 9492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789130838.136595:0:9492:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91ddff549800 from 1 10000000:01000000:3.0:1789130838.136599:0:9492:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789130838.136661:0:9492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff91ddfd0b5800/0xf3fe2838e1fc2059 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130838.136670:0:9492:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff91ddfd0b5800/0xf3fe2838e1fc2059 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130838.136681:0:9492:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff91ddfd0b5800/0xf3fe2838e1fc2059 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130838.136710:0:9492:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7891680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:9492:1876039508724864:0@lo:101: 00000100:00100000:3.0:1789130838.136802:0:9492:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130838.136861:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508724864 00000100:00100000:3.0:1789130838.136870:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508724864 00000100:00100000:3.0:1789130838.136938:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1789130838.136948:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8606050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+15:9492:x1876039508724864:12345-0@lo:101: 00010000:00010000:3.0:1789130838.136965:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130838.136980:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91ddfd0b4a00/0xf3fe2838e1fc2060 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3fe2838e1fc2059 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130838.137009:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91ddfd0b4a00/0xf3fe2838e1fc2060 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3fe2838e1fc2059 expref: 16 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130838.137034:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91ddfd0b4a00/0xf3fe2838e1fc2060 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc2059 expref: 16 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130838.137043:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ddfd0b4a00, rc 0) 00000100:00100000:3.0:1789130838.137081:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8606050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+16:9492:x1876039508724864:12345-0@lo:101: Request processed in 136us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130838.137108:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1789130838.137166:0:9492:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddc4b62000 going to sleep for 11 seconds 00000100:00100000:3.0:1789130838.137193:0:9492:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7891680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:9492:1876039508724864:0@lo:101: 00010000:00010000:3.0:1789130838.137210:0:9492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff91ddfd0b5800/0xf3fe2838e1fc2059 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc2060 expref: -99 pid: 9492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130838.137219:0:9492:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff91ddfd0b5800/0xf3fe2838e1fc2059 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3fe2838e1fc2060 expref: -99 pid: 9492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130838.137510:0:9492:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7891680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:9492:1876039508724992:0@lo:501: 00000100:00100000:3.0:1789130838.137544:0:9492:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130838.137570:0:9492:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddc4b62000 going to sleep for 11 seconds 00000100:00100000:3.0:1789130838.137591:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508724992 00000100:00100000:3.0:1789130838.137595:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508724992 00000100:00100000:3.0:1789130838.137648:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1789130838.137656:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8604c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+16:9492:x1876039508724992:12345-0@lo:501: 00000100:00100000:3.0:1789130838.137766:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8604c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+16:9492:x1876039508724992:12345-0@lo:501: Request processed in 110us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130838.137774:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1789130838.137816:0:9492:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7891680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:9492:1876039508724992:0@lo:501: 00000100:00100000:3.0:1789130838.137855:0:9492:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7891680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:9492:1876039508725120:0@lo:503: 00000100:00100000:3.0:1789130838.137894:0:9492:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130838.137914:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508725120 00000100:00100000:3.0:1789130838.137917:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508725120 00000100:00100000:3.0:1789130838.137939:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1789130838.137946:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8605050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+16:9492:x1876039508725120:12345-0@lo:503: 00000100:00100000:3.0:1789130838.138025:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8605050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+16:9492:x1876039508725120:12345-0@lo:503: Request processed in 79us (129us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130838.138031:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1789130838.138071:0:9492:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddc4b62000 going to sleep for 11 seconds 00000100:00100000:3.0:1789130838.138808:0:9492:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7891680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:9492:1876039508725120:0@lo:503: 00000040:00080000:3.0:1789130838.139856:0:9492:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789130838.139972:0:9492:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7891680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:9492:1876039508725248:0@lo:502: 00000100:00100000:3.0:1789130838.140066:0:9492:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130838.140142:0:9492:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddc4b62000 going to sleep for 11 seconds 00000100:00100000:2.0:1789130838.141210:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508725248 00000100:00100000:2.0:1789130838.141224:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508725248 00000100:00100000:2.0:1789130838.141290:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1789130838.141302:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8607450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+16:9492:x1876039508725248:12345-0@lo:502: 00000100:00100000:2.0:1789130838.141596:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8607450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+16:9492:x1876039508725248:12345-0@lo:502: Request processed in 296us (1529us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130838.141604:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1789130838.141787:0:9492:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7891680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:9492:1876039508725248:0@lo:502: 00000040:00080000:3.0:1789130838.142071:0:9492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1789130838.143821:0:9492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1789130838.143898:0:9492:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7891680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:9492:1876039508725376:0@lo:502: 00000100:00100000:3.0:1789130838.144012:0:9492:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130838.144072:0:9492:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddc4b62000 going to sleep for 11 seconds 00000100:00100000:2.0:1789130838.144821:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508725376 00000100:00100000:2.0:1789130838.144835:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508725376 00000100:00100000:2.0:1789130838.144908:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1789130838.144922:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8607850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+16:9492:x1876039508725376:12345-0@lo:502: 00000100:00100000:1.0:1789130838.145230:0:9492:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7891680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:9492:1876039508725376:0@lo:502: 00000040:00080000:1.0:1789130838.145402:0:9492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1789130838.145424:0:9492:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000100:00100000:2.0:1789130838.146264:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8607850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+16:9492:x1876039508725376:12345-0@lo:502: Request processed in 1339us (2246us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130838.146276:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000020:01000000:3.0:1789130838.150669:0:9509:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789130838.150691:0:9509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789130838.150694:0:9509:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789130838.150992:0:9509:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff91ddff549800 00000020:00000080:3.0:1789130838.150997:0:9509:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789130838.151024:0:9509:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789130838.151027:0:9509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789130838.151028:0:9509:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1789130838.151031:0:9509:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1789130838.151220:0:9492:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1789130838.151274:0:9492:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789130838.151305:0:9492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff91ddfd0b5800/0xf3fe2838e1fc2059 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc2060 expref: -99 pid: 9492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130838.151482:0:9492:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff91ddfd0b5800/0xf3fe2838e1fc2059 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc2060 expref: -99 pid: 9492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789130838.153633:0:9492:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789130838.153649:0:9492:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff91ddff549800 10000000:01000000:3.0:1789130838.153653:0:9492:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff91ddff549800 10000000:01000000:3.0:1789130838.153657:0:9492:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789130838.153666:0:9492:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff91ddff549800 from 1 10000000:01000000:3.0:1789130838.153669:0:9492:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789130838.153726:0:9492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff91ddfd0b4600/0xf3fe2838e1fc2067 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130838.153738:0:9492:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff91ddfd0b4600/0xf3fe2838e1fc2067 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130838.153750:0:9492:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff91ddfd0b4600/0xf3fe2838e1fc2067 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130838.153780:0:9492:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7890f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:9492:1876039508725504:0@lo:101: 00000100:00100000:3.0:1789130838.153871:0:9492:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130838.153924:0:9492:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddd029a300 going to sleep for 11 seconds 00000100:00100000:2.0:1789130838.154069:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508725504 00000100:00100000:2.0:1789130838.154080:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508725504 00000100:00100000:2.0:1789130838.154157:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1789130838.154169:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8606c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+16:9492:x1876039508725504:12345-0@lo:101: 00010000:00010000:2.0:1789130838.154185:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130838.154201:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91ddc27e7800/0xf3fe2838e1fc206e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3fe2838e1fc2067 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130838.154227:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91ddc27e7800/0xf3fe2838e1fc206e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3fe2838e1fc2067 expref: 17 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130838.154239:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91ddc27e7800/0xf3fe2838e1fc206e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc2067 expref: 17 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130838.154274:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ddc27e7800, rc 0) 00000100:00100000:2.0:1789130838.154557:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8606c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+17:9492:x1876039508725504:12345-0@lo:101: Request processed in 390us (686us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130838.154566:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1789130838.154669:0:9492:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7890f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:9492:1876039508725504:0@lo:101: 00010000:00010000:0.0:1789130838.154689:0:9492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff91ddfd0b4600/0xf3fe2838e1fc2067 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc206e expref: -99 pid: 9492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130838.154698:0:9492:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff91ddfd0b4600/0xf3fe2838e1fc2067 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3fe2838e1fc206e expref: -99 pid: 9492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130838.154821:0:9492:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff753840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:9492:1876039508725632:0@lo:501: 00000100:00100000:0.0:1789130838.154857:0:9492:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130838.154897:0:9492:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddf5cf1900 going to sleep for 11 seconds 00000100:00100000:2.0:1789130838.155005:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508725632 00000100:00100000:2.0:1789130838.155010:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508725632 00000100:00100000:2.0:1789130838.155049:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1789130838.155056:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8605450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+17:9492:x1876039508725632:12345-0@lo:501: 00000100:00100000:2.0:1789130838.155205:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8605450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+17:9492:x1876039508725632:12345-0@lo:501: Request processed in 149us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130838.155212:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1789130838.155444:0:9492:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff753840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:9492:1876039508725632:0@lo:501: 00000100:00100000:0.0:1789130838.155521:0:9492:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff753840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:9492:1876039508725760:0@lo:503: 00000100:00100000:0.0:1789130838.155570:0:9492:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130838.155597:0:9492:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddf5cf1900 going to sleep for 11 seconds 00000100:00100000:3.0:1789130838.155729:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508725760 00000100:00100000:3.0:1789130838.155738:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508725760 00000100:00100000:3.0:1789130838.155779:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1789130838.155787:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8604450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+17:9492:x1876039508725760:12345-0@lo:503: 00000100:00100000:3.0:1789130838.155884:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8604450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+17:9492:x1876039508725760:12345-0@lo:503: Request processed in 97us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130838.155890:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1789130838.156005:0:9492:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff753840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:9492:1876039508725760:0@lo:503: 00000040:00080000:0.0:1789130838.156515:0:9492:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789130838.156592:0:9492:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff753840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:9492:1876039508725888:0@lo:502: 00000100:00100000:0.0:1789130838.156904:0:9492:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130838.156944:0:9492:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddf5cf1900 going to sleep for 11 seconds 00000100:00100000:3.0:1789130838.157015:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508725888 00000100:00100000:3.0:1789130838.157028:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508725888 00000100:00100000:3.0:1789130838.157073:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1789130838.157081:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8607c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+17:9492:x1876039508725888:12345-0@lo:502: 00000100:00100000:3.0:1789130838.157411:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8607c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+17:9492:x1876039508725888:12345-0@lo:502: Request processed in 329us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130838.157419:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1789130838.157712:0:9492:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff753840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:9492:1876039508725888:0@lo:502: 00000040:00080000:0.0:1789130838.157986:0:9492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1789130838.158018:0:9492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1789130838.158031:0:9492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1789130838.158045:0:9492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1789130838.158058:0:9492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1789130838.158072:0:9492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1789130838.158153:0:9492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1789130838.158236:0:9492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1789130838.158249:0:9492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1789130838.158931:0:9492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1789130838.158963:0:9492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1789130838.158980:0:9492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1789130838.158994:0:9492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1789130838.159008:0:9492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1789130838.159021:0:9492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1789130838.159032:0:9492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1789130838.159045:0:9492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1789130838.159084:0:9492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1789130838.159121:0:9492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1789130838.159147:0:9492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1789130838.159174:0:9492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1789130838.159191:0:9492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1789130838.159205:0:9492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1789130838.159220:0:9492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1789130838.159234:0:9492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:0.0:1789130838.159247:0:9492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:0.0:1789130838.159270:0:9492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:0.0:1789130838.159282:0:9492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:0.0:1789130838.159293:0:9492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:0.0:1789130838.159303:0:9492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:0.0:1789130838.159378:0:9492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:0.0:1789130838.159392:0:9492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:0.0:1789130838.159402:0:9492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:0.0:1789130838.159423:0:9492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:0.0:1789130838.159436:0:9492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:0.0:1789130838.159446:0:9492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:0.0:1789130838.159485:0:9492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000040:00080000:0.0:1789130838.159501:0:9492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:0.0:1789130838.159512:0:9492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14912 00000040:00080000:0.0:1789130838.159523:0:9492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 88 off15000 00000040:00080000:0.0:1789130838.159533:0:9492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 128 off15128 00000040:00080000:0.0:1789130838.159544:0:9492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 144 off15272 00000040:00080000:0.0:1789130838.159554:0:9492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 128 off15400 00000040:00080000:0.0:1789130838.159564:0:9492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 224 off15624 00000040:00080000:0.0:1789130838.159575:0:9492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15848 00000040:00080000:0.0:1789130838.159585:0:9492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 80 off15928 00000100:00100000:0.0:1789130838.159752:0:9492:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff753840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:9492:1876039508726016:0@lo:502: 00000100:00100000:0.0:1789130838.159843:0:9492:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130838.159902:0:9492:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddf5cf1900 going to sleep for 11 seconds 00000100:00100000:3.0:1789130838.160109:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508726016 00000100:00100000:3.0:1789130838.160118:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508726016 00000100:00100000:3.0:1789130838.160182:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1789130838.160192:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8605850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+17:9492:x1876039508726016:12345-0@lo:502: 00000100:00100000:3.0:1789130838.160686:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8605850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+17:9492:x1876039508726016:12345-0@lo:502: Request processed in 493us (842us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130838.160696:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1789130838.160850:0:9492:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff753840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:9492:1876039508726016:0@lo:502: 00000040:00080000:1.0:1789130838.160946:0:9492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 224 off16152 00000040:00080000:1.0:1789130838.160959:0:9492:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 47 count 48 00000020:01000004:0.0:1789130838.162138:0:9510:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1789130838.162171:0:9510:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff91de01a01a48) 00000020:00000080:0.0:1789130838.162211:0:9510:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type lwp with refcount 2 00000020:01000004:0.0:1789130838.162543:0:9510:0:(tgt_mount.c:153:server_get_mount()) get mount ffff91ddff549800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1789130838.162548:0:9510:0:(tgt_mount.c:187:server_put_mount()) put mount ffff91ddff549800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1789130838.162551:0:9510:0:(obd_mount.c:710:lustre_put_lsi()) put ffff91ddff549800 3 00010000:00080000:0.0:1789130838.162589:0:9510:0:(ldlm_lib.c:102:import_set_conn()) imp ffff91dcc7b4d800@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.111@tcp at head 00010000:00010000:0.0:1789130838.181702:0:9510:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-9 is initialized 00000020:00000080:0.0:1789130838.181948:0:9510:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1789130838.184316:0:9510:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789130838.184332:0:9510:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xf3fe2838e1fc207c 00000100:00080000:0.0:1789130838.184344:0:9510:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789130838.184351:0:9510:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff91dcc7b4d800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:0.0:1789130838.184389:0:9510:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91ddff750000 x1876039508726144/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789130838.184420:0:9510:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1789130838.184847:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff750000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3624:1876039508726144:0@lo:38: 00000100:00100000:2.0:1789130838.184972:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130838.185030:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc6bee580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3627:1876039508726272:0@lo:400: 00000100:00100000:1.0:1789130838.185118:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130838.185179:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc6becf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3627:1876039508726784:0@lo:400: 00000100:00100000:2.0:1789130838.185207:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508726144 00000100:00100000:1.0:1789130838.185213:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130838.185219:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508726144 00000100:00100000:1.0:1789130838.185241:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789130838.185252:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc6bec3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508726400:0@lo:400: 00000100:00100000:2.0:1789130838.185258:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508726272 00000100:00100000:2.0:1789130838.185263:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508726272 00000100:00100000:1.0:1789130838.185293:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130838.185312:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508726784 00000100:00100000:2.0:1789130838.185318:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508726784 00000100:00100000:1.0:1789130838.185332:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc6bef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3627:1876039508726912:0@lo:400: 00000100:00100000:2.0:1789130838.185369:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789130838.185382:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddca180780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1876039508726272:12345-0@lo:400: 00000100:00100000:1.0:1789130838.185394:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130838.185435:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc6bede00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508726656:0@lo:400: 00000100:00100000:2.0:1789130838.185723:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddca180780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1876039508726272:12345-0@lo:400: Request processed in 341us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130838.185737:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789130838.185762:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508726912 00000100:00100000:2.0:1789130838.185766:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508726912 00000100:00100000:2.0:1789130838.185798:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789130838.185817:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddca229e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1876039508726784:12345-0@lo:400: 00000100:00100000:2.0:1789130838.185882:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddca229e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1876039508726784:12345-0@lo:400: Request processed in 68us (672us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130838.185893:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789130838.185921:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789130838.185940:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7c92d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1876039508726912:12345-0@lo:400: 00000100:00100000:2.0:1789130838.185996:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7c92d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1876039508726912:12345-0@lo:400: Request processed in 65us (602us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130838.186008:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789130838.186025:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789130838.186030:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc5fe8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3624:x1876039508726144:12345-0@lo:38: 00010000:00080000:2.0:1789130838.186057:0:6502:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 194 last 0 00000020:00000080:2.0:1789130838.186113:0:6502:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xf3fe2838e1fc2083 00000004:00100000:2.0:1789130838.186135:0:6502:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789130838.186179:0:6502:0:(import.c:65:import_set_state_nolock()) ffff91dcc7874000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789130838.186245:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc5fe8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3624:x1876039508726144:12345-0@lo:38: Request processed in 214us (1276us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130838.186253:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1789130838.186279:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789130838.186285:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789130838.186397:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91ddff750000 x1876039508726144/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789130848 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789130838.186412:0:3624:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789130838.186421:0:3624:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:0.0:1789130838.186431:0:3624:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1789130838.186437:0:3624:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789130838.186440:0:3624:0:(import.c:65:import_set_state_nolock()) ffff91dcc7b4d800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789130838.186448:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff750000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3624:1876039508726144:0@lo:38: 00000100:00100000:2.0:1789130838.186826:0:9512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dde0b80f00 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9512:1876039508727296:0@lo:901: 00000100:00100000:2.0:1789130838.186873:0:9512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130838.186908:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508727296 00000100:00100000:2.0:1789130838.186912:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508727296 00000100:00100000:2.0:1789130838.186954:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789130838.186963:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dde0b81680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9512:x1876039508727296:12345-0@lo:901: 00000100:00100000:2.0:1789130838.187075:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dde0b81680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9512:x1876039508727296:12345-0@lo:901: Request processed in 113us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130838.187083:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1789130838.187249:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789130838.187263:0:9512:0:(client.c:2715:ptlrpc_set_wait()) set ffff91dded3d5f00 going to sleep for 11 seconds 00010000:00080000:2.0:1789130838.187281:0:9512:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91dde0b80f00 x1876039508727296/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1789130854 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789130838.187293:0:9512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dde0b80f00 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9512:1876039508727296:0@lo:901: 00000020:01000004:0.0:1789130838.187593:0:9510:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1789130838.187616:0:9510:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff91de01a03490) 00000020:00000080:0.0:1789130838.187715:0:9510:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type lwp with refcount 2 00000020:01000004:0.0:1789130838.187847:0:9510:0:(tgt_mount.c:153:server_get_mount()) get mount ffff91ddff549800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1789130838.187852:0:9510:0:(tgt_mount.c:187:server_put_mount()) put mount ffff91ddff549800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1789130838.187859:0:9510:0:(obd_mount.c:710:lustre_put_lsi()) put ffff91ddff549800 3 00010000:00080000:0.0:1789130838.187902:0:9510:0:(ldlm_lib.c:102:import_set_conn()) imp ffff91dcc7b4c000@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.111@tcp at head 00000100:00100000:1.0:1789130838.187940:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130838.187997:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddca180f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508727168:0@lo:400: 00000100:00100000:2.0:1789130838.188108:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508726400 00000100:00100000:2.0:1789130838.188117:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508726400 00000100:00100000:1.0:1789130838.188135:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130838.188159:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508726656 00000100:00100000:2.0:1789130838.188165:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508726656 00000100:00100000:2.0:1789130838.188183:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789130838.188191:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddca229a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508726400:12345-0@lo:400: 00000100:00100000:2.0:1789130838.188262:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddca229a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508726400:12345-0@lo:400: Request processed in 71us (2973us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130838.188270:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789130838.188284:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789130838.188291:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7c93c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508726656:12345-0@lo:400: 00000100:00100000:2.0:1789130838.188321:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7c93c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508726656:12345-0@lo:400: Request processed in 31us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130838.188327:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789130838.188385:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc6bede00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508726656:0@lo:400: 00000100:00100000:1.0:1789130838.188424:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789130838.188434:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc6bef840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3626:1876039508726528:0@lo:400: 00000100:00100000:1.0:1789130838.188494:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130838.188523:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc6befc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1876039508727040:0@lo:400: 00000100:00100000:1.0:1789130838.188621:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130838.188736:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508726528 00000100:00100000:1.0:1789130838.188744:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508726528 00000100:00100000:1.0:1789130838.188783:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789130838.188792:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7c90f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1876039508726528:12345-0@lo:400: 00000100:00100000:1.0:1789130838.188857:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7c90f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1876039508726528:12345-0@lo:400: Request processed in 66us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130838.188866:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789130838.188901:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508727168 00000100:00100000:1.0:1789130838.188905:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508727168 00000100:00100000:1.0:1789130838.188940:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508727040 00000100:00100000:1.0:1789130838.188943:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508727040 00000100:00100000:1.0:1789130838.188967:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789130838.188975:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7c921c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508727168:12345-0@lo:400: 00000100:00100000:1.0:1789130838.189019:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7c921c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508727168:12345-0@lo:400: Request processed in 45us (885us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130838.189108:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789130838.189124:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789130838.189130:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7c91680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1876039508727040:12345-0@lo:400: 00000100:00100000:1.0:1789130838.189159:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7c91680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1876039508727040:12345-0@lo:400: Request processed in 30us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130838.189313:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1789130838.189341:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789130838.189395:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc6bec3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508726400:0@lo:400: 00010000:00080000:1.0:1789130838.189414:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91dcc6bef480 x1876039508726912/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130854 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789130838.189425:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc6bef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3627:1876039508726912:0@lo:400: 00010000:00080000:1.0:1789130838.189438:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91dcc6bee580 x1876039508726272/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130854 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789130838.189447:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc6bee580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3627:1876039508726272:0@lo:400: 00010000:00080000:1.0:1789130838.190160:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91dcc6becf00 x1876039508726784/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130854 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789130838.190470:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc6becf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3627:1876039508726784:0@lo:400: 00010000:00080000:1.0:1789130838.190552:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91dcc6bef840 x1876039508726528/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130854 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789130838.190562:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc6bef840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3626:1876039508726528:0@lo:400: 00010000:00080000:1.0:1789130838.190575:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91dcc6befc00 x1876039508727040/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789130854 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789130838.190583:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc6befc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1876039508727040:0@lo:400: 00010000:00080000:1.0:1789130838.190592:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91ddca180f00 x1876039508727168/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789130854 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789130838.190599:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddca180f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508727168:0@lo:400: 00010000:00010000:0.0:1789130838.191327:0:9510:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-10 is initialized 00000020:00000080:0.0:1789130838.191894:0:9510:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:0.0:1789130838.192043:0:9510:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789130838.192063:0:9510:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xf3fe2838e1fc2091 00000100:00080000:0.0:1789130838.192079:0:9510:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789130838.192087:0:9510:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff91dcc7b4c000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:0.0:1789130838.192153:0:9510:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91ddff750000 x1876039508727424/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789130838.192182:0:9510:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000040:00080000:0.0:1789130838.192836:0:9510:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000020:01000000:3.0:1789130838.192967:0:9492:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-47 (rc=0) 10000000:01000000:3.0:1789130838.193008:0:9492:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789130838.193030:0:9492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff91ddfd0b4600/0xf3fe2838e1fc2067 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc206e expref: -99 pid: 9492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130838.193044:0:9492:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff91ddfd0b4600/0xf3fe2838e1fc2067 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc206e expref: -99 pid: 9492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789130838.193150:0:9492:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789130838.193153:0:9492:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789130838.193163:0:9492:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789130838.193165:0:9492:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789130838.193167:0:9492:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789130838.193168:0:9492:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789130838.193170:0:9492:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789130838.193172:0:9492:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789130838.193173:0:9492:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789130838.193176:0:9492:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789130838.193185:0:9492:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789130838.193190:0:9492:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:3.0:1789130838.193193:0:9492:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789130838.193194:0:9492:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789130838.193195:0:9492:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789130838.193196:0:9492:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789130838.193197:0:9492:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789130838.193199:0:9492:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789130838.193200:0:9492:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789130838.193201:0:9492:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789130838.193202:0:9492:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789130838.193203:0:9492:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789130838.193204:0:9492:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789130838.193228:0:9492:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1789130838.193579:0:9492:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7893c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:9492:1876039508727552:0@lo:253: 00000100:00100000:3.0:1789130838.193678:0:9492:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130838.193739:0:9492:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddc4c14900 going to sleep for 11 seconds 00000100:00100000:1.0:1789130838.194001:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff750000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3624:1876039508727424:0@lo:38: 00000100:00100000:1.0:1789130838.194087:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130838.194226:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508727424 00000100:00100000:0.0:1789130838.194236:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508727424 00000100:00100000:0.0:1789130838.194284:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789130838.194293:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7c90b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3624:x1876039508727424:12345-0@lo:38: 00010000:00080000:0.0:1789130838.194332:0:6501:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 194 last 0 00000020:00000080:0.0:1789130838.194378:0:6501:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xf3fe2838e1fc2098 00000004:00100000:0.0:1789130838.194400:0:6501:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789130838.194450:0:6501:0:(import.c:65:import_set_state_nolock()) ffff91dcc7b49800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789130838.195357:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7c90b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1876039508727424:12345-0@lo:38: Request processed in 1059us (1264us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130838.195369:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1789130838.195442:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91ddff750000 x1876039508727424/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789130848 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789130838.195454:0:3624:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789130838.195484:0:3624:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 1 00000100:00080000:0.0:1789130838.195511:0:3624:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1789130838.195517:0:3624:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1789130838.195521:0:3624:0:(import.c:65:import_set_state_nolock()) ffff91dcc7b4c000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789130838.195530:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff750000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3624:1876039508727424:0@lo:38: 00000100:00100000:2.0:1789130838.196560:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508727552 00000100:00100000:2.0:1789130838.196573:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508727552 00000100:00100000:2.0:1789130838.196649:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1789130838.196661:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8604850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+17:9492:x1876039508727552:12345-0@lo:253: 20000000:01000000:2.0:1789130838.196697:0:6492:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1789130838.196722:0:6492:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1789130838.206563:0:6492:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789130838.206589:0:6492:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1789130838.206652:0:6516:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1789130838.206664:0:6516:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1789130838.206710:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91dde19ab000/0xf3fe2838e1fc209f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130838.206729:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91dde19ab400/0xf3fe2838e1fc1f95 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc1f8e expref: 17 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130838.206738:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91ddfd0b5200/0xf3fe2838e1fc1fdb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc1fd4 expref: 17 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130838.206745:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91dde19ab000/0xf3fe2838e1fc209f lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130838.206792:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91ddfd0b5200/0xf3fe2838e1fc1fdb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf3fe2838e1fc1fd4 expref: 17 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130838.206808:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91ddfd0b5200/0xf3fe2838e1fc1fdb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf3fe2838e1fc1fd4 expref: 17 pid: 6493 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130838.206824:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7c93840 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6516:1876039508727680:0@lo:104: 00000100:00100000:1.0:1789130838.206894:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789130838.206952:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91dde19ab400/0xf3fe2838e1fc1f95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf3fe2838e1fc1f8e expref: 17 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130838.206960:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91dde19ab400/0xf3fe2838e1fc1f95 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf3fe2838e1fc1f8e expref: 17 pid: 6492 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130838.206968:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7c93480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6516:1876039508727808:0@lo:104: 00000100:00100000:1.0:1789130838.206990:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130838.207020:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddff7a8d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789130838.207082:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508727680 00000100:00100000:2.0:1789130838.207094:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508727680 00000100:00100000:2.0:1789130838.207203:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508727808 00000100:00100000:2.0:1789130838.207208:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508727808 00000100:00100000:2.0:1789130838.207247:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789130838.207259:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7c91e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+4:6516:x1876039508727680:12345-0@lo:104: 00010000:00010000:2.0:1789130838.207280:0:6484:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff91ddfd0b4c00/0xf3fe2838e1fc1fd4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3fe2838e1fc1fdb expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130838.207382:0:6484:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789130838.207389:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7c91e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+4:6516:x1876039508727680:12345-0@lo:104: Request processed in 132us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130838.207398:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789130838.207419:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789130838.207424:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7c912c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+3:6516:x1876039508727808:12345-0@lo:104: 00010000:00010000:2.0:1789130838.207444:0:6484:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff91ddc27e7600/0xf3fe2838e1fc1f8e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3fe2838e1fc1f95 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130838.207536:0:6484:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789130838.207541:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7c912c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+3:6516:x1876039508727808:12345-0@lo:104: Request processed in 117us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130838.207548:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789130838.207656:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8604850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+17:9492:x1876039508727552:12345-0@lo:253: Request processed in 10993us (13974us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130838.207680:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00010000:00010000:1.0:1789130838.207729:0:6488:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789130838.207736:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff91ddfd0b4c00/0xf3fe2838e1fc1fd4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3fe2838e1fc1fdb expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130838.207746:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddfd0b4c00 already unused, calling callback (ffffffffc124bc20) 10000000:00010000:1.0:1789130838.207750:0:6488:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff91ddfd0b4c00/0xf3fe2838e1fc1fd4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf3fe2838e1fc1fdb expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130838.207760:0:6488:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff91ddfd0b4c00/0xf3fe2838e1fc1fd4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf3fe2838e1fc1fdb expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789130838.207768:0:6488:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff91ddfd0b4c00/0xf3fe2838e1fc1fd4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf3fe2838e1fc1fdb expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789130838.207775:0:6488:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789130838.207808:0:6488:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff91ddfd0b4c00/0xf3fe2838e1fc1fd4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc1fdb expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130838.207815:0:6488:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789130838.207832:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff91ddfd0b4c00/0xf3fe2838e1fc1fd4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc1fdb expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130838.207839:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff91ddfd0b4c00/0xf3fe2838e1fc1fd4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc1fdb expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130838.207852:0:6488:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789130838.207856:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff91ddc27e7600/0xf3fe2838e1fc1f8e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3fe2838e1fc1f95 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130838.207871:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddc27e7600 already unused, calling callback (ffffffffc124bc20) 10000000:00010000:1.0:1789130838.207875:0:6488:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff91ddc27e7600/0xf3fe2838e1fc1f8e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf3fe2838e1fc1f95 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130838.207882:0:6488:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff91ddc27e7600/0xf3fe2838e1fc1f8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf3fe2838e1fc1f95 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789130838.207888:0:6488:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff91ddc27e7600/0xf3fe2838e1fc1f8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf3fe2838e1fc1f95 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789130838.207894:0:6488:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789130838.207907:0:6488:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff91ddc27e7600/0xf3fe2838e1fc1f8e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc1f95 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130838.207913:0:6488:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789130838.207918:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff91ddc27e7600/0xf3fe2838e1fc1f8e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc1f95 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130838.207925:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff91ddc27e7600/0xf3fe2838e1fc1f8e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc1f95 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130838.207939:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130838.207940:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130838.207942:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789130838.207955:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7c903c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3627:1876039508727936:0@lo:103: 00000100:00100000:1.0:1789130838.207989:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130838.208014:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789130838.208020:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7c92580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3627:1876039508728064:0@lo:103: 00000100:00100000:2.0:1789130838.208128:0:9492:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7893c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:9492:1876039508727552:0@lo:253: 10000000:01000000:2.0:1789130838.208149:0:9492:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1789130838.208153:0:9492:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789130838.208155:0:9492:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789130838.208172:0:9492:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789130838.208174:0:9492:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789130838.208175:0:9492:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789130838.208176:0:9492:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789130838.208178:0:9492:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789130838.208180:0:9492:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789130838.208181:0:9492:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789130838.208183:0:9492:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789130838.208185:0:9492:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789130838.208210:0:9492:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:0.0:1789130838.208638:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789130838.208777:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130838.212390:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508727936 00000100:00100000:0.0:1789130838.212405:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508727936 00010000:00010000:0.0:1789130838.212476:0:8431:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91ddfd0b5200/0xf3fe2838e1fc1fdb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3fe2838e1fc1fd4 expref: 17 pid: 6493 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130838.212523:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508728064 00000100:00100000:0.0:1789130838.212528:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508728064 00010000:00010000:0.0:1789130838.212557:0:8431:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91dde19ab400/0xf3fe2838e1fc1f95 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3fe2838e1fc1f8e expref: 18 pid: 6492 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130838.212592:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789130838.212609:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7c91a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+18:3627:x1876039508727936:12345-0@lo:103: 00010000:00010000:0.0:1789130838.212625:0:8431:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789130838.212632:0:8431:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91ddfd0b5200/0xf3fe2838e1fc1fdb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3fe2838e1fc1fd4 expref: 18 pid: 6493 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130838.212645:0:8431:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91ddfd0b5200/0xf3fe2838e1fc1fdb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf3fe2838e1fc1fd4 expref: 18 pid: 6493 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130838.212671:0:8431:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789130838.212764:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7c91a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+18:3627:x1876039508727936:12345-0@lo:103: Request processed in 163us (4774us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130838.212774:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00080000:10000000:2.0:1789130838.212797:0:9492:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00000100:00100000:0.0:1789130838.212798:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789130838.212824:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7c930c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+17:3627:x1876039508728064:12345-0@lo:103: 00010000:00010000:0.0:1789130838.212837:0:8431:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789130838.212842:0:8431:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91dde19ab400/0xf3fe2838e1fc1f95 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3fe2838e1fc1f8e expref: 17 pid: 6492 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130838.212854:0:8431:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91dde19ab400/0xf3fe2838e1fc1f95 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf3fe2838e1fc1f8e expref: 17 pid: 6492 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130838.212871:0:8431:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91dde19ab000/0xf3fe2838e1fc209f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130838.212880:0:8431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91dde19ab000/0xf3fe2838e1fc209f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789130838.212897:0:8431:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.008781586s 00010000:00010000:0.0:1789130838.212902:0:8431:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91dde19ab000/0xf3fe2838e1fc209f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130838.212909:0:8431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91dde19ab000/0xf3fe2838e1fc209f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130838.212915:0:8431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91dde19ab000/0xf3fe2838e1fc209f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130838.212922:0:8431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91dde19ab000/0xf3fe2838e1fc209f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130838.212929:0:8431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dde19ab000 already unused, calling callback (ffffffffc0c4e550) 00010000:00010000:0.0:1789130838.212933:0:8431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91dde19ab000/0xf3fe2838e1fc209f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130838.212942:0:8431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91dde19ab000/0xf3fe2838e1fc209f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130838.212960:0:8431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91dde19ab000/0xf3fe2838e1fc209f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130838.212970:0:8431:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789130838.212995:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7c930c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+17:3627:x1876039508728064:12345-0@lo:103: Request processed in 175us (4219us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130838.213002:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00080000:10000000:2.0:1789130838.213422:0:9492:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1789130838.213722:0:9492:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:2.0:1789130838.213920:0:9492:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1789130838.214422:0:9492:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:10000000:2.0:1789130838.214596:0:9492:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000100:00100000:2.0:1789130838.216189:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7c92580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3627:1876039508728064:0@lo:103: 00000100:00100000:2.0:1789130838.216209:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7c903c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3627:1876039508727936:0@lo:103: 00010000:00010000:2.0:1789130838.216423:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91ddfd0b5200/0xf3fe2838e1fc1fdb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf3fe2838e1fc1fd4 expref: 16 pid: 6493 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130838.216442:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7c93840 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6516:1876039508727680:0@lo:104: 00010000:00010000:2.0:1789130838.216477:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91dde19ab400/0xf3fe2838e1fc1f95 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf3fe2838e1fc1f8e expref: 15 pid: 6492 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130838.216488:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7c93480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6516:1876039508727808:0@lo:104: 00010000:00010000:2.0:1789130838.216511:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91dde19ab000/0xf3fe2838e1fc209f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130838.216522:0:6516:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91dde19ab000/0xf3fe2838e1fc209f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130838.216552:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91dde19ab000/0xf3fe2838e1fc209f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130838.216558:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91dde19ab000/0xf3fe2838e1fc209f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:0.0:1789130838.220649:0:9492:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1789130838.243234:0:9492:0:(ofd_obd.c:543:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1789130838.243249:0:9492:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1789130838.244271:0:9492:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1789130838.244362:0:9492:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.111@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1789130838.244390:0:9492:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=50 00000080:00000004:1.0:1789130838.244434:0:9492:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:1.0:1789130838.245616:0:9492:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789130838.245875:0:9492:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:2.0:1789130838.932648:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789130839.390222:0:9567:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789130839.390520:0:9567:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789130839.953620:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789130840.146706:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789130840.146730:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7890780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508728192:0@lo:13: 00000100:00100000:0.0:1789130840.146803:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130840.146949:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508728192 00000100:00100000:3.0:1789130840.146956:0:8418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508728192 00000100:00100000:3.0:1789130840.147010:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789130840.147020:0:8418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff750000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508728192:12345-0@lo:13: 00002000:00000024:3.0:1789130840.147049:0:8418:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789130840.147096:0:8418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff750000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508728192:12345-0@lo:13: Request processed in 78us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130840.147103:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:0.0:1789130840.147158:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789130840.147186:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc7890780 x1876039508728192/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789130856 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789130840.147203:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7890780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508728192:0@lo:13: 00000100:00100000:1.0:1789130840.663188:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff7512c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1876039508728320:0@lo:13: 00000100:00100000:1.0:1789130840.663260:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130840.663392:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508728320 00000100:00100000:3.0:1789130840.663401:0:8418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508728320 00000100:00100000:3.0:1789130840.663493:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789130840.663502:0:8418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7c90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1876039508728320:12345-0@lo:13: 00002000:00000024:3.0:1789130840.663524:0:8418:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789130840.663572:0:8418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7c90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1876039508728320:12345-0@lo:13: Request processed in 71us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130840.663595:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:0.0:1789130840.663693:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789130840.663771:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91ddff7512c0 x1876039508728320/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789130856 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789130840.663790:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff7512c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1876039508728320:0@lo:13: 00010000:00010000:0.0:1789130840.978426:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130842.004744:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789130842.708702:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7c92940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1876039508728448:0@lo:41: 00000100:00100000:0.0:1789130842.708819:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130842.708927:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789130842.708936:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7890b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508728576:0@lo:41: 00000100:00100000:2.0:1789130842.709048:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508728448 00000100:00100000:2.0:1789130842.709062:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508728448 00000100:00100000:2.0:1789130842.709134:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789130842.709145:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff753840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1876039508728448:12345-0@lo:41: 00000004:00000024:2.0:1789130842.709180:0:6505:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:2.0:1789130842.709260:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff753840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1876039508728448:12345-0@lo:41: Request processed in 116us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130842.709267:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789130842.713736:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130842.714058:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7c92940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1876039508728448:0@lo:41: 00000100:00100000:2.0:1789130842.716194:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508728576 00000100:00100000:2.0:1789130842.716215:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508728576 00000100:00100000:2.0:1789130842.716310:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789130842.716322:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff753c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508728576:12345-0@lo:41: 00000004:00000024:2.0:1789130842.716384:0:6505:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:2.0:1789130842.716674:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff753c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508728576:12345-0@lo:41: Request processed in 353us (2949us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130842.716684:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789130842.716785:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7890b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508728576:0@lo:41: 00010000:00010000:1.0:1789130843.025778:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789130843.223926:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7c93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3626:1876039508728832:0@lo:400: 00000100:00100000:1.0:1789130843.223947:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7c93840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508728960:0@lo:400: 00000100:00100000:3.0:1789130843.224032:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7c92940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3625:1876039508728704:0@lo:400: 00000100:00100000:0.0:1789130843.226512:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130843.226603:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddca181680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3626:1876039508729344:0@lo:400: 00000100:00100000:2.0:1789130843.227043:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508728832 00000100:00100000:2.0:1789130843.227052:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508728832 00000100:00100000:2.0:1789130843.227113:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789130843.227123:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff7512c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1876039508728832:12345-0@lo:400: 00000100:00100000:2.0:1789130843.227198:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff7512c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1876039508728832:12345-0@lo:400: Request processed in 76us (691us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130843.227206:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789130843.227287:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130843.227331:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc6bef840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3626:1876039508729856:0@lo:400: 00000100:00100000:0.0:1789130843.227355:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1789130843.227456:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc7c93480 x1876039508728832/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130859 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789130843.227492:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7c93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3626:1876039508728832:0@lo:400: 00000100:00100000:0.0:1789130843.227523:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508729344 00000100:00100000:0.0:1789130843.227527:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508729344 00000100:00100000:0.0:1789130843.227554:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508729856 00000100:00100000:0.0:1789130843.227557:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508729856 00000100:00100000:0.0:1789130843.227572:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789130843.227578:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddca0f8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1876039508729344:12345-0@lo:400: 00000100:00100000:0.0:1789130843.227615:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddca0f8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1876039508729344:12345-0@lo:400: Request processed in 37us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130843.227851:0:6500:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1789130843.227860:0:6500:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1789130843.227910:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789130843.227932:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789130843.227940:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddca0f92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1876039508729856:12345-0@lo:400: 00000100:00100000:0.0:1789130843.227975:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddca0f92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1876039508729856:12345-0@lo:400: Request processed in 36us (618us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130843.227980:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:0.0:1789130843.227996:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789130843.228018:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91ddca181680 x1876039508729344/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130859 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789130843.228028:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddca181680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3626:1876039508729344:0@lo:400: 00010000:00080000:0.0:1789130843.228039:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc6bef840 x1876039508729856/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130859 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789130843.228047:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc6bef840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3626:1876039508729856:0@lo:400: 00000100:00100000:2.0:1789130843.233602:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7c903c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3628:1876039508729088:0@lo:400: 00000100:00100000:2.0:1789130843.233675:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130843.233740:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc6bee940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1876039508729600:0@lo:400: 00000100:00100000:2.0:1789130843.233768:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130843.235039:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508729088 00000100:00100000:0.0:1789130843.235050:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508729088 00000100:00100000:0.0:1789130843.235108:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789130843.235117:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dde0b80f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3628:x1876039508729088:12345-0@lo:400: 00000100:00100000:0.0:1789130843.235189:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dde0b80f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3628:x1876039508729088:12345-0@lo:400: Request processed in 73us (1514us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130843.235197:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:0.0:1789130843.235239:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc7c903c0 x1876039508729088/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130859 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789130843.235253:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7c903c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3628:1876039508729088:0@lo:400: 00000100:00100000:1.0:1789130843.237498:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130843.237625:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508729600 00000100:00100000:1.0:1789130843.237633:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508729600 00000100:00100000:1.0:1789130843.237691:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789130843.237712:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddca0c4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3628:x1876039508729600:12345-0@lo:400: 00000100:00100000:1.0:1789130843.237773:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddca0c4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3628:x1876039508729600:12345-0@lo:400: Request processed in 64us (4003us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130843.237789:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1789130843.237867:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789130843.238036:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc6bee940 x1876039508729600/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789130859 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789130843.238050:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc6bee940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1876039508729600:0@lo:400: 00000100:00100000:3.0:1789130843.238100:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130843.238125:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508728704 00000100:00100000:0.0:1789130843.238130:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508728704 00000100:00100000:3.0:1789130843.238158:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7c92580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508729216:0@lo:400: 00000100:00100000:0.0:1789130843.238166:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1789130843.238174:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8604050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+15:3625:x1876039508728704:12345-0@lo:400: 00000100:00100000:3.0:1789130843.238196:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130843.238220:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc6befc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508729728:0@lo:400: 00000100:00100000:0.0:1789130843.238230:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8604050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+15:3625:x1876039508728704:12345-0@lo:400: Request processed in 56us (130us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130843.238238:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1789130843.238251:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130843.238284:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7c92940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3625:1876039508728704:0@lo:400: 00000100:00100000:3.0:1789130843.238320:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508728960 00000100:00100000:3.0:1789130843.238324:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508728960 00000100:00100000:3.0:1789130843.238350:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508729216 00000100:00100000:3.0:1789130843.238353:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508729216 00000100:00100000:3.0:1789130843.238370:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789130843.238376:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc6bee580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508728960:12345-0@lo:400: 00000100:00100000:3.0:1789130843.238414:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc6bee580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508728960:12345-0@lo:400: Request processed in 38us (924us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130843.238421:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789130843.238446:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789130843.238453:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7893840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1876039508729216:12345-0@lo:400: 00000100:00100000:3.0:1789130843.238509:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7893840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1876039508729216:12345-0@lo:400: Request processed in 57us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130843.238515:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789130843.238531:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508729728 00000100:00100000:3.0:1789130843.238535:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508729728 00000100:00100000:3.0:1789130843.238706:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789130843.238714:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7891e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1876039508729728:12345-0@lo:400: 00000100:00100000:3.0:1789130843.238752:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7891e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1876039508729728:12345-0@lo:400: Request processed in 39us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130843.238758:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1789130843.238772:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789130843.238791:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7c92580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508729216:0@lo:400: 00010000:00080000:3.0:1789130843.238801:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc6befc00 x1876039508729728/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789130859 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130843.238810:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc6befc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508729728:0@lo:400: 00000100:00100000:1.0:1789130843.243119:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7c93840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508728960:0@lo:400: 00000100:00100000:1.0:1789130843.243146:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddca180f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3627:1876039508729472:0@lo:400: 00000100:00100000:1.0:1789130843.243205:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130843.243246:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc6becf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3627:1876039508729984:0@lo:400: 00000100:00100000:1.0:1789130843.243271:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130843.247985:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508729472 00000100:00100000:2.0:1789130843.247998:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508729472 00000100:00100000:2.0:1789130843.248215:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508729984 00000100:00100000:2.0:1789130843.248219:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508729984 00000100:00100000:2.0:1789130843.248252:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789130843.248262:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc6bef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1876039508729472:12345-0@lo:400: 00000100:00100000:2.0:1789130843.248374:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc6bef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1876039508729472:12345-0@lo:400: Request processed in 101us (5156us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130843.248383:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789130843.248407:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789130843.248416:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc6bec3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3627:x1876039508729984:12345-0@lo:400: 00000100:00100000:2.0:1789130843.248448:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc6bec3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3627:x1876039508729984:12345-0@lo:400: Request processed in 35us (5176us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130843.248455:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:2.0:1789130843.248496:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1789130843.248879:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91ddca180f00 x1876039508729472/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130859 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789130843.248907:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddca180f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3627:1876039508729472:0@lo:400: 00010000:00080000:0.0:1789130843.248921:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc6becf00 x1876039508729984/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130859 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789130843.248937:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc6becf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3627:1876039508729984:0@lo:400: 00010000:00010000:3.0:1789130844.051097:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789130844.243635:0:6497:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789130844.243641:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff91ddff4f9000 from 39 10000000:01000000:1.0:1789130844.243646:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789130844.243685:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff91dde19abe00/0xf3fe2838e1fc20a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130844.243696:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff91dde19abe00/0xf3fe2838e1fc20a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130844.243707:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff91dde19abe00/0xf3fe2838e1fc20a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130844.243728:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc6bede00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508730112:0@lo:101: 00000100:00100000:1.0:1789130844.243798:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130844.243846:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddff7a8900 going to sleep for 11 seconds 00000100:00100000:2.0:1789130844.243917:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508730112 00000100:00100000:2.0:1789130844.243924:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508730112 00000100:00100000:2.0:1789130844.243978:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1789130844.243988:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8606850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+15:6497:x1876039508730112:12345-0@lo:101: 00010000:00010000:2.0:1789130844.244009:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130844.244022:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91ddc27e6c00/0xf3fe2838e1fc20ad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3fe2838e1fc20a6 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130844.244044:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91ddc27e6c00/0xf3fe2838e1fc20ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3fe2838e1fc20a6 expref: 16 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130844.244064:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91ddc27e6c00/0xf3fe2838e1fc20ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc20a6 expref: 16 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130844.244074:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ddc27e6c00, rc 0) 00000100:00100000:2.0:1789130844.244117:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8606850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+16:6497:x1876039508730112:12345-0@lo:101: Request processed in 130us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130844.244126:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1789130844.244171:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc6bede00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508730112:0@lo:101: 00010000:00010000:2.0:1789130844.244186:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff91dde19abe00/0xf3fe2838e1fc20a6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc20ad expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130844.244195:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff91dde19abe00/0xf3fe2838e1fc20a6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3fe2838e1fc20ad expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130844.244253:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddca0c6940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508730240:0@lo:501: 00000100:00100000:2.0:1789130844.244278:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130844.244294:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff91dcc7d68b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789130844.244306:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508730240 00000100:00100000:2.0:1789130844.244309:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508730240 00000100:00100000:2.0:1789130844.244332:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1789130844.244339:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8606450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+16:6497:x1876039508730240:12345-0@lo:501: 00000100:00100000:2.0:1789130844.244480:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8606450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+16:6497:x1876039508730240:12345-0@lo:501: Request processed in 120us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130844.244487:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1789130844.244515:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddca0c6940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508730240:0@lo:501: 00000100:00100000:2.0:1789130844.246499:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddca0c6940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508730368:0@lo:503: 00000100:00100000:2.0:1789130844.246584:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130844.246615:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff91dcc7d68b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789130844.249096:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508730368 00000100:00100000:1.0:1789130844.249112:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508730368 00000100:00100000:1.0:1789130844.249173:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1789130844.249183:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8607050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+16:6497:x1876039508730368:12345-0@lo:503: 00000100:00100000:1.0:1789130844.249331:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8607050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+16:6497:x1876039508730368:12345-0@lo:503: Request processed in 149us (2747us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130844.249346:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1789130844.250357:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddca0c6940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508730368:0@lo:503: 00000100:00100000:2.0:1789130844.251417:0:9814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddca0c6940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:9814:1876039508730496:0@lo:502: 00000100:00100000:2.0:1789130844.251510:0:9814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130844.251547:0:9814:0:(client.c:2715:ptlrpc_set_wait()) set ffff91dcc7d68c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789130844.251657:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508730496 00000100:00100000:3.0:1789130844.251664:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508730496 00000100:00100000:3.0:1789130844.251710:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1789130844.251718:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8605c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+16:9814:x1876039508730496:12345-0@lo:502: 00000100:00100000:3.0:1789130844.251822:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8605c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+16:9814:x1876039508730496:12345-0@lo:502: Request processed in 104us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130844.251829:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1789130844.251910:0:9814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddca0c6940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:9814:1876039508730496:0@lo:502: 00000100:00100000:2.0:1789130844.251950:0:9814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddca0c6940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:9814:1876039508730624:0@lo:502: 00000100:00100000:2.0:1789130844.251981:0:9814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130844.252005:0:9814:0:(client.c:2715:ptlrpc_set_wait()) set ffff91dcc7d68c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789130844.252317:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508730624 00000100:00100000:3.0:1789130844.252322:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508730624 00000100:00100000:3.0:1789130844.252353:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1789130844.252361:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8603850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+16:9814:x1876039508730624:12345-0@lo:502: 00000100:00100000:3.0:1789130844.252426:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8603850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+16:9814:x1876039508730624:12345-0@lo:502: Request processed in 66us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130844.252433:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1789130844.254283:0:9814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddca0c6940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:9814:1876039508730624:0@lo:502: 00000040:00080000:2.0:1789130844.254325:0:9814:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:1.0:1789130844.255013:0:6497:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:1.0:1789130844.255045:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789130844.255066:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff91dde19abe00/0xf3fe2838e1fc20a6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc20ad expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130844.255078:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff91dde19abe00/0xf3fe2838e1fc20a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc20ad expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789130844.255089:0:6497:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1789130844.255091:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:1.0:1789130844.255094:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1789130844.255131:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff91dde19aae00/0xf3fe2838e1fc20b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130844.255139:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff91dde19aae00/0xf3fe2838e1fc20b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130844.255149:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff91dde19aae00/0xf3fe2838e1fc20b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130844.255170:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc6bede00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508730752:0@lo:101: 00000100:00100000:1.0:1789130844.255231:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130844.255270:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddff7a8c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789130844.255286:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508730752 00000100:00100000:2.0:1789130844.255293:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508730752 00000100:00100000:2.0:1789130844.255345:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1789130844.255353:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8602c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+16:6497:x1876039508730752:12345-0@lo:101: 00010000:00010000:2.0:1789130844.255366:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130844.255378:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91ddc27e7c00/0xf3fe2838e1fc20bb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3fe2838e1fc20b4 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130844.255416:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91ddc27e7c00/0xf3fe2838e1fc20bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3fe2838e1fc20b4 expref: 17 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130844.255426:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91ddc27e7c00/0xf3fe2838e1fc20bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc20b4 expref: 17 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130844.255434:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ddc27e7c00, rc 0) 00000100:00100000:2.0:1789130844.255511:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8602c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+17:6497:x1876039508730752:12345-0@lo:101: Request processed in 158us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130844.255518:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1789130844.256508:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc6bede00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508730752:0@lo:101: 00010000:00010000:1.0:1789130844.256527:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff91dde19aae00/0xf3fe2838e1fc20b4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc20bb expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130844.256537:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff91dde19aae00/0xf3fe2838e1fc20b4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3fe2838e1fc20bb expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130844.256614:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc6bede00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508730880:0@lo:501: 00000100:00100000:1.0:1789130844.256652:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130844.256723:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddff7a8c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789130844.257975:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508730880 00000100:00100000:2.0:1789130844.257983:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508730880 00000100:00100000:2.0:1789130844.258036:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1789130844.258044:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8601450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+17:6497:x1876039508730880:12345-0@lo:501: 00000100:00100000:2.0:1789130844.258280:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8601450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+17:6497:x1876039508730880:12345-0@lo:501: Request processed in 237us (1628us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130844.258287:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1789130844.258362:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc6bede00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508730880:0@lo:501: 00000100:00100000:0.0:1789130844.258404:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddca180f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508731008:0@lo:503: 00000100:00100000:0.0:1789130844.258448:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130844.258642:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddd867ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1789130844.268987:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508731008 00000100:00100000:2.0:1789130844.269001:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508731008 00000100:00100000:2.0:1789130844.269074:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1789130844.269084:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8600450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+17:6497:x1876039508731008:12345-0@lo:503: 00000100:00100000:2.0:1789130844.269260:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8600450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+17:6497:x1876039508731008:12345-0@lo:503: Request processed in 177us (10810us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130844.269268:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1789130844.269332:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddca180f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508731008:0@lo:503: 00000100:00100000:2.0:1789130844.269566:0:9818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddca0c6940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:9818:1876039508731136:0@lo:502: 00000100:00100000:2.0:1789130844.269614:0:9818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130844.269638:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508731136 00000100:00100000:2.0:1789130844.269641:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508731136 00000100:00100000:2.0:1789130844.269663:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1789130844.269669:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8603c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+17:9818:x1876039508731136:12345-0@lo:502: 00000100:00100000:2.0:1789130844.269734:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8603c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+17:9818:x1876039508731136:12345-0@lo:502: Request processed in 65us (119us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130844.269741:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1789130844.269780:0:9818:0:(client.c:2715:ptlrpc_set_wait()) set ffff91dcc7d68900 going to sleep for 11 seconds 00000100:00100000:2.0:1789130844.269792:0:9818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddca0c6940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:9818:1876039508731136:0@lo:502: 00000020:01000000:2.0:1789130844.269814:0:9818:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789130844.269822:0:9818:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789130844.269825:0:9818:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789130844.269829:0:9818:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789130844.269831:0:9818:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1789130844.269845:0:9818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddca0c6940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:9818:1876039508731264:0@lo:502: 00000100:00100000:2.0:1789130844.269876:0:9818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130844.269894:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508731264 00000100:00100000:2.0:1789130844.269897:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508731264 00000100:00100000:2.0:1789130844.269917:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1789130844.269922:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8601850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+17:9818:x1876039508731264:12345-0@lo:502: 00000100:00100000:2.0:1789130844.269976:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8601850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+17:9818:x1876039508731264:12345-0@lo:502: Request processed in 53us (99us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130844.269982:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1789130844.270008:0:9818:0:(client.c:2715:ptlrpc_set_wait()) set ffff91dcc7d68900 going to sleep for 11 seconds 00000100:00100000:2.0:1789130844.270019:0:9818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddca0c6940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:9818:1876039508731264:0@lo:502: 00000020:01000000:2.0:1789130844.270034:0:9818:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789130844.270042:0:9818:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789130844.270044:0:9818:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789130844.270047:0:9818:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:2.0:1789130844.270108:0:6497:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:2.0:1789130844.270128:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1789130844.270137:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff91dde19aae00/0xf3fe2838e1fc20b4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc20bb expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130844.270147:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff91dde19aae00/0xf3fe2838e1fc20b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc20bb expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789130844.270156:0:6497:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789130844.270158:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff91ddfce33000 from 39 10000000:01000000:2.0:1789130844.270161:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789130844.270184:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff91ddc27e6200/0xf3fe2838e1fc20c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130844.270192:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff91ddc27e6200/0xf3fe2838e1fc20c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130844.270200:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff91ddc27e6200/0xf3fe2838e1fc20c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130844.270211:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddca0c6940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508731392:0@lo:101: 00000100:00100000:2.0:1789130844.270236:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130844.270250:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff91dcc7d68900 going to sleep for 11 seconds 00000100:00100000:2.0:1789130844.270261:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508731392 00000100:00100000:2.0:1789130844.270264:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508731392 00000100:00100000:2.0:1789130844.270284:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1789130844.270289:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8600850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+17:6497:x1876039508731392:12345-0@lo:101: 00010000:00010000:2.0:1789130844.270298:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130844.270315:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91ddc27e7600/0xf3fe2838e1fc20c9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3fe2838e1fc20c2 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130844.270334:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91ddc27e7600/0xf3fe2838e1fc20c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3fe2838e1fc20c2 expref: 18 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130844.270344:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91ddc27e7600/0xf3fe2838e1fc20c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc20c2 expref: 18 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130844.270352:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ddc27e7600, rc 0) 00000100:00100000:2.0:1789130844.270379:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8600850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+18:6497:x1876039508731392:12345-0@lo:101: Request processed in 89us (141us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130844.270384:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1789130844.270414:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddca0c6940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508731392:0@lo:101: 00010000:00010000:2.0:1789130844.270425:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff91ddc27e6200/0xf3fe2838e1fc20c2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc20c9 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130844.270433:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff91ddc27e6200/0xf3fe2838e1fc20c2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3fe2838e1fc20c9 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130844.270490:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddca0c6940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508731520:0@lo:501: 00000100:00100000:2.0:1789130844.270512:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130844.270525:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff91dcc7d68900 going to sleep for 11 seconds 00000100:00100000:2.0:1789130844.270535:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508731520 00000100:00100000:2.0:1789130844.270538:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508731520 00000100:00100000:2.0:1789130844.270558:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1789130844.270563:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8600050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+18:6497:x1876039508731520:12345-0@lo:501: 00000100:00100000:2.0:1789130844.270656:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8600050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+18:6497:x1876039508731520:12345-0@lo:501: Request processed in 91us (142us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130844.270670:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1789130844.270699:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddca0c6940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508731520:0@lo:501: 00000100:00100000:2.0:1789130844.270721:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddca0c6940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508731648:0@lo:503: 00000100:00100000:2.0:1789130844.270751:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130844.270764:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff91dcc7d68900 going to sleep for 11 seconds 00000100:00100000:2.0:1789130844.270774:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508731648 00000100:00100000:2.0:1789130844.270777:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508731648 00000100:00100000:2.0:1789130844.270797:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1789130844.270802:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8602850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+18:6497:x1876039508731648:12345-0@lo:503: 00000100:00100000:2.0:1789130844.270866:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8602850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+18:6497:x1876039508731648:12345-0@lo:503: Request processed in 63us (114us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130844.270873:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1789130844.270907:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddca0c6940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508731648:0@lo:503: 00000100:00100000:2.0:1789130844.280217:0:9819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddca0c6940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:9819:1876039508731776:0@lo:502: 00000100:00100000:2.0:1789130844.280300:0:9819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130844.280344:0:9819:0:(client.c:2715:ptlrpc_set_wait()) set ffff91dcc7d68180 going to sleep for 11 seconds 00000100:00100000:3.0:1789130844.288550:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508731776 00000100:00100000:3.0:1789130844.288564:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508731776 00000100:00100000:3.0:1789130844.288620:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1789130844.288638:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8602450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+18:9819:x1876039508731776:12345-0@lo:502: 00000100:00100000:3.0:1789130844.288805:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8602450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+18:9819:x1876039508731776:12345-0@lo:502: Request processed in 168us (8504us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130844.288813:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789130844.289376:0:9819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddca0c6940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:9819:1876039508731776:0@lo:502: 00000100:00100000:2.0:1789130844.289441:0:9819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddca0c6940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:9819:1876039508731904:0@lo:502: 00000100:00100000:2.0:1789130844.289501:0:9819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130844.289532:0:9819:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddd867ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1789130844.290012:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508731904 00000100:00100000:0.0:1789130844.290018:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508731904 00000100:00100000:0.0:1789130844.290065:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1789130844.290074:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8603050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+18:9819:x1876039508731904:12345-0@lo:502: 00000100:00100000:0.0:1789130844.290185:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8603050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+18:9819:x1876039508731904:12345-0@lo:502: Request processed in 112us (684us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130844.290194:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1789130844.290225:0:9819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddca0c6940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:9819:1876039508731904:0@lo:502: 00000040:00080000:2.0:1789130844.290246:0:9819:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:2.0:1789130844.290314:0:6497:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:2.0:1789130844.290333:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789130844.290348:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff91ddc27e6200/0xf3fe2838e1fc20c2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc20c9 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130844.290359:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff91ddc27e6200/0xf3fe2838e1fc20c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc20c9 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789130844.290368:0:6497:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789130844.290371:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff91ddfce33000 from 6 10000000:01000000:2.0:1789130844.290374:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789130844.290398:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff91ddc27e7200/0xf3fe2838e1fc20d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130844.290406:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff91ddc27e7200/0xf3fe2838e1fc20d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130844.290415:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff91ddc27e7200/0xf3fe2838e1fc20d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130844.290427:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddca0c6940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508732032:0@lo:101: 00000100:00100000:2.0:1789130844.290456:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130844.290506:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff91dcc7d68180 going to sleep for 11 seconds 00000100:00100000:3.0:1789130844.290856:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508732032 00000100:00100000:3.0:1789130844.290862:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508732032 00000100:00100000:3.0:1789130844.290963:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1789130844.290972:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8601c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+18:6497:x1876039508732032:12345-0@lo:101: 00010000:00010000:3.0:1789130844.290981:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130844.290995:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91ddfd0b4000/0xf3fe2838e1fc20d7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3fe2838e1fc20d0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130844.291016:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91ddfd0b4000/0xf3fe2838e1fc20d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3fe2838e1fc20d0 expref: 19 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130844.291025:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91ddfd0b4000/0xf3fe2838e1fc20d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc20d0 expref: 19 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130844.291033:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ddfd0b4000, rc 0) 00000100:00100000:3.0:1789130844.291082:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8601c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+19:6497:x1876039508732032:12345-0@lo:101: Request processed in 112us (626us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130844.291089:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1789130844.291151:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddca0c6940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508732032:0@lo:101: 00010000:00010000:2.0:1789130844.291163:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff91ddc27e7200/0xf3fe2838e1fc20d0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc20d7 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130844.291172:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff91ddc27e7200/0xf3fe2838e1fc20d0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3fe2838e1fc20d7 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130844.291214:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddca0c6940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508732160:0@lo:256: 00000100:00100000:2.0:1789130844.291252:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130844.291272:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff91dcc7d68180 going to sleep for 11 seconds 00000100:00100000:3.0:1789130844.293165:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508732160 00000100:00100000:3.0:1789130844.293178:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508732160 00000100:00100000:3.0:1789130844.293242:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1789130844.293252:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8602050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+19:6497:x1876039508732160:12345-0@lo:256: 20000000:01000000:3.0:1789130844.293274:0:6492:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789130844.293292:0:6492:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789130844.293300:0:6492:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:3.0:1789130844.293420:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8602050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+19:6497:x1876039508732160:12345-0@lo:256: Request processed in 169us (2167us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130844.293428:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1789130844.296111:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddca0c6940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508732160:0@lo:256: 10000000:01000000:2.0:1789130844.296189:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789130844.296200:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff91ddc27e7200/0xf3fe2838e1fc20d0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc20d7 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130844.296211:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff91ddc27e7200/0xf3fe2838e1fc20d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc20d7 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789130844.296221:0:6497:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1789130844.296224:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 34 10000000:01000000:2.0:1789130844.296227:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1789130844.296273:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff91dcc7e37400/0xf3fe2838e1fc20de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130844.296282:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff91dcc7e37400/0xf3fe2838e1fc20de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130844.296291:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff91dcc7e37400/0xf3fe2838e1fc20de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130844.296310:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddca0c6940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508732288:0@lo:101: 00000100:00100000:2.0:1789130844.296367:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130844.296408:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddd867ff00 going to sleep for 11 seconds 00000100:00100000:3.0:1789130844.300246:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508732288 00000100:00100000:3.0:1789130844.300260:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508732288 00000100:00100000:3.0:1789130844.300325:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1789130844.300335:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8600c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+19:6497:x1876039508732288:12345-0@lo:101: 00010000:00010000:3.0:1789130844.300351:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130844.300370:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91ddfd0b5a00/0xf3fe2838e1fc20e5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3fe2838e1fc20de expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130844.300395:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91ddfd0b5a00/0xf3fe2838e1fc20e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3fe2838e1fc20de expref: 20 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130844.300405:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91ddfd0b5a00/0xf3fe2838e1fc20e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc20de expref: 20 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130844.300414:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ddfd0b5a00, rc 0) 00000100:00100000:3.0:1789130844.300496:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8600c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+20:6497:x1876039508732288:12345-0@lo:101: Request processed in 162us (4129us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130844.300503:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1789130844.300678:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddca0c6940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508732288:0@lo:101: 00010000:00010000:2.0:1789130844.300697:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff91dcc7e37400/0xf3fe2838e1fc20de lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc20e5 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130844.300724:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff91dcc7e37400/0xf3fe2838e1fc20de lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3fe2838e1fc20e5 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130844.300801:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddca0c6940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508732416:0@lo:501: 00000100:00100000:2.0:1789130844.300836:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130844.300868:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddd867ff00 going to sleep for 11 seconds 00000100:00100000:3.0:1789130844.300919:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508732416 00000100:00100000:3.0:1789130844.300923:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508732416 00000100:00100000:3.0:1789130844.300954:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1789130844.300961:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8601050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+20:6497:x1876039508732416:12345-0@lo:501: 00000100:00100000:3.0:1789130844.301087:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8601050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+20:6497:x1876039508732416:12345-0@lo:501: Request processed in 125us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130844.301094:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1789130844.301276:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddca0c6940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508732416:0@lo:501: 00000100:00100000:2.0:1789130844.301305:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddca0c6940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508732544:0@lo:503: 00000100:00100000:2.0:1789130844.301345:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130844.301368:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddd867ff00 going to sleep for 11 seconds 00000100:00100000:3.0:1789130844.301407:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508732544 00000100:00100000:3.0:1789130844.301412:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508732544 00000100:00100000:3.0:1789130844.301443:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1789130844.301449:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8603450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+20:6497:x1876039508732544:12345-0@lo:503: 00000100:00100000:3.0:1789130844.301550:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8603450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+20:6497:x1876039508732544:12345-0@lo:503: Request processed in 100us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130844.301556:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1789130844.301720:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddca0c6940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508732544:0@lo:503: 00000100:00100000:2.0:1789130844.302744:0:9820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddca0c6940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:9820:1876039508732672:0@lo:502: 00000100:00100000:2.0:1789130844.302800:0:9820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130844.302828:0:9820:0:(client.c:2715:ptlrpc_set_wait()) set ffff91dcc7d68cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789130844.302873:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508732672 00000100:00100000:3.0:1789130844.302879:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508732672 00000100:00100000:3.0:1789130844.302917:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1789130844.302924:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddf5cc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+20:9820:x1876039508732672:12345-0@lo:502: 00000100:00100000:3.0:1789130844.303027:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddf5cc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+20:9820:x1876039508732672:12345-0@lo:502: Request processed in 103us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130844.303034:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1789130844.303090:0:9820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddca0c6940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:9820:1876039508732672:0@lo:502: 00000020:01000000:3.0:1789130844.303118:0:9820:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789130844.303126:0:9820:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1789130844.303143:0:9820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789130844.303146:0:9820:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1789130844.303152:0:9820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789130844.303155:0:9820:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.111@tcp to nid 0x20000c0a8cb6f (192.168.203.111@tcp) 00000020:01000000:3.0:1789130844.303177:0:9820:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1789130844.303180:0:9820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789130844.303195:0:9820:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff91ddff71b490) 00000020:00000080:3.0:1789130844.303219:0:9820:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:3.0:1789130844.303226:0:9820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789130844.303319:0:9820:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:3.0:1789130844.303326:0:9820:0:(osd_handler.c:8895:osd_obd_connect()) connect #5 00000020:00000080:3.0:1789130844.303340:0:9820:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xf3fe2838e1fc20f3 00010000:00080000:3.0:1789130844.303377:0:9820:0:(ldlm_lib.c:102:import_set_conn()) imp ffff91dcc7e71000@lustre-OST0001-osc-MDT0001: add connection 192.168.203.111@tcp at head 00010000:00010000:3.0:1789130844.303626:0:9820:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000040:01000000:3.0:1789130844.303744:0:9820:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1789130844.303755:0:9820:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:3.0:1789130844.303914:0:9820:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789130844.304019:0:9820:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789130844.304161:0:9820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:3.0:1789130844.304252:0:9820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:2.0:1789130844.306599:0:9821:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789130844.306606:0:9821:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1789130844.316227:0:9820:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1789130844.316244:0:9820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1789130844.316295:0:9820:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1789130844.316323:0:9820:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf3fe2838e1fc20fa 00000100:00080000:2.0:1789130844.316335:0:9820:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789130844.316341:0:9820:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff91dcc7e71000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:2.0:1789130844.316377:0:9820:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91ddca0c7c00 x1876039508732800/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789130844.316399:0:9820:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:2.0:1789130844.316560:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddca0c6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3628:1876039508732928:0@lo:400: 00000100:00100000:2.0:1789130844.316635:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130844.316666:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc6d66580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3628:1876039508733440:0@lo:400: 00000100:00100000:2.0:1789130844.316688:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130844.316703:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc6d64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3628:1876039508733952:0@lo:400: 00000100:00100000:2.0:1789130844.316724:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130844.316742:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1789130844.316747:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc6d643c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1876039508733312:0@lo:400: 00000100:00100000:2.0:1789130844.316770:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130844.316785:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc6d66940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1876039508733824:0@lo:400: 00000100:00100000:2.0:1789130844.316806:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130844.316841:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc6d652c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3626:1876039508733184:0@lo:400: 00000100:00100000:3.0:1789130844.316853:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddca0c7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3624:1876039508732800:0@lo:8: 00000100:00100000:2.0:1789130844.316863:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130844.316885:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc6d670c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1876039508733696:0@lo:400: 00000100:00100000:3.0:1789130844.316893:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130844.316905:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130844.316921:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1789130844.316927:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc6d67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1876039508733056:0@lo:400: 00000100:00100000:3.0:1789130844.316936:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508733312 00000100:00100000:3.0:1789130844.316941:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508733312 00000100:00100000:2.0:1789130844.316945:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130844.316959:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc6d65a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3626:1876039508733568:0@lo:400: 00000100:00100000:3.0:1789130844.316973:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508733056 00000100:00100000:3.0:1789130844.316976:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508733056 00000100:00100000:2.0:1789130844.316987:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130844.316990:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789130844.316997:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc6d64f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3628:x1876039508733312:12345-0@lo:400: 00000100:00100000:2.0:1789130844.316999:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc6d64780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3626:1876039508734080:0@lo:400: 00000100:00100000:2.0:1789130844.317031:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130844.317045:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc6d64f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3628:x1876039508733312:12345-0@lo:400: Request processed in 48us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130844.317066:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789130844.317066:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508732928 00000100:00100000:2.0:1789130844.317069:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508732928 00000100:00100000:3.0:1789130844.317081:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789130844.317086:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc6d65e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1876039508733056:12345-0@lo:400: 00000100:00100000:2.0:1789130844.317089:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508733440 00000100:00100000:2.0:1789130844.317091:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508733440 00000100:00100000:2.0:1789130844.317110:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508733952 00000100:00100000:2.0:1789130844.317113:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508733952 00000100:00100000:3.0:1789130844.317118:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc6d65e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1876039508733056:12345-0@lo:400: Request processed in 32us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130844.317124:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508733184 00000100:00100000:3.0:1789130844.317125:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789130844.317126:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508733184 00000100:00100000:2.0:1789130844.317135:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508733568 00000100:00100000:2.0:1789130844.317137:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508733568 00000100:00100000:3.0:1789130844.317140:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508733824 00000100:00100000:3.0:1789130844.317142:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508733824 00000100:00100000:2.0:1789130844.317146:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508734080 00000100:00100000:2.0:1789130844.317148:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508734080 00000100:00100000:3.0:1789130844.317156:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508732800 00000100:00100000:3.0:1789130844.317158:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508732800 00000100:00100000:2.0:1789130844.317160:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789130844.317165:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc6d66d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1876039508732928:12345-0@lo:400: 00000100:00100000:3.0:1789130844.317172:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508733696 00000100:00100000:3.0:1789130844.317174:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508733696 00000100:00100000:3.0:1789130844.317187:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789130844.317192:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc6d65680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3628:x1876039508733824:12345-0@lo:400: 00000100:00100000:2.0:1789130844.317193:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc6d66d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1876039508732928:12345-0@lo:400: Request processed in 29us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130844.317199:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789130844.317211:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789130844.317217:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc6d67c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3628:x1876039508733440:12345-0@lo:400: 00000100:00100000:3.0:1789130844.317218:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc6d65680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3628:x1876039508733824:12345-0@lo:400: Request processed in 26us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130844.317224:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789130844.317234:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789130844.317239:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc6d67840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1876039508733696:12345-0@lo:400: 00000100:00100000:2.0:1789130844.317239:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc6d67c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3628:x1876039508733440:12345-0@lo:400: Request processed in 23us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130844.317245:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789130844.317256:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789130844.317260:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc6d67840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1876039508733696:12345-0@lo:400: Request processed in 22us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130844.317261:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc6d661c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3628:x1876039508733952:12345-0@lo:400: 00000100:00100000:3.0:1789130844.317265:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789130844.317275:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789130844.317279:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7893480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3624:x1876039508732800:12345-0@lo:8: 00000100:00100000:2.0:1789130844.317282:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc6d661c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3628:x1876039508733952:12345-0@lo:400: Request processed in 22us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130844.317287:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789130844.317296:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00010000:00080000:3.0:1789130844.317300:0:8417:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 200 last 0 00000100:00100000:2.0:1789130844.317301:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc6d64b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1876039508733184:12345-0@lo:400: 00000020:00000080:3.0:1789130844.317322:0:8417:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf3fe2838e1fc2101 00000100:00100000:2.0:1789130844.317322:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc6d64b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1876039508733184:12345-0@lo:400: Request processed in 22us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130844.317327:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00002000:00100000:3.0:1789130844.317335:0:8417:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff91dcc7e75000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113984 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:3.0:1789130844.317339:0:8417:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00000001:00000004:3.0:1789130844.317343:0:8417:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:2.0:1789130844.317343:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789130844.317349:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7b24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1876039508733568:12345-0@lo:400: 00000100:00100000:2.0:1789130844.317373:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7b24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1876039508733568:12345-0@lo:400: Request processed in 25us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130844.317379:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789130844.317388:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789130844.317393:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7b24780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1876039508734080:12345-0@lo:400: 00002000:00100000:3.0:1789130844.317401:0:8417:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:2.0:1789130844.317416:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7b24780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1876039508734080:12345-0@lo:400: Request processed in 23us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130844.317421:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000020:01000000:2.0:1789130844.317508:0:9820:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789130844.317513:0:9820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789130844.317515:0:9820:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1789130844.317518:0:9820:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789130844.317522:0:9820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789130844.317523:0:9820:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789130844.317526:0:9820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789130844.317527:0:9820:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1789130844.317549:0:9820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7b26d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:9820:1876039508734208:0@lo:502: 00000100:00100000:2.0:1789130844.317587:0:9820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130844.317610:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508734208 00000100:00100000:2.0:1789130844.317613:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508734208 00002000:00080000:3.0:1789130844.317635:0:8417:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00100000:2.0:1789130844.317636:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1789130844.317641:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddf5cc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+20:9820:x1876039508734208:12345-0@lo:502: 00000100:00080000:3.0:1789130844.317659:0:8417:0:(import.c:65:import_set_state_nolock()) ffff91dcc7e77000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789130844.317693:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7893480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3624:x1876039508732800:12345-0@lo:8: Request processed in 413us (799us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130844.317700:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789130844.317732:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddf5cc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+20:9820:x1876039508734208:12345-0@lo:502: Request processed in 89us (143us total) trans 0 rc 0/0 00010000:00080000:3.0:1789130844.317736:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91ddca0c7c00 x1876039508732800/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789130854 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789130844.317738:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1789130844.317770:0:3624:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00100000:2.0:1789130844.317770:0:9820:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddc4b62c00 going to sleep for 11 seconds 00000100:00080000:3.0:1789130844.317778:0:3624:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 1 00000100:00100000:2.0:1789130844.317784:0:9820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7b26d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:9820:1876039508734208:0@lo:502: 00000100:00080000:3.0:1789130844.317786:0:3624:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1789130844.317791:0:3624:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1789130844.317793:0:3624:0:(import.c:65:import_set_state_nolock()) ffff91dcc7e71000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1789130844.317801:0:3624:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1789130844.317806:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddca0c7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3624:1876039508732800:0@lo:8: 00000020:01000000:2.0:1789130844.317807:0:9820:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789130844.317810:0:9820:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789130844.317812:0:9820:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789130844.317815:0:9820:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000100:00100000:3.0:1789130844.317832:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc6d67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1876039508733056:0@lo:400: 00010000:00080000:3.0:1789130844.317844:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc6d65a40 x1876039508733568/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130860 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130844.317851:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc6d65a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3626:1876039508733568:0@lo:400: 00010000:00080000:3.0:1789130844.317871:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc6d64780 x1876039508734080/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130860 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130844.317878:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc6d64780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3626:1876039508734080:0@lo:400: 00010000:00080000:3.0:1789130844.317888:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc6d652c0 x1876039508733184/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130860 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130844.317895:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc6d652c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3626:1876039508733184:0@lo:400: 00010000:00080000:3.0:1789130844.317902:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc6d670c0 x1876039508733696/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789130860 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130844.317909:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc6d670c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1876039508733696:0@lo:400: 00000004:00080000:2.0:1789130844.317921:0:9821:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000020:01000000:3.0:1789130844.317929:0:6497:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 34-42 (rc=0) 10000000:01000000:3.0:1789130844.317949:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1789130844.317957:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff91dcc7e37400/0xf3fe2838e1fc20de lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc20e5 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789130844.317965:0:9821:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 200235506114ns, next at 0ns, rc = 0 00080000:00080000:2.0:1789130844.317971:0:9821:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00010000:00010000:3.0:1789130844.317973:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff91dcc7e37400/0xf3fe2838e1fc20de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc20e5 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789130844.317982:0:6497:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789130844.317984:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff91dded7b6800 from 39 10000000:01000000:3.0:1789130844.317987:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789130844.318009:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff91ddfd0b4e00/0xf3fe2838e1fc2108 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130844.318016:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff91ddfd0b4e00/0xf3fe2838e1fc2108 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130844.318025:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff91ddfd0b4e00/0xf3fe2838e1fc2108 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130844.318036:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc78912c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508734336:0@lo:101: 00000100:00100000:3.0:1789130844.318075:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130844.318088:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddff3aba80 going to sleep for 11 seconds 00000100:00100000:3.0:1789130844.318109:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc6d643c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1876039508733312:0@lo:400: 00010000:00080000:3.0:1789130844.318118:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc6d66940 x1876039508733824/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789130860 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130844.318125:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc6d66940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1876039508733824:0@lo:400: 00010000:00080000:3.0:1789130844.318133:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91ddca0c6940 x1876039508732928/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130860 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130844.318140:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddca0c6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3628:1876039508732928:0@lo:400: 00010000:00080000:3.0:1789130844.318147:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc6d66580 x1876039508733440/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130860 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130844.318159:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc6d66580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3628:1876039508733440:0@lo:400: 00010000:00080000:3.0:1789130844.318173:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc6d64000 x1876039508733952/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130860 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130844.318181:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc6d64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3628:1876039508733952:0@lo:400: 00000100:00100000:0.0:1789130844.318679:0:9822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddca181680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9822:1876039508734464:0@lo:700: 00000100:00100000:0.0:1789130844.318714:0:9822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130844.318732:0:9822:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddff3c3f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789130844.319619:0:8423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508734464 00000100:00100000:3.0:1789130844.319626:0:8423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508734464 00000100:00100000:3.0:1789130844.319669:0:8423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789130844.319676:0:8423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddca180f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:9822:x1876039508734464:12345-0@lo:700: 00000100:00100000:3.0:1789130844.319709:0:8423:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc78903c0 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8423:1876039508734592:0@lo:700: 00000100:00100000:3.0:1789130844.319740:0:8423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130844.319953:0:8423:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddff3ab0c0 going to sleep for 11 seconds 00000100:00080000:3.0:1789130844.320521:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789130844.320606:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508734336 00000100:00100000:3.0:1789130844.320612:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508734336 00000100:00100000:3.0:1789130844.320644:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1789130844.320651:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddf5cc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+20:6497:x1876039508734336:12345-0@lo:101: 00010000:00010000:3.0:1789130844.320661:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130844.320677:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91ddfd0b4800/0xf3fe2838e1fc210f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3fe2838e1fc2108 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130844.320710:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91ddfd0b4800/0xf3fe2838e1fc210f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3fe2838e1fc2108 expref: 21 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130844.320721:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91ddfd0b4800/0xf3fe2838e1fc210f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc2108 expref: 21 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130844.320740:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ddfd0b4800, rc 0) 00000100:00100000:3.0:1789130844.320990:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddf5cc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+21:6497:x1876039508734336:12345-0@lo:101: Request processed in 338us (2914us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130844.320997:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1789130844.321194:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508734592 00000100:00100000:2.0:1789130844.321208:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508734592 00000100:00100000:2.0:1789130844.321268:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789130844.321279:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7892580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0001:lustre-MDT0000-lwp-OST0001_UUID+5:8423:x1876039508734592:12345-0@lo:700: 00000100:00100000:0.0:1789130844.321587:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc78912c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508734336:0@lo:101: 00010000:00010000:0.0:1789130844.321606:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff91ddfd0b4e00/0xf3fe2838e1fc2108 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc210f expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130844.321616:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff91ddfd0b4e00/0xf3fe2838e1fc2108 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3fe2838e1fc210f expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130844.321687:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7c93840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508734720:0@lo:501: 00000100:00100000:0.0:1789130844.321716:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130844.321751:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddff3c3b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789130844.321839:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508734720 00000100:00100000:3.0:1789130844.321844:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508734720 00000100:00100000:3.0:1789130844.322356:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1789130844.322368:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddf5cc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+21:6497:x1876039508734720:12345-0@lo:501: 00000100:00100000:3.0:1789130844.322504:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddf5cc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+21:6497:x1876039508734720:12345-0@lo:501: Request processed in 138us (786us total) trans 0 rc 0/0 00000004:00080000:2.0:1789130844.323106:0:7432:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:0.0:1789130844.331871:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7c93840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508734720:0@lo:501: 00000100:00100000:0.0:1789130844.332008:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7c93840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508734848:0@lo:503: 00000100:00100000:0.0:1789130844.332122:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130844.332178:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddff3c3b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789130844.333244:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1789130844.333299:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508734848 00000100:00100000:3.0:1789130844.333306:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508734848 00000100:00100000:3.0:1789130844.333419:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1789130844.333430:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddf5cc6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+21:6497:x1876039508734848:12345-0@lo:503: 00000100:00100000:3.0:1789130844.333629:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddf5cc6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+21:6497:x1876039508734848:12345-0@lo:503: Request processed in 200us (1507us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130844.333637:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1789130844.333696:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7c93840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508734848:0@lo:503: 00000100:00100000:3.0:1789130844.335699:0:9823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc78912c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:9823:1876039508734976:0@lo:502: 00000100:00100000:3.0:1789130844.335880:0:9823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130844.335931:0:9823:0:(client.c:2715:ptlrpc_set_wait()) set ffff91dcc7d68cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789130844.337306:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508734976 00000100:00100000:2.0:1789130844.337322:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508734976 00000100:00100000:2.0:1789130844.337385:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1789130844.337396:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddf5cc4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+21:9823:x1876039508734976:12345-0@lo:502: 00000100:00100000:2.0:1789130844.337652:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddf5cc4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+21:9823:x1876039508734976:12345-0@lo:502: Request processed in 257us (1771us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130844.337659:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1789130844.337731:0:9823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc78912c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:9823:1876039508734976:0@lo:502: 00000100:00100000:2.0:1789130844.339075:0:9823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7b26d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:9823:1876039508735104:0@lo:502: 00000100:00100000:2.0:1789130844.339139:0:9823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130844.339167:0:9823:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddc4c51600 going to sleep for 11 seconds 00000100:00100000:2.0:1789130844.339192:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508735104 00000100:00100000:2.0:1789130844.339198:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508735104 00000100:00100000:2.0:1789130844.339238:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1789130844.339246:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddf5cc5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+21:9823:x1876039508735104:12345-0@lo:502: 00000100:00100000:2.0:1789130844.339346:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddf5cc5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+21:9823:x1876039508735104:12345-0@lo:502: Request processed in 100us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130844.339354:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1789130844.339396:0:9823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7b26d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:9823:1876039508735104:0@lo:502: 00000040:00080000:2.0:1789130844.339417:0:9823:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 40000000:02000000:0.0:1789130844.340584:0:6508:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost 00000020:01000000:2.0:1789130844.344272:0:6497:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:2.0:1789130844.344315:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789130844.344327:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff91ddfd0b4e00/0xf3fe2838e1fc2108 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc210f expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130844.344339:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff91ddfd0b4e00/0xf3fe2838e1fc2108 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc210f expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789130844.344350:0:6497:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789130844.344352:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff91dded7b6800 from 6 10000000:01000000:2.0:1789130844.344355:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789130844.344396:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff91dcc7e37800/0xf3fe2838e1fc2116 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130844.344403:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff91dcc7e37800/0xf3fe2838e1fc2116 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130844.344414:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff91dcc7e37800/0xf3fe2838e1fc2116 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130844.344435:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7b26d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508735232:0@lo:101: 00000100:00100000:2.0:1789130844.344515:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130844.344584:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddc4c51600 going to sleep for 11 seconds 00000100:00100000:2.0:1789130844.344610:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508735232 00000100:00100000:2.0:1789130844.344623:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508735232 00000100:00100000:2.0:1789130844.344673:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1789130844.344681:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddf5cc7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+21:6497:x1876039508735232:12345-0@lo:101: 00010000:00010000:2.0:1789130844.344693:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130844.344705:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91dcc7e37c00/0xf3fe2838e1fc211d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3fe2838e1fc2116 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130844.344728:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91dcc7e37c00/0xf3fe2838e1fc211d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3fe2838e1fc2116 expref: 22 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130844.344741:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91dcc7e37c00/0xf3fe2838e1fc211d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc2116 expref: 22 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130844.345159:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dcc7e37c00, rc 0) 00000100:00100000:2.0:1789130844.345206:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddf5cc7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+22:6497:x1876039508735232:12345-0@lo:101: Request processed in 525us (691us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130844.345215:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1789130844.345264:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7b26d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508735232:0@lo:101: 00010000:00010000:2.0:1789130844.345279:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff91dcc7e37800/0xf3fe2838e1fc2116 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc211d expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130844.345288:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff91dcc7e37800/0xf3fe2838e1fc2116 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3fe2838e1fc211d expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130844.345340:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7b26d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508735360:0@lo:256: 00000100:00100000:2.0:1789130844.345373:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130844.345392:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddc4c51600 going to sleep for 11 seconds 00000100:00100000:3.0:1789130844.345422:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508735360 00000100:00100000:3.0:1789130844.345435:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508735360 00000100:00100000:3.0:1789130844.345514:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1789130844.345533:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddf5cc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+22:6497:x1876039508735360:12345-0@lo:256: 20000000:01000000:3.0:1789130844.345559:0:6493:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789130844.345594:0:6493:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789130844.345598:0:6493:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:3.0:1789130844.345720:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddf5cc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+22:6497:x1876039508735360:12345-0@lo:256: Request processed in 189us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130844.345728:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1789130844.348822:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7b26d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508735360:0@lo:256: 10000000:01000000:2.0:1789130844.348912:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789130844.348924:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff91dcc7e37800/0xf3fe2838e1fc2116 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc211d expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130844.348935:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff91dcc7e37800/0xf3fe2838e1fc2116 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc211d expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789130844.348944:0:6497:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1789130844.348947:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:2.0:1789130844.348950:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1789130844.348983:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff91dcc7e36a00/0xf3fe2838e1fc2124 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130844.348990:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff91dcc7e36a00/0xf3fe2838e1fc2124 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130844.348999:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff91dcc7e36a00/0xf3fe2838e1fc2124 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130844.349019:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7b26d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508735488:0@lo:101: 00000100:00100000:2.0:1789130844.349092:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130844.349141:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddc4c51600 going to sleep for 11 seconds 00000100:00100000:3.0:1789130844.349411:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508735488 00000100:00100000:3.0:1789130844.349426:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508735488 00000100:00100000:3.0:1789130844.349521:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1789130844.349532:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddf5cc6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+22:6497:x1876039508735488:12345-0@lo:101: 00010000:00010000:3.0:1789130844.349550:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130844.349628:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91ddfd0b4200/0xf3fe2838e1fc212b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3fe2838e1fc2124 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130844.349663:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91ddfd0b4200/0xf3fe2838e1fc212b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3fe2838e1fc2124 expref: 23 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130844.349677:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91ddfd0b4200/0xf3fe2838e1fc212b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc2124 expref: 23 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130844.349688:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ddfd0b4200, rc 0) 00000100:00100000:3.0:1789130844.349765:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddf5cc6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+23:6497:x1876039508735488:12345-0@lo:101: Request processed in 234us (674us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130844.349773:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1789130844.350067:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7b26d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508735488:0@lo:101: 00010000:00010000:2.0:1789130844.350087:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff91dcc7e36a00/0xf3fe2838e1fc2124 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc212b expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130844.350098:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff91dcc7e36a00/0xf3fe2838e1fc2124 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3fe2838e1fc212b expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130844.350176:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7b26d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508735616:0@lo:501: 00000100:00100000:2.0:1789130844.350215:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130844.350241:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddc4c51600 going to sleep for 11 seconds 00000100:00100000:3.0:1789130844.350308:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508735616 00000100:00100000:3.0:1789130844.350315:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508735616 00000100:00100000:3.0:1789130844.350357:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1789130844.350365:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddf5cc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+23:6497:x1876039508735616:12345-0@lo:501: 00000100:00100000:3.0:1789130844.350545:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddf5cc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+23:6497:x1876039508735616:12345-0@lo:501: Request processed in 180us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130844.350552:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1789130844.351408:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7b26d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508735616:0@lo:501: 00000100:00100000:2.0:1789130844.351452:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7b26d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508735744:0@lo:503: 00000100:00100000:2.0:1789130844.352117:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130844.352161:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddc4c51600 going to sleep for 11 seconds 00000100:00100000:3.0:1789130844.352292:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508735744 00000100:00100000:3.0:1789130844.352306:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508735744 00000100:00100000:3.0:1789130844.352394:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1789130844.352405:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddf5cc4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+23:6497:x1876039508735744:12345-0@lo:503: 00000100:00100000:3.0:1789130844.352887:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddf5cc4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+23:6497:x1876039508735744:12345-0@lo:503: Request processed in 482us (769us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130844.352897:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1789130844.353064:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7b26d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508735744:0@lo:503: 00000100:00100000:0.0:1789130844.354626:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7892580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0001:lustre-MDT0000-lwp-OST0001_UUID+5:8423:x1876039508734592:12345-0@lo:700: Request processed in 33339us (34874us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130844.354643:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1789130844.354915:0:8423:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc78903c0 x1876039508734592/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789130860 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130844.354932:0:8423:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc78903c0 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8423:1876039508734592:0@lo:700: 40000000:02000000:3.0:1789130844.354946:0:8423:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] 00000100:00100000:0.0:1789130844.363864:0:9824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7c92580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:9824:1876039508735872:0@lo:502: 00000100:00100000:0.0:1789130844.363986:0:9824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130844.364542:0:9824:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddff3c3540 going to sleep for 11 seconds 00000001:00100000:0.0:1789130844.369013:0:9493:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:2.0:1789130844.369946:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508735872 00000100:00100000:2.0:1789130844.369963:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508735872 00000100:00100000:2.0:1789130844.370072:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1789130844.370085:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddf5cc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+23:9824:x1876039508735872:12345-0@lo:502: 00000100:00100000:2.0:1789130844.370299:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddf5cc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+23:9824:x1876039508735872:12345-0@lo:502: Request processed in 216us (6314us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130844.370307:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1789130844.370387:0:9824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7c92580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:9824:1876039508735872:0@lo:502: 00000020:01000000:2.0:1789130844.370432:0:9824:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789130844.370442:0:9824:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1789130844.370451:0:9824:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789130844.370453:0:9824:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1789130844.371761:0:9824:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789130844.371773:0:9824:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.111@tcp to nid 0x20000c0a8cb6f (192.168.203.111@tcp) 00000020:01000000:2.0:1789130844.371812:0:9824:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1789130844.371816:0:9824:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789130844.371848:0:9824:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff91dcc6f5b490) 00000020:00000080:2.0:1789130844.371886:0:9824:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type osp with refcount 2 00000020:00000080:2.0:1789130844.371895:0:9824:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789130844.372030:0:9824:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1789130844.372038:0:9824:0:(osd_handler.c:8895:osd_obd_connect()) connect #7 00000020:00000080:2.0:1789130844.372048:0:9824:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf3fe2838e1fc2139 00010000:00080000:2.0:1789130844.372099:0:9824:0:(ldlm_lib.c:102:import_set_conn()) imp ffff91dcc7876000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.111@tcp at head 00010000:00010000:2.0:1789130844.372376:0:9824:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-12 is initialized 00000040:01000000:2.0:1789130844.373929:0:9824:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:2.0:1789130844.373952:0:9824:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1789130844.374227:0:9824:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789130844.374366:0:9824:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789130844.375454:0:8423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddca180f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:9822:x1876039508734464:12345-0@lo:700: Request processed in 55765us (56727us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130844.375487:0:8423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1789130844.376183:0:9822:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91ddca181680 x1876039508734464/t0(0) o700->lustre-OST0001-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789130860 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130844.376203:0:9822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddca181680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9822:1876039508734464:0@lo:700: 00000040:00080000:2.0:1789130844.376314:0:9824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:3.0:1789130844.381437:0:9824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000004:00080000:0.0:1789130844.385984:0:9822:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1789130844.386002:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7c92940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1876039508736000:0@lo:13: 00000100:00100000:0.0:1789130844.386020:0:9822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7c903c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9822:1876039508736128:0@lo:7: 00000040:00080000:2.0:1789130844.386521:0:9825:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789130844.386527:0:9825:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1789130844.389003:0:9824:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789130844.389023:0:9824:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1789130844.389092:0:9824:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1789130844.389129:0:9824:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf3fe2838e1fc2140 00000100:00080000:2.0:1789130844.389147:0:9824:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789130844.389155:0:9824:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff91dcc7876000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:2.0:1789130844.389204:0:9824:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91dcc7b26d00 x1876039508736256/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789130844.389231:0:9824:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:0.0:1789130844.389237:0:9822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130844.389309:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508736128 00000100:00100000:0.0:1789130844.389319:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508736128 00000020:01000000:2.0:1789130844.389328:0:9824:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789130844.389335:0:9824:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789130844.389337:0:9824:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1789130844.389342:0:9824:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789130844.389348:0:9824:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789130844.389350:0:9824:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789130844.389354:0:9824:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789130844.389365:0:9824:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1789130844.389389:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789130844.389402:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7c93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:9822:x1876039508736128:12345-0@lo:7: 00000100:00100000:2.0:1789130844.389406:0:9824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7b27c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:9824:1876039508736384:0@lo:502: 00000100:00100000:2.0:1789130844.389513:0:9824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130844.389553:0:9824:0:(client.c:2715:ptlrpc_set_wait()) set ffff91dcc6ab6300 going to sleep for 11 seconds 00000100:00100000:2.0:1789130844.389598:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508736384 00000100:00100000:2.0:1789130844.389602:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508736384 00000100:00100000:2.0:1789130844.389629:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1789130844.389637:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddf5cc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+23:9824:x1876039508736384:12345-0@lo:502: 00000100:00100000:2.0:1789130844.389779:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddf5cc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+23:9824:x1876039508736384:12345-0@lo:502: Request processed in 142us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130844.389787:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1789130844.389850:0:9824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7b27c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:9824:1876039508736384:0@lo:502: 00000020:01000000:2.0:1789130844.389879:0:9824:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789130844.389883:0:9824:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789130844.389885:0:9824:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789130844.389890:0:9824:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000020:01000000:2.0:1789130844.390011:0:6497:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-42 (rc=0) 10000000:01000000:2.0:1789130844.390034:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1789130844.390045:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff91dcc7e36a00/0xf3fe2838e1fc2124 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc212b expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130844.390069:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff91dcc7e36a00/0xf3fe2838e1fc2124 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc212b expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789130844.390081:0:6497:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1789130844.390084:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff91ddd10e8000 from 1 10000000:01000000:2.0:1789130844.390087:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789130844.390117:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff91dcc7e36600/0xf3fe2838e1fc2147 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130844.390136:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff91dcc7e36600/0xf3fe2838e1fc2147 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130844.390147:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff91dcc7e36600/0xf3fe2838e1fc2147 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130844.390159:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7b27c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508736512:0@lo:101: 00000100:00100000:2.0:1789130844.390189:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130844.390207:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddd85edd80 going to sleep for 11 seconds 00000100:00100000:1.0:1789130844.391822:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508736512 00000100:00100000:1.0:1789130844.391838:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508736512 00000100:00100000:1.0:1789130844.392184:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1789130844.392199:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddf5cc4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+23:6497:x1876039508736512:12345-0@lo:101: 00010000:00010000:1.0:1789130844.392216:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130844.392238:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91dde19ab600/0xf3fe2838e1fc214e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3fe2838e1fc2147 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130844.392268:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91dde19ab600/0xf3fe2838e1fc214e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3fe2838e1fc2147 expref: 24 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130844.392280:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91dde19ab600/0xf3fe2838e1fc214e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc2147 expref: 24 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130844.392289:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dde19ab600, rc 0) 00000100:00100000:1.0:1789130844.392387:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddf5cc4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+24:6497:x1876039508736512:12345-0@lo:101: Request processed in 193us (2195us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130844.392396:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1789130844.392454:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7b27c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508736512:0@lo:101: 00010000:00010000:1.0:1789130844.392497:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff91dcc7e36600/0xf3fe2838e1fc2147 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc214e expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130844.392506:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff91dcc7e36600/0xf3fe2838e1fc2147 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3fe2838e1fc214e expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130844.393349:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc6becf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508736640:0@lo:501: 00000100:00100000:1.0:1789130844.393390:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130844.393437:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddff7a8a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789130844.393494:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508736640 00000100:00100000:1.0:1789130844.393500:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508736640 00000100:00100000:1.0:1789130844.393551:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1789130844.393558:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddf5cc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+24:6497:x1876039508736640:12345-0@lo:501: 00000100:00100000:1.0:1789130844.393647:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddf5cc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+24:6497:x1876039508736640:12345-0@lo:501: Request processed in 90us (256us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789130844.393654:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1789130844.393694:0:9822:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddff3c3f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789130844.394435:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130844.394527:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7b26d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3624:1876039508736256:0@lo:8: 00000100:00100000:3.0:1789130844.394575:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130844.394633:0:8417:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1789130844.394644:0:8417:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1789130844.394666:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508736000 00000100:00100000:3.0:1789130844.394675:0:8418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508736000 00000100:00100000:3.0:1789130844.394729:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789130844.394738:0:8418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc78903c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3626:x1876039508736000:12345-0@lo:13: 00002000:00000024:3.0:1789130844.394777:0:8418:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923922944 avail 3692400640 00000100:00100000:3.0:1789130844.394830:0:8418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc78903c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3626:x1876039508736000:12345-0@lo:13: Request processed in 92us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130844.394838:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789130844.394864:0:8416:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1789130844.394870:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508736256 00000100:00100000:3.0:1789130844.394873:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508736256 00010000:00080000:3.0:1789130844.395084:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc7c92940 x1876039508736000/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789130860 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130844.395109:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7c92940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1876039508736000:0@lo:13: 00000100:00100000:2.0:1789130844.395228:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc6becf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508736640:0@lo:501: 10000000:01000000:2.0:1789130844.395289:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1789130844.395301:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff91dcc7e36600/0xf3fe2838e1fc2147 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc214e expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130844.395312:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff91dcc7e36600/0xf3fe2838e1fc2147 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc214e expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130844.399047:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789130844.399077:0:9827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7890b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3624:x1876039508736256:12345-0@lo:8: 00010000:00080000:2.0:1789130844.399124:0:9827:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 200 last 0 00000020:00000080:2.0:1789130844.399165:0:9827:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf3fe2838e1fc2155 00002000:00100000:2.0:1789130844.399187:0:9827:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff91dcc7ee6800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113984 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1789130844.399193:0:9827:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1789130844.399195:0:9827:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1789130844.399276:0:9827:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789130844.399320:0:9827:0:(import.c:65:import_set_state_nolock()) ffff91dcc7ee5800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789130844.399446:0:9827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7890b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3624:x1876039508736256:12345-0@lo:8: Request processed in 371us (4870us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130844.399456:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:3.0:1789130844.404019:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc7b26d00 x1876039508736256/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789130854 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130844.404039:0:3624:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789130844.404066:0:3624:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1789130844.404078:0:3624:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1789130844.404085:0:3624:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1789130844.404090:0:3624:0:(import.c:65:import_set_state_nolock()) ffff91dcc7876000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1789130844.404166:0:3624:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1789130844.404174:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7b26d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3624:1876039508736256:0@lo:8: 00000004:00080000:1.0:1789130844.404684:0:9825:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1789130844.404787:0:9825:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 200322327616ns, next at 0ns, rc = 0 00080000:00080000:1.0:1789130844.404798:0:9825:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:2.0:1789130844.414733:0:6479:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:2.0:1789130844.420400:0:9826:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:2.0:1789130844.420443:0:9826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7b24f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9826:1876039508736896:0@lo:7: 00000100:00100000:2.0:1789130844.420553:0:9826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130844.420604:0:9826:0:(client.c:2715:ptlrpc_set_wait()) set ffff91dcc6ab6300 going to sleep for 11 seconds 00000100:00100000:2.0:1789130844.420626:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7b261c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1876039508736768:0@lo:13: 00000100:00100000:2.0:1789130844.420655:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130844.420802:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508736896 00000100:00100000:3.0:1789130844.420812:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508736896 00000100:00100000:3.0:1789130844.420889:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789130844.420912:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7b25680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:9826:x1876039508736896:12345-0@lo:7: 00000100:00100000:3.0:1789130844.420983:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508736768 00000100:00100000:3.0:1789130844.420986:0:8418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508736768 00000100:00100000:3.0:1789130844.421018:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789130844.421024:0:8418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7b24b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3627:x1876039508736768:12345-0@lo:13: 00002000:00000024:3.0:1789130844.421038:0:8418:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923922944 avail 3692400640 00000100:00100000:3.0:1789130844.421102:0:8418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7b24b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3627:x1876039508736768:12345-0@lo:13: Request processed in 77us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130844.421109:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1789130844.421155:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc7b261c0 x1876039508736768/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789130860 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130844.421177:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7b261c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1876039508736768:0@lo:13: 00000100:00080000:2.0:1789130844.421389:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00080000:0.0:1789130844.423311:0:8414:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:0.0:1789130844.423321:0:8414:0:(ofd_dev.c:1222:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1789130844.423444:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7c93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:9822:x1876039508736128:12345-0@lo:7: Request processed in 34040us (34205us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130844.423483:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:2.0:1789130844.423549:0:9822:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc7c903c0 x1876039508736128/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789130860 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789130844.423565:0:9822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7c903c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9822:1876039508736128:0@lo:7: 00000004:00080000:2.0:1789130844.423582:0:9822:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1789130844.423630:0:9822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7b27840 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9822:1876039508737024:0@lo:5: 00000100:00100000:2.0:1789130844.423671:0:9822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130844.423712:0:9822:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddd8266540 going to sleep for 11 seconds 00000100:00100000:2.0:1789130844.423730:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508737024 00000100:00100000:2.0:1789130844.423737:0:9827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508737024 00000100:00100000:2.0:1789130844.423788:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789130844.423797:0:9827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7b25e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:9822:x1876039508737024:12345-0@lo:5: 00002000:00080000:2.0:1789130844.423827:0:9827:0:(ofd_dev.c:1654:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:2.0:1789130844.423863:0:9827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7b25e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:9822:x1876039508737024:12345-0@lo:5: Request processed in 67us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130844.423870:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1789130844.423907:0:9822:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc7b27840 x1876039508737024/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789130860 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789130844.423918:0:9822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7b27840 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9822:1876039508737024:0@lo:5: 00000004:00080000:2.0:1789130844.423928:0:9822:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x1:0x0] from OST, last_created [0x2c0000400:0x1:0x0]last_used is [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1789130844.423954:0:9822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7b27840 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9822:1876039508737152:0@lo:5: 00000100:00100000:2.0:1789130844.423974:0:9822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130844.423998:0:9822:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddd8266540 going to sleep for 11 seconds 00000100:00100000:0.0:1789130844.424084:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508737152 00000100:00100000:0.0:1789130844.424089:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508737152 00000100:00100000:0.0:1789130844.424145:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789130844.424155:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7b27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:9822:x1876039508737152:12345-0@lo:5: 00002000:00080000:0.0:1789130844.424185:0:8417:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 2 00002000:00080000:2.0:1789130844.430129:0:8416:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:2.0:1789130844.430142:0:8416:0:(ofd_dev.c:1222:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:2.0:1789130844.430402:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7b25680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:9826:x1876039508736896:12345-0@lo:7: Request processed in 9486us (9842us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130844.430417:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1789130844.430826:0:9826:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc7b24f00 x1876039508736896/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789130860 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130844.430846:0:9826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7b24f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9826:1876039508736896:0@lo:7: 00000004:00080000:3.0:1789130844.430864:0:9826:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:3.0:1789130844.430913:0:9826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7890780 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9826:1876039508737280:0@lo:5: 00000100:00100000:3.0:1789130844.430961:0:9826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130844.431028:0:9826:0:(client.c:2715:ptlrpc_set_wait()) set ffff91dcc782dcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789130844.431074:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508737280 00000100:00100000:2.0:1789130844.431083:0:9827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508737280 00000100:00100000:2.0:1789130844.431132:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789130844.431142:0:9827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7893c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:9826:x1876039508737280:12345-0@lo:5: 00002000:00080000:2.0:1789130844.431176:0:9827:0:(ofd_dev.c:1654:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1789130844.431181:0:9827:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1789130844.433317:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7b27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:9822:x1876039508737152:12345-0@lo:5: Request processed in 9156us (9332us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1789130844.433332:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:3.0:1789130844.433394:0:9822:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc7b27840 x1876039508737152/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789130860 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130844.433415:0:9822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7b27840 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9822:1876039508737152:0@lo:5: 00000004:00080000:3.0:1789130844.433436:0:9822:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x1:0x0]-[0x2c0000400:0x21:0x0] 00000100:00100000:3.0:1789130844.433533:0:9822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7890f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9822:1876039508737408:0@lo:900: 00000100:00100000:3.0:1789130844.433598:0:9822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130844.433624:0:9822:0:(client.c:2715:ptlrpc_set_wait()) set ffff91dcc782d900 going to sleep for 11 seconds 00000100:00100000:2.0:1789130844.435919:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508737408 00000100:00100000:2.0:1789130844.435939:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508737408 00000100:00100000:2.0:1789130844.436007:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789130844.436019:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7891680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:9822:x1876039508737408:12345-0@lo:900: 00000100:00100000:2.0:1789130844.436149:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7891680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:9822:x1876039508737408:12345-0@lo:900: Request processed in 131us (2553us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130844.436158:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1789130844.436211:0:9822:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc7890f00 x1876039508737408/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789130860 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789130844.436247:0:9822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7890f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9822:1876039508737408:0@lo:900: 00000001:00080000:3.0:1789130844.443227:0:9493:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000001:00080000:3.0:1789130844.443252:0:9493:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:3.0:1789130844.443550:0:9493:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1789130844.443812:0:9827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7893c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:9826:x1876039508737280:12345-0@lo:5: Request processed in 12664us (12844us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1789130844.443829:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:3.0:1789130844.443937:0:9826:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc7890780 x1876039508737280/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789130860 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130844.443950:0:9826:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1789130844.443958:0:9826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7890780 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9826:1876039508737280:0@lo:5: 00000004:00080000:3.0:1789130844.443978:0:9826:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:3.0:1789130844.444040:0:9826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7890780 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9826:1876039508737536:0@lo:700: 00000100:00100000:3.0:1789130844.444093:0:9826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130844.444136:0:9826:0:(client.c:2715:ptlrpc_set_wait()) set ffff91dcc782dcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789130844.444222:0:8424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508737536 00000100:00100000:0.0:1789130844.444229:0:8424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508737536 00000100:00100000:0.0:1789130844.444295:0:8424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789130844.444305:0:8424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7892940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9826:x1876039508737536:12345-0@lo:700: 00000100:00100000:0.0:1789130844.460323:0:8424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7892940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9826:x1876039508737536:12345-0@lo:700: Request processed in 16011us (16221us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130844.460338:0:8424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1789130844.460420:0:9826:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc7890780 x1876039508737536/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789130860 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130844.460443:0:9826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7890780 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9826:1876039508737536:0@lo:700: 00000004:02000040:3.0:1789130844.467397:0:9826:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 00000100:00100000:3.0:1789130844.474802:0:9826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7890780 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9826:1876039508737664:0@lo:5: 00000100:00100000:3.0:1789130844.474894:0:9826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130844.476313:0:9826:0:(client.c:2715:ptlrpc_set_wait()) set ffff91dcc782dcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789130844.477380:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508737664 00000100:00100000:0.0:1789130844.477397:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508737664 00000100:00100000:0.0:1789130844.477550:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789130844.477563:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc78930c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:9826:x1876039508737664:12345-0@lo:5: 00002000:00080000:0.0:1789130844.485750:0:8416:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:0.0:1789130844.485777:0:8416:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2 00000100:00100000:0.0:1789130844.487535:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc78930c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:9826:x1876039508737664:12345-0@lo:5: Request processed in 9964us (12631us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1789130844.487550:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:3.0:1789130844.491593:0:9826:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc7890780 x1876039508737664/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789130860 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130844.491620:0:9826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7890780 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9826:1876039508737664:0@lo:5: 00000004:00080000:3.0:1789130844.491640:0:9826:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1:0x0]-[0x2c0000401:0x21:0x0] 00000001:02000400:3.0:1789130844.914969:0:9869:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg311-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1789130845.083803:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789130845.271102:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789130845.271138:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc78921c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1876039508737792:0@lo:13: 00000100:00100000:1.0:1789130845.271245:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130845.271422:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508737792 00000100:00100000:0.0:1789130845.271432:0:8418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508737792 00000100:00100000:0.0:1789130845.271527:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789130845.271539:0:8418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc6befc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1876039508737792:12345-0@lo:13: 00002000:00000024:0.0:1789130845.271593:0:8418:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789130845.271670:0:8418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc6befc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1876039508737792:12345-0@lo:13: Request processed in 133us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130845.271686:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:0.0:1789130845.271749:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc78921c0 x1876039508737792/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789130861 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789130845.271770:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc78921c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1876039508737792:0@lo:13: 00000100:00080000:3.0:1789130845.272226:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789130845.777701:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc6bee940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508737920:0@lo:13: 00000100:00100000:3.0:1789130845.777796:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130845.777863:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508737920 00000100:00100000:1.0:1789130845.777875:0:8418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508737920 00000100:00100000:1.0:1789130845.777981:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789130845.777992:0:8418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7890000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508737920:12345-0@lo:13: 00002000:00000024:1.0:1789130845.778031:0:8418:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789130845.778117:0:8418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7890000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508737920:12345-0@lo:13: Request processed in 126us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130845.778125:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:1.0:1789130845.778160:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789130845.778979:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc6bee940 x1876039508737920/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789130861 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130845.779005:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc6bee940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508737920:0@lo:13: 00000020:00000004:0.0:1789130845.902588:0:9921:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789130845.902924:0:9921:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789130846.111546:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789130846.970631:0:9493:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00010000:00010000:3.0:1789130847.123515:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789130847.827632:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7b243c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508738048:0@lo:41: 00000100:00100000:1.0:1789130847.827750:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130847.827967:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508738048 00000100:00100000:2.0:1789130847.827978:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508738048 00000100:00100000:2.0:1789130847.828053:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789130847.828066:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc6bef840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508738048:12345-0@lo:41: 00000004:00000024:2.0:1789130847.828119:0:6505:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789130847.828196:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc6bef840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508738048:12345-0@lo:41: Request processed in 131us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130847.828205:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789130847.828268:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7b243c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508738048:0@lo:41: 00000100:00100000:0.0:1789130847.829870:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7c903c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508738176:0@lo:41: 00000100:00100000:0.0:1789130847.829965:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130847.831442:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508738176 00000100:00100000:2.0:1789130847.831507:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508738176 00000100:00100000:2.0:1789130847.831587:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789130847.831688:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7c92940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508738176:12345-0@lo:41: 00000004:00000024:2.0:1789130847.831738:0:6505:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1789130847.831834:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7c92940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508738176:12345-0@lo:41: Request processed in 150us (1880us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130847.831842:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789130847.834405:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7c903c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508738176:0@lo:41: 00010000:00010000:2.0:1789130848.146274:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789130849.069394:0:10023:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789130849.069675:0:10023:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789130849.169807:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789130849.874735:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7b26580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1876039508738304:0@lo:13: 00000100:00100000:2.0:1789130849.874830:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130849.874960:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508738304 00000100:00100000:2.0:1789130849.874969:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508738304 00000100:00100000:2.0:1789130849.875043:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789130849.875054:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7b25a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1876039508738304:12345-0@lo:13: 00002000:00000024:2.0:1789130849.875105:0:8419:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789130849.875158:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7b25a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1876039508738304:12345-0@lo:13: Request processed in 105us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130849.875166:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1789130849.875214:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc7b26580 x1876039508738304/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789130865 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789130849.875242:0:3628:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1789130849.875273:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7b26580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1876039508738304:0@lo:13: 00000100:00080000:1.0:1789130849.875848:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789130849.875868:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789130849.875880:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc6bee940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508738432:0@lo:13: 00000100:00100000:1.0:1789130849.875937:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130849.875972:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508738432 00000100:00100000:1.0:1789130849.875977:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508738432 00000100:00100000:1.0:1789130849.876028:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789130849.876038:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc6becf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508738432:12345-0@lo:13: 00002000:00000024:1.0:1789130849.876054:0:8419:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789130849.876092:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc6becf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508738432:12345-0@lo:13: Request processed in 56us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130849.876099:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:1.0:1789130849.876116:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789130849.876135:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc6bee940 x1876039508738432/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789130865 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789130849.876145:0:3626:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:1.0:1789130849.876160:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc6bee940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508738432:0@lo:13: 00000100:00100000:1.0:1789130849.876567:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7890f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3626:1876039508738560:0@lo:400: 00000100:00100000:1.0:1789130849.876604:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130849.876642:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7892d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508739072:0@lo:400: 00000100:00100000:1.0:1789130849.876668:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130849.876765:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc6d66940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508739584:0@lo:400: 00000100:00100000:1.0:1789130849.876813:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130849.876839:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789130849.876845:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc78921c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3626:1876039508738944:0@lo:400: 00000100:00100000:1.0:1789130849.876885:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130849.876912:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc6d66580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1876039508739456:0@lo:400: 00000100:00100000:1.0:1789130849.876935:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130849.876964:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508739072 00000100:00100000:1.0:1789130849.876969:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508739072 00000100:00100000:1.0:1789130849.877006:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789130849.877024:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc6bee940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508739072:12345-0@lo:400: 00000100:00100000:1.0:1789130849.877071:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc6bee940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508739072:12345-0@lo:400: Request processed in 58us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130849.877079:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789130849.877101:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508739584 00000100:00100000:1.0:1789130849.877105:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508739584 00000100:00100000:1.0:1789130849.877137:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508739456 00000100:00100000:1.0:1789130849.877140:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508739456 00000100:00100000:1.0:1789130849.877163:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789130849.877169:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc6bede00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508739584:12345-0@lo:400: 00000100:00100000:1.0:1789130849.877206:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc6bede00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508739584:12345-0@lo:400: Request processed in 37us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130849.877213:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789130849.877225:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789130849.877607:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc78912c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3627:1876039508738688:0@lo:400: 00000100:00100000:2.0:1789130849.877645:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130849.877675:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddca181680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3627:1876039508739200:0@lo:400: 00000100:00100000:2.0:1789130849.877709:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130849.877728:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc6d643c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3627:1876039508739712:0@lo:400: 00000100:00100000:2.0:1789130849.877749:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130849.877771:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1789130849.877778:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7890780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508738816:0@lo:400: 00000100:00100000:2.0:1789130849.877800:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130849.877818:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc6d64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3627:1876039508739328:0@lo:400: 00000100:00100000:2.0:1789130849.877838:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130849.877848:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc6d670c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3627:1876039508739840:0@lo:400: 00000100:00100000:2.0:1789130849.877867:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130849.877954:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508738560 00000100:00100000:3.0:1789130849.877959:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508738560 00000100:00100000:3.0:1789130849.877999:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1789130849.878008:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddcf4fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+24:3626:x1876039508738560:12345-0@lo:400: 00000100:00100000:3.0:1789130849.878064:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddcf4fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+24:3626:x1876039508738560:12345-0@lo:400: Request processed in 58us (1459us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130849.878071:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1789130849.880113:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7816d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1876039508739456:12345-0@lo:400: 00000100:00100000:1.0:1789130849.880220:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7816d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1876039508739456:12345-0@lo:400: Request processed in 127us (3284us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130849.880340:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508738944 00000100:00100000:2.0:1789130849.880349:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508738944 00000100:00100000:2.0:1789130849.880393:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508738688 00000100:00100000:2.0:1789130849.880396:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508738688 00000100:00100000:2.0:1789130849.880410:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508739200 00000100:00100000:2.0:1789130849.880413:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508739200 00000100:00100000:2.0:1789130849.880430:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508739712 00000100:00100000:2.0:1789130849.880433:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508739712 00000100:00100000:2.0:1789130849.880447:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508739328 00000100:00100000:2.0:1789130849.880451:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508739328 00000100:00100000:2.0:1789130849.880481:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508739840 00000100:00100000:2.0:1789130849.880484:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508739840 00000100:00100000:2.0:1789130849.880499:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789130849.880505:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7814780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1876039508738944:12345-0@lo:400: 00000100:00100000:2.0:1789130849.880549:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7814780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1876039508738944:12345-0@lo:400: Request processed in 44us (3663us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130849.880557:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789130849.880574:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789130849.880580:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7b26580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1876039508738688:12345-0@lo:400: 00000100:00100000:2.0:1789130849.880616:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7b26580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1876039508738688:12345-0@lo:400: Request processed in 37us (2971us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130849.880622:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789130849.880634:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789130849.880640:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7b27840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1876039508739200:12345-0@lo:400: 00000100:00100000:2.0:1789130849.880668:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7b27840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1876039508739200:12345-0@lo:400: Request processed in 29us (2959us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130849.880674:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789130849.880684:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789130849.880690:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7b270c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3627:x1876039508739712:12345-0@lo:400: 00000100:00100000:2.0:1789130849.880728:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7b270c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3627:x1876039508739712:12345-0@lo:400: Request processed in 38us (2977us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130849.880734:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789130849.880747:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789130849.880752:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7b243c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1876039508739328:12345-0@lo:400: 00000100:00100000:2.0:1789130849.880780:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7b243c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1876039508739328:12345-0@lo:400: Request processed in 28us (2941us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130849.880785:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789130849.880796:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789130849.880802:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7b252c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3627:x1876039508739840:12345-0@lo:400: 00000100:00100000:2.0:1789130849.880829:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7b252c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3627:x1876039508739840:12345-0@lo:400: Request processed in 27us (2961us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130849.880835:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:2.0:1789130849.880990:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc6d64000 x1876039508739328/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130865 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789130849.881006:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc6d64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3627:1876039508739328:0@lo:400: 00010000:00080000:2.0:1789130849.881033:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc6d670c0 x1876039508739840/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130865 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789130849.881042:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc6d670c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3627:1876039508739840:0@lo:400: 00010000:00080000:2.0:1789130849.881054:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc78912c0 x1876039508738688/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130865 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789130849.881062:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc78912c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3627:1876039508738688:0@lo:400: 00010000:00080000:2.0:1789130849.881074:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91ddca181680 x1876039508739200/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130865 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789130849.881096:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddca181680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3627:1876039508739200:0@lo:400: 00010000:00080000:2.0:1789130849.881110:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc6d643c0 x1876039508739712/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130865 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789130849.881119:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc6d643c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3627:1876039508739712:0@lo:400: 00000100:00100000:0.0:1789130849.884011:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508738816 00000100:00100000:0.0:1789130849.884043:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508738816 00000100:00100000:0.0:1789130849.884098:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789130849.884109:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7b26940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508738816:12345-0@lo:400: 00000100:00100000:1.0:1789130849.884239:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:1.0:1789130849.884379:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789130849.884386:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789130849.884390:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789130849.884432:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc78921c0 x1876039508738944/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130865 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789130849.884449:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc78921c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3626:1876039508738944:0@lo:400: 00010000:00080000:1.0:1789130849.884483:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc6d66580 x1876039508739456/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789130865 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789130849.884493:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc6d66580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1876039508739456:0@lo:400: 00000100:00100000:1.0:1789130849.884506:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7890f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3626:1876039508738560:0@lo:400: 00000100:00100000:1.0:1789130849.884519:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7892d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508739072:0@lo:400: 00010000:00080000:1.0:1789130849.884532:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc6d66940 x1876039508739584/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789130865 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789130849.884541:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc6d66940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508739584:0@lo:400: 00000100:00100000:0.0:1789130849.886496:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7b26940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508738816:12345-0@lo:400: Request processed in 2374us (8678us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130849.886514:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789130849.886912:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7890780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508738816:0@lo:400: 00000020:00000004:2.0:1789130850.134099:0:10071:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789130850.134114:0:10071:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:0.0:1789130850.200313:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789130850.388121:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc6d652c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508739968:0@lo:13: 00000100:00100000:2.0:1789130850.388218:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130850.388684:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508739968 00000100:00100000:3.0:1789130850.388696:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508739968 00000100:00100000:3.0:1789130850.388768:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789130850.388780:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7b24f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1876039508739968:12345-0@lo:13: 00002000:00000024:3.0:1789130850.388819:0:8419:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789130850.388879:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7b24f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1876039508739968:12345-0@lo:13: Request processed in 101us (660us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130850.388888:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:2.0:1789130850.388988:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc6d652c0 x1876039508739968/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789130866 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789130850.389021:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc6d652c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508739968:0@lo:13: 00000100:00100000:2.0:1789130850.607133:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789130850.607897:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498203264 00000100:00100000:0.0:1789130850.607911:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498203264 00000100:00100000:0.0:1789130850.607963:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 180 00000100:00100000:0.0:1789130850.607973:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddcf4fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2384:x1876039498203264:12345-192.168.203.11@tcp:250: 00010000:00080000:0.0:1789130850.608019:0:6493:0:(ldlm_lib.c:1482:target_handle_connect()) MGS: connection from dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6@192.168.203.11@tcp t0 exp 0000000000000000 cur 206 last 0 00000020:00000080:0.0:1789130850.608057:0:6493:0:(genops.c:1385:class_connect()) connect: client dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6, cookie 0xf3fe2838e1fc215c 00000100:00080000:0.0:1789130850.608257:0:6493:0:(import.c:65:import_set_state_nolock()) ffff91dcc78a6800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789130850.608350:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddcf4fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+5:2384:x1876039498203264:12345-192.168.203.11@tcp:250: Request processed in 376us (1232us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130850.608359:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 180 00000100:00100000:2.0:1789130850.624665:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789130850.624789:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498203392 00000100:00100000:1.0:1789130850.624802:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498203392 00000100:00100000:1.0:1789130850.624878:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 181 00000100:00100000:1.0:1789130850.624890:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddcf4fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+5:6146:x1876039498203392:12345-192.168.203.11@tcp:101: 00010000:00010000:1.0:1789130850.624912:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130850.624935:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91dde19aac00/0xf3fe2838e1fc2163 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xf8eae2996d2697ea expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130850.624970:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91dde19aac00/0xf3fe2838e1fc2163 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d2697ea expref: 6 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130850.624983:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91dde19aac00/0xf3fe2838e1fc2163 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d2697ea expref: 6 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130850.625024:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dde19aac00, rc 0) 00000100:00100000:1.0:1789130850.625100:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddcf4fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+6:6146:x1876039498203392:12345-192.168.203.11@tcp:101: Request processed in 212us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130850.625108:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 181 00000100:00100000:3.0:1789130850.627168:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789130850.627330:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498203520 00000100:00100000:1.0:1789130850.627343:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498203520 00000100:00100000:1.0:1789130850.627412:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 182 00000100:00100000:1.0:1789130850.627423:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddcf4f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+6:6146:x1876039498203520:12345-192.168.203.11@tcp:501: 00000100:00100000:1.0:1789130850.627647:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddcf4f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+6:6146:x1876039498203520:12345-192.168.203.11@tcp:501: Request processed in 225us (490us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789130850.627656:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 182 00000100:00100000:3.0:1789130850.634172:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789130850.634346:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498203648 00000100:00100000:0.0:1789130850.634360:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498203648 00000100:00100000:0.0:1789130850.634431:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 183 00000100:00100000:0.0:1789130850.634443:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddcf4fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+6:6146:x1876039498203648:12345-192.168.203.11@tcp:101: 00010000:00010000:0.0:1789130850.634501:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130850.634525:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91ddc0030600/0xf3fe2838e1fc216a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xf8eae2996d2697f1 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130850.634560:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91ddc0030600/0xf3fe2838e1fc216a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d2697f1 expref: 7 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130850.634574:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91ddc0030600/0xf3fe2838e1fc216a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d2697f1 expref: 7 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130850.634585:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ddc0030600, rc 0) 00000100:00100000:0.0:1789130850.634655:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddcf4fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+7:6146:x1876039498203648:12345-192.168.203.11@tcp:101: Request processed in 214us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130850.634663:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 183 00000100:00100000:3.0:1789130850.640772:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789130850.640985:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498203776 00000100:00100000:2.0:1789130850.640998:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498203776 00000100:00100000:2.0:1789130850.641083:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 184 00000100:00100000:2.0:1789130850.641095:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddcf4f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+7:6146:x1876039498203776:12345-192.168.203.11@tcp:501: 00000100:00100000:2.0:1789130850.641325:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddcf4f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+8:6146:x1876039498203776:12345-192.168.203.11@tcp:501: Request processed in 231us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130850.641333:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 184 00000100:00100000:3.0:1789130850.652312:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789130850.652526:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498203904 00000100:00100000:0.0:1789130850.652539:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498203904 00000100:00100000:0.0:1789130850.652613:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 185 00000100:00100000:0.0:1789130850.652625:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddcf4f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+8:6146:x1876039498203904:12345-192.168.203.11@tcp:503: 00000100:00100000:0.0:1789130850.652840:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddcf4f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+8:6146:x1876039498203904:12345-192.168.203.11@tcp:503: Request processed in 217us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130850.652860:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 185 00000100:00100000:2.0:1789130850.662261:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789130850.662374:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498204032 00000100:00100000:3.0:1789130850.662387:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498204032 00000100:00100000:3.0:1789130850.662455:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 186 00000100:00100000:3.0:1789130850.662506:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddcf4fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+8:6165:x1876039498204032:12345-192.168.203.11@tcp:502: 00000100:00100000:3.0:1789130850.667505:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddcf4fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+8:6165:x1876039498204032:12345-192.168.203.11@tcp:502: Request processed in 4982us (5238us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130850.667542:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 186 00000100:00100000:2.0:1789130850.730203:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789130850.730439:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498204160 00000100:00100000:1.0:1789130850.730454:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498204160 00000100:00100000:1.0:1789130850.730589:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 187 00000100:00100000:1.0:1789130850.730601:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddcf4fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+8:6165:x1876039498204160:12345-192.168.203.11@tcp:502: 00000100:00100000:1.0:1789130850.730826:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddcf4fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+8:6165:x1876039498204160:12345-192.168.203.11@tcp:502: Request processed in 226us (638us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130850.730835:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 187 00000100:00100000:1.0:1789130850.735269:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789130850.735426:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498204288 00000100:00100000:2.0:1789130850.735439:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498204288 00000100:00100000:2.0:1789130850.735572:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 188 00000100:00100000:2.0:1789130850.735584:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddcf4fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+8:6146:x1876039498204288:12345-192.168.203.11@tcp:101: 00010000:00010000:2.0:1789130850.735607:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130850.735631:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91dcc7e37200/0xf3fe2838e1fc2171 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269822 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130850.735671:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91dcc7e37200/0xf3fe2838e1fc2171 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269822 expref: 9 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130850.735684:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91dcc7e37200/0xf3fe2838e1fc2171 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269822 expref: 9 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130850.735696:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dcc7e37200, rc 0) 00000100:00100000:2.0:1789130850.735781:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddcf4fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+9:6146:x1876039498204288:12345-192.168.203.11@tcp:101: Request processed in 199us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130850.735789:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 188 00000100:00100000:3.0:1789130850.746155:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789130850.746879:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498204416 00000100:00100000:0.0:1789130850.746896:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498204416 00000100:00100000:0.0:1789130850.746989:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 189 00000100:00100000:0.0:1789130850.747001:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddcf4f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+9:6146:x1876039498204416:12345-192.168.203.11@tcp:256: 20000000:01000000:0.0:1789130850.747050:0:6493:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1789130850.747081:0:6493:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1789130850.747085:0:6493:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1789130850.747088:0:6493:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1789130850.747092:0:6493:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1789130850.747094:0:6493:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:0.0:1789130850.751152:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddcf4f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+9:6146:x1876039498204416:12345-192.168.203.11@tcp:256: Request processed in 4135us (4996us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130850.751173:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 189 00000100:00100000:1.0:1789130850.754547:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789130850.754936:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498204544 00000100:00100000:2.0:1789130850.754948:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498204544 00000100:00100000:2.0:1789130850.755032:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 190 00000100:00100000:2.0:1789130850.755044:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddcf4f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+9:6146:x1876039498204544:12345-192.168.203.11@tcp:101: 00010000:00010000:2.0:1789130850.755066:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130850.755090:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91dcc7e36c00/0xf3fe2838e1fc2178 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269829 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130850.755124:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91dcc7e36c00/0xf3fe2838e1fc2178 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269829 expref: 10 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130850.755136:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91dcc7e36c00/0xf3fe2838e1fc2178 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269829 expref: 10 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130850.755167:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dcc7e36c00, rc 0) 00000100:00100000:2.0:1789130850.755254:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddcf4f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+10:6146:x1876039498204544:12345-192.168.203.11@tcp:101: Request processed in 213us (723us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130850.755263:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 190 00000100:00100000:3.0:1789130850.757119:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789130850.757564:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498204672 00000100:00100000:0.0:1789130850.757578:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498204672 00000100:00100000:0.0:1789130850.757650:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 191 00000100:00100000:0.0:1789130850.757662:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddcf4fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+10:6146:x1876039498204672:12345-192.168.203.11@tcp:501: 00000100:00100000:0.0:1789130850.757871:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddcf4fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+10:6146:x1876039498204672:12345-192.168.203.11@tcp:501: Request processed in 211us (764us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130850.757880:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 191 00000100:00100000:3.0:1789130850.760243:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789130850.760357:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498204800 00000100:00100000:1.0:1789130850.760370:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498204800 00000100:00100000:1.0:1789130850.760437:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 192 00000100:00100000:1.0:1789130850.760448:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddcf7c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+10:6146:x1876039498204800:12345-192.168.203.11@tcp:503: 00000100:00100000:1.0:1789130850.760716:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddcf7c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+10:6146:x1876039498204800:12345-192.168.203.11@tcp:503: Request processed in 270us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130850.760725:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 192 00000100:00100000:1.0:1789130850.766497:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789130850.766656:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498204928 00000100:00100000:2.0:1789130850.766668:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498204928 00000100:00100000:2.0:1789130850.766746:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 193 00000100:00100000:2.0:1789130850.766759:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddcf7c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+10:6171:x1876039498204928:12345-192.168.203.11@tcp:502: 00000100:00100000:2.0:1789130850.766974:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddcf7c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+10:6171:x1876039498204928:12345-192.168.203.11@tcp:502: Request processed in 217us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130850.766984:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 193 00000100:00100000:3.0:1789130850.771002:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789130850.771739:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498205056 00000100:00100000:0.0:1789130850.771754:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498205056 00000100:00100000:0.0:1789130850.771833:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 194 00000100:00100000:0.0:1789130850.771845:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddcf7cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+10:6171:x1876039498205056:12345-192.168.203.11@tcp:502: 00000100:00100000:0.0:1789130850.772076:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddcf7cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+10:6171:x1876039498205056:12345-192.168.203.11@tcp:502: Request processed in 232us (1089us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130850.772092:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 194 00000100:00100000:3.0:1789130850.783730:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789130850.783787:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789130850.784342:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498205184 00000100:00100000:2.0:1789130850.784356:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498205184 00000100:00100000:2.0:1789130850.784416:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498205440 00000100:00100000:2.0:1789130850.784420:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498205440 00000100:00100000:2.0:1789130850.784492:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 7 00000100:00100000:2.0:1789130850.784504:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc6d64780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2384:x1876039498205184:12345-192.168.203.11@tcp:38: 00010000:00080000:2.0:1789130850.784553:0:6500:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from b99c111d-b9b6-4590-88e4-9fefd4d4c3a4@192.168.203.11@tcp t0 exp 0000000000000000 cur 206 last 0 00000020:00000080:2.0:1789130850.784618:0:6500:0:(genops.c:1385:class_connect()) connect: client b99c111d-b9b6-4590-88e4-9fefd4d4c3a4, cookie 0xf3fe2838e1fc217f 00000004:00100000:2.0:1789130850.784652:0:6500:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return 37 00000100:00080000:2.0:1789130850.784962:0:6500:0:(import.c:65:import_set_state_nolock()) ffff91dcc7ee0800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789130850.785064:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc6d64780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+6:2384:x1876039498205184:12345-192.168.203.11@tcp:38: Request processed in 560us (1349us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130850.785073:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 7 00000100:00100000:2.0:1789130850.785100:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 8 00000100:00100000:2.0:1789130850.785122:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc6d65a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2384:x1876039498205440:12345-192.168.203.11@tcp:38: 00010000:00080000:2.0:1789130850.785141:0:6500:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0001: connection from b99c111d-b9b6-4590-88e4-9fefd4d4c3a4@192.168.203.11@tcp t0 exp 0000000000000000 cur 206 last 0 00000020:00000080:2.0:1789130850.785177:0:6500:0:(genops.c:1385:class_connect()) connect: client b99c111d-b9b6-4590-88e4-9fefd4d4c3a4, cookie 0xf3fe2838e1fc2186 00000004:00100000:2.0:1789130850.785192:0:6500:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return 37 00000100:00080000:2.0:1789130850.785910:0:6500:0:(import.c:65:import_set_state_nolock()) ffff91dcc7871000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789130850.785951:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc6d65a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+6:2384:x1876039498205440:12345-192.168.203.11@tcp:38: Request processed in 827us (2162us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130850.785959:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 8 00000100:00100000:2.0:1789130850.898193:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7817c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1876039508740096:0@lo:13: 00000100:00100000:2.0:1789130850.898294:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130850.898553:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508740096 00000100:00100000:1.0:1789130850.898564:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508740096 00000100:00100000:1.0:1789130850.898625:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789130850.898636:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7b261c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1876039508740096:12345-0@lo:13: 00002000:00000024:1.0:1789130850.898666:0:8419:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789130850.898733:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7b261c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1876039508740096:12345-0@lo:13: Request processed in 98us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130850.898741:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:3.0:1789130850.898858:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc7817c00 x1876039508740096/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789130866 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130850.898879:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7817c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1876039508740096:0@lo:13: 00010000:00010000:2.0:1789130851.222033:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789130851.294406:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789130851.294760:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498205696 00000100:00100000:0.0:1789130851.294773:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498205696 00000100:00100000:3.0:1789130851.295541:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789130851.295643:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789130851.295679:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498205568 00000100:00100000:3.0:1789130851.295686:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498205568 00000100:00100000:2.0:1789130851.295787:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498205312 00000100:00100000:2.0:1789130851.295792:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498205312 00000100:00100000:2.0:1789130851.295856:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 9 00000100:00100000:2.0:1789130851.295882:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc6d652c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+7:0:x1876039498205312:12345-192.168.203.11@tcp:41: 00000004:00000024:2.0:1789130851.295942:0:6500:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1789130851.296042:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc6d652c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+7:0:x1876039498205312:12345-192.168.203.11@tcp:41: Request processed in 163us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130851.296051:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 9 00000100:00100000:0.0:1789130851.296541:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 10 00000100:00100000:0.0:1789130851.296554:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc78161c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+6:6146:x1876039498205696:12345-192.168.203.11@tcp:41: 00000004:00000024:0.0:1789130851.296575:0:9769:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1789130851.296624:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc78161c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+6:6146:x1876039498205696:12345-192.168.203.11@tcp:41: Request processed in 73us (2234us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130851.296632:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 10 00000100:00100000:3.0:1789130851.300438:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 11 00000100:00100000:3.0:1789130851.300484:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc6d67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+6:0:x1876039498205568:12345-192.168.203.11@tcp:41: 00000004:00000024:3.0:1789130851.300539:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789130851.302613:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc6d67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+6:0:x1876039498205568:12345-192.168.203.11@tcp:41: Request processed in 2144us (7063us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130851.302650:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 11 00000100:00080000:1.0:1789130851.303380:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789130851.303390:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789130851.320359:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789130851.320494:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498205824 00000100:00100000:0.0:1789130851.320509:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498205824 00000100:00100000:0.0:1789130851.320634:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 12 00000100:00100000:0.0:1789130851.320648:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7b26d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+6:6146:x1876039498205824:12345-192.168.203.11@tcp:40: 00000100:00100000:0.0:1789130851.320774:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7b26d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+6:6146:x1876039498205824:12345-192.168.203.11@tcp:40: Request processed in 129us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130851.320783:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 12 00000100:00100000:0.0:1789130851.324952:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789130851.326315:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498206208 00000100:00100000:3.0:1789130851.326331:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498206208 00000100:00100000:3.0:1789130851.326485:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 4 00000100:00100000:3.0:1789130851.326499:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7c93840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+6:6146:x1876039498206208:12345-192.168.203.11@tcp:900: 00000100:00100000:3.0:1789130851.326856:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7c93840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+6:6146:x1876039498206208:12345-192.168.203.11@tcp:900: Request processed in 359us (1916us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130851.326866:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 4 00000100:00100000:0.0:1789130851.326972:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789130851.327147:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789130851.327204:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498205952 00000100:00100000:3.0:1789130851.327210:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498205952 00000100:00100000:3.0:1789130851.327239:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498206080 00000100:00100000:3.0:1789130851.327242:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498206080 00000100:00100000:3.0:1789130851.327257:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 16 00000100:00100000:3.0:1789130851.327262:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7c92580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2384:x1876039498205952:12345-192.168.203.11@tcp:8: 00010000:00080000:3.0:1789130851.327296:0:8414:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from b99c111d-b9b6-4590-88e4-9fefd4d4c3a4@192.168.203.11@tcp t0 exp 0000000000000000 cur 207 last 0 00000020:00000080:3.0:1789130851.327331:0:8414:0:(genops.c:1385:class_connect()) connect: client b99c111d-b9b6-4590-88e4-9fefd4d4c3a4, cookie 0xf3fe2838e1fc218d 00002000:00100000:3.0:1789130851.327346:0:8414:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli b99c111d-b9b6-4590-88e4-9fefd4d4c3a4/ffff91dcc7e70800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113984 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789130851.327360:0:8414:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return 37 00002000:00080000:3.0:1789130851.327591:0:8414:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789130851.327626:0:8414:0:(import.c:65:import_set_state_nolock()) ffff91dcc7e70000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789130851.327723:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 17 00000100:00100000:1.0:1789130851.327729:0:9827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7c903c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2384:x1876039498206080:12345-192.168.203.11@tcp:8: 00010000:00080000:1.0:1789130851.327748:0:9827:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from b99c111d-b9b6-4590-88e4-9fefd4d4c3a4@192.168.203.11@tcp t0 exp 0000000000000000 cur 207 last 0 00000020:00000080:1.0:1789130851.327770:0:9827:0:(genops.c:1385:class_connect()) connect: client b99c111d-b9b6-4590-88e4-9fefd4d4c3a4, cookie 0xf3fe2838e1fc2194 00002000:00100000:1.0:1789130851.327775:0:9827:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli b99c111d-b9b6-4590-88e4-9fefd4d4c3a4/ffff91dcc1ee1800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113984 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789130851.327790:0:9827:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return 37 00002000:00080000:1.0:1789130851.327927:0:9827:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789130851.327944:0:9827:0:(import.c:65:import_set_state_nolock()) ffff91dcc1ee6800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789130851.329095:0:9827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7c903c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+6:2384:x1876039498206080:12345-192.168.203.11@tcp:8: Request processed in 1356us (1939us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130851.329138:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 17 00000100:00100000:3.0:1789130851.329342:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7c92580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+6:2384:x1876039498205952:12345-192.168.203.11@tcp:8: Request processed in 2076us (2369us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130851.329351:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 16 00000100:00100000:0.0:1789130851.332820:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789130851.333271:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498206336 00000100:00100000:1.0:1789130851.333285:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498206336 00000100:00100000:1.0:1789130851.333357:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 195 00000100:00100000:1.0:1789130851.333369:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8606050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+10:2386:x1876039498206336:12345-192.168.203.11@tcp:400: 00000100:00100000:1.0:1789130851.333492:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8606050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+10:2386:x1876039498206336:12345-192.168.203.11@tcp:400: Request processed in 125us (685us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130851.333500:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 195 00000100:00100000:3.0:1789130851.334521:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789130851.334829:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498206464 00000100:00100000:0.0:1789130851.334838:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498206464 00000100:00100000:0.0:1789130851.334891:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 0 00000100:00100000:0.0:1789130851.334913:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc6d66940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+6:6146:x1876039498206464:12345-192.168.203.11@tcp:33: 00000004:00080000:0.0:1789130851.380877:0:6503:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 45496us 00000004:00200000:2.0:1789130851.421092:0:6503:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1789130851.421205:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc6d66940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+6:6146:x1876039498206464:12345-192.168.203.11@tcp:33: Request processed in 86290us (86686us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130851.421221:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 0 00000100:00100000:3.0:1789130851.622526:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789130851.622727:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498206592 00000100:00100000:2.0:1789130851.622737:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498206592 00000100:00100000:2.0:1789130851.622803:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 13 00000100:00100000:2.0:1789130851.622813:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc6d66580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+6:6189:x1876039498206592:12345-192.168.203.11@tcp:101: 00010000:00010000:2.0:1789130851.622834:0:6501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130851.623180:0:6501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7e37600/0xf3fe2838e1fc219b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d26985a expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130851.623290:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7e36200/0xf3fe2838e1fc21a2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130851.623307:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7e36200/0xf3fe2838e1fc21a2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130851.623328:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7e36200/0xf3fe2838e1fc21a2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789130851.623390:0:6501:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789130851.623395:0:6501:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789130851.623420:0:6501:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7e36200/0xf3fe2838e1fc21a2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130851.623455:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7e37600/0xf3fe2838e1fc219b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d26985a expref: 8 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130851.623520:0:6501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7e36200/0xf3fe2838e1fc21a2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d26985a expref: 7 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130851.623531:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91dcc7d6c700) 00010000:00010000:2.0:1789130851.623535:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789130851.623539:0:6501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dcc7e36200, rc 0) 00000100:00100000:2.0:1789130851.625282:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc6d66580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+7:6189:x1876039498206592:12345-192.168.203.11@tcp:101: Request processed in 2457us (2751us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130851.625315:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 13 00010000:00010000:1.0:1789130852.245265:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789130852.947302:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789130852.947332:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7c90780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1876039508740224:0@lo:41: 00000100:00100000:2.0:1789130852.947415:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130852.947731:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508740224 00000100:00100000:1.0:1789130852.947739:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508740224 00000100:00100000:1.0:1789130852.947785:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789130852.947794:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7b27c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3628:x1876039508740224:12345-0@lo:41: 00000004:00000024:1.0:1789130852.947826:0:6505:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1789130852.947872:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7b27c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3628:x1876039508740224:12345-0@lo:41: Request processed in 79us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130852.947880:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789130852.947942:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789130852.947953:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7814f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1876039508740352:0@lo:41: 00000100:00100000:3.0:1789130852.947986:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130852.948383:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508740352 00000100:00100000:1.0:1789130852.948388:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508740352 00000100:00100000:1.0:1789130852.948408:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789130852.948416:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc6d643c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1876039508740352:12345-0@lo:41: 00000004:00000024:1.0:1789130852.948433:0:6505:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789130852.948511:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc6d643c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1876039508740352:12345-0@lo:41: Request processed in 95us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130852.948517:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789130852.948643:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7814f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1876039508740352:0@lo:41: 00000100:00100000:2.0:1789130852.949736:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7c90780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1876039508740224:0@lo:41: 00010000:00010000:0.0:1789130853.265669:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789130853.611068:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789130853.614454:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498206720 00000100:00100000:2.0:1789130853.614483:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498206720 00000100:00100000:2.0:1789130853.614636:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 14 00000100:00100000:2.0:1789130853.614647:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc6d670c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+7:6241:x1876039498206720:12345-192.168.203.11@tcp:41: 00000004:00000024:2.0:1789130853.614685:0:6500:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1789130853.614763:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc6d670c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+7:6241:x1876039498206720:12345-192.168.203.11@tcp:41: Request processed in 118us (3703us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130853.614772:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 14 00000100:00100000:3.0:1789130853.618492:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789130853.618611:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498206848 00000100:00100000:0.0:1789130853.618624:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498206848 00000100:00080000:1.0:1789130853.622601:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789130853.622629:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789130853.625042:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 15 00000100:00100000:0.0:1789130853.625060:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc6d64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+6:6241:x1876039498206848:12345-192.168.203.11@tcp:41: 00000004:00000024:0.0:1789130853.625100:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789130853.625177:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc6d64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+6:6241:x1876039498206848:12345-192.168.203.11@tcp:41: Request processed in 123us (6725us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130853.625185:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 15 00000100:00100000:3.0:1789130853.630032:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789130853.630145:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498206976 00000100:00100000:1.0:1789130853.630159:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498206976 00000100:00100000:1.0:1789130853.630249:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 16 00000100:00100000:1.0:1789130853.630259:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddca0c6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+6:6241:x1876039498206976:12345-192.168.203.11@tcp:13: 00002000:00000024:1.0:1789130853.630290:0:8419:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789130853.630362:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddca0c6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+6:6241:x1876039498206976:12345-192.168.203.11@tcp:13: Request processed in 104us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130853.630370:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 16 00000100:00080000:2.0:1789130853.630439:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789130853.632680:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789130853.634014:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498207104 00000100:00100000:1.0:1789130853.634029:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498207104 00000100:00100000:1.0:1789130853.634156:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 17 00000100:00100000:1.0:1789130853.634167:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddca0c7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+6:6241:x1876039498207104:12345-192.168.203.11@tcp:13: 00002000:00000024:1.0:1789130853.634201:0:8419:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789130853.634274:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddca0c7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+6:6241:x1876039498207104:12345-192.168.203.11@tcp:13: Request processed in 109us (1616us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130853.634282:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 17 00000100:00080000:2.0:1789130853.643737:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1789130854.289773:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789130854.994516:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7d99e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508740736:0@lo:400: 00000100:00100000:3.0:1789130854.994586:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130854.994637:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7d9a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3627:1876039508741248:0@lo:400: 00000100:00100000:3.0:1789130854.994663:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130854.994685:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7d98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3627:1876039508741760:0@lo:400: 00000100:00100000:3.0:1789130854.994705:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130854.994730:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1789130854.994736:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7d9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3627:1876039508740864:0@lo:400: 00000100:00100000:3.0:1789130854.994756:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130854.994769:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7d99a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508741376:0@lo:400: 00000100:00100000:3.0:1789130854.994800:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130854.994823:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7d98780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508741888:0@lo:400: 00000100:00100000:3.0:1789130854.994846:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130854.994882:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508740736 00000100:00100000:3.0:1789130854.994889:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508740736 00000100:00100000:3.0:1789130854.994926:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789130854.994934:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7d9bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508740736:12345-0@lo:400: 00000100:00100000:3.0:1789130854.994994:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7d9bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508740736:12345-0@lo:400: Request processed in 60us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130854.995008:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789130854.995031:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508741248 00000100:00100000:3.0:1789130854.995035:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508741248 00000100:00100000:3.0:1789130854.995062:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508741760 00000100:00100000:3.0:1789130854.995065:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508741760 00000100:00100000:3.0:1789130854.995077:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508740864 00000100:00100000:3.0:1789130854.995079:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508740864 00000100:00100000:3.0:1789130854.995090:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789130854.995095:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7d9a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1876039508741248:12345-0@lo:400: 00000100:00100000:3.0:1789130854.995125:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7d9a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1876039508741248:12345-0@lo:400: Request processed in 30us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130854.995131:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789130854.995142:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789130854.995147:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7d98f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3627:x1876039508741760:12345-0@lo:400: 00000100:00100000:3.0:1789130854.995168:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7d98f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3627:x1876039508741760:12345-0@lo:400: Request processed in 21us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130854.995173:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789130854.995181:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789130854.995186:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7d99680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1876039508740864:12345-0@lo:400: 00000100:00100000:3.0:1789130854.995222:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7d99680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1876039508740864:12345-0@lo:400: Request processed in 36us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130854.995228:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:3.0:1789130854.995242:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789130854.995270:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7d9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3627:1876039508740864:0@lo:400: 00000100:00100000:3.0:1789130854.995279:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7d99e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508740736:0@lo:400: 00010000:00080000:3.0:1789130854.995288:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc7d9a580 x1876039508741248/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130870 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130854.995304:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7d9a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3627:1876039508741248:0@lo:400: 00010000:00080000:3.0:1789130854.995317:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc7d98000 x1876039508741760/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130870 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130854.995324:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7d98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3627:1876039508741760:0@lo:400: 00000100:00100000:0.0:1789130854.995554:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7d98b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3625:1876039508740480:0@lo:400: 00000100:00100000:0.0:1789130854.995590:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130854.995622:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7d992c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508740992:0@lo:400: 00000100:00100000:0.0:1789130854.995647:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130854.995666:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7d9b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508741504:0@lo:400: 00000100:00100000:0.0:1789130854.995685:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130854.995704:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7d9ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508742016:0@lo:400: 00000100:00100000:0.0:1789130854.995729:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130854.995749:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1789130854.995756:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7d9b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3625:1876039508740608:0@lo:400: 00000100:00100000:0.0:1789130854.995777:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130854.995797:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7d983c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3625:1876039508741120:0@lo:400: 00000100:00100000:0.0:1789130854.995817:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130854.995834:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7d9a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3625:1876039508741632:0@lo:400: 00000100:00100000:0.0:1789130854.995855:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130854.995877:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508740608 00000100:00100000:0.0:1789130854.995888:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508740608 00000100:00100000:0.0:1789130854.995910:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508741120 00000100:00100000:0.0:1789130854.995913:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508741120 00000100:00100000:0.0:1789130854.995932:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508741632 00000100:00100000:0.0:1789130854.995935:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508741632 00000100:00100000:0.0:1789130854.995948:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789130854.995955:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff7c1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1876039508740608:12345-0@lo:400: 00000100:00100000:0.0:1789130854.996006:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff7c1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1876039508740608:12345-0@lo:400: Request processed in 51us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130854.996012:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789130854.996025:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789130854.996031:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff7c2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1876039508741120:12345-0@lo:400: 00000100:00100000:0.0:1789130854.996056:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff7c2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1876039508741120:12345-0@lo:400: Request processed in 26us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130854.996062:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789130854.996072:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789130854.996078:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff7c0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1876039508741632:12345-0@lo:400: 00000100:00100000:0.0:1789130854.996118:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff7c0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1876039508741632:12345-0@lo:400: Request processed in 39us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130854.996125:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789130854.996148:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508741376 00000100:00100000:0.0:1789130854.996151:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508741376 00000100:00100000:0.0:1789130854.996167:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508741888 00000100:00100000:0.0:1789130854.996170:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508741888 00000100:00100000:0.0:1789130854.996180:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508741504 00000100:00100000:0.0:1789130854.996182:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508741504 00000100:00100000:0.0:1789130854.996210:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508742016 00000100:00100000:0.0:1789130854.996214:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508742016 00000100:00100000:0.0:1789130854.996229:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789130854.996241:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7ad12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508741376:12345-0@lo:400: 00000100:00100000:0.0:1789130854.996280:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7ad12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508741376:12345-0@lo:400: Request processed in 39us (1479us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130854.996286:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789130854.996298:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789130854.996305:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7ad03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508741888:12345-0@lo:400: 00000100:00100000:0.0:1789130854.996332:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7ad03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508741888:12345-0@lo:400: Request processed in 29us (1485us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130854.996338:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789130854.996349:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789130854.996354:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddffa81680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1876039508741504:12345-0@lo:400: 00000100:00100000:0.0:1789130854.996380:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddffa81680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1876039508741504:12345-0@lo:400: Request processed in 26us (693us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130854.996399:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789130854.996410:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789130854.996416:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff7c21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1876039508742016:12345-0@lo:400: 00000100:00100000:0.0:1789130854.996443:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff7c21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1876039508742016:12345-0@lo:400: Request processed in 28us (714us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130854.996449:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789130854.996492:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508740992 00000100:00100000:0.0:1789130854.996497:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508740992 00000100:00100000:0.0:1789130854.996514:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789130854.996520:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7c90780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1876039508740992:12345-0@lo:400: 00000100:00100000:0.0:1789130854.996550:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7c90780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1876039508740992:12345-0@lo:400: Request processed in 30us (903us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130854.996555:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:0.0:1789130854.996587:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789130854.996590:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789130854.996592:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789130854.996625:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7d9b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3625:1876039508740608:0@lo:400: 00000100:00100000:0.0:1789130854.996636:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7d983c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3625:1876039508741120:0@lo:400: 00000100:00100000:0.0:1789130854.996647:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7d9a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3625:1876039508741632:0@lo:400: 00000100:00100000:0.0:1789130854.996658:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7d992c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508740992:0@lo:400: 00010000:00080000:0.0:1789130854.996668:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc7d9b0c0 x1876039508741504/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789130870 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789130854.996678:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7d9b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508741504:0@lo:400: 00010000:00080000:0.0:1789130854.996688:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc7d9ad00 x1876039508742016/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789130870 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789130854.996696:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7d9ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508742016:0@lo:400: 00000100:00100000:3.0:1789130854.996925:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508740480 00000100:00100000:3.0:1789130854.996930:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508740480 00000100:00100000:3.0:1789130854.996974:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1789130854.996992:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8604c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+24:3625:x1876039508740480:12345-0@lo:400: 00000100:00100000:3.0:1789130854.997036:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8604c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+24:3625:x1876039508740480:12345-0@lo:400: Request processed in 56us (1446us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130854.997042:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1789130854.997079:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7d98b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3625:1876039508740480:0@lo:400: 00010000:00080000:3.0:1789130854.997105:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc7d99a40 x1876039508741376/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789130870 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130854.997114:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7d99a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508741376:0@lo:400: 00010000:00080000:3.0:1789130854.997123:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc7d98780 x1876039508741888/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789130870 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130854.997131:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7d98780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508741888:0@lo:400: 00000100:00100000:1.0:1789130854.997437:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7815680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508742144:0@lo:13: 00000100:00100000:1.0:1789130854.997495:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130854.997528:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508742144 00000100:00100000:1.0:1789130854.997532:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508742144 00000100:00100000:1.0:1789130854.997561:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789130854.997568:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7814b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508742144:12345-0@lo:13: 00002000:00000024:1.0:1789130854.997584:0:8419:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789130854.997620:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7814b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508742144:12345-0@lo:13: Request processed in 53us (125us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130854.997627:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:1.0:1789130854.997666:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc7815680 x1876039508742144/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789130870 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789130854.997679:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7815680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508742144:0@lo:13: 00000100:00100000:0.0:1789130855.001553:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7ad2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508742272:0@lo:13: 00000100:00100000:0.0:1789130855.001623:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130855.001740:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508742272 00000100:00100000:1.0:1789130855.001748:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508742272 00000100:00100000:1.0:1789130855.001803:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789130855.001813:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff7c2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508742272:12345-0@lo:13: 00002000:00000024:1.0:1789130855.001837:0:8419:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789130855.001889:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff7c2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508742272:12345-0@lo:13: Request processed in 78us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130855.001896:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:1.0:1789130855.001943:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc7ad2580 x1876039508742272/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789130871 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789130855.001961:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7ad2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508742272:0@lo:13: 00010000:00010000:1.0:1789130855.313986:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789130855.511441:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789130855.511510:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7ad1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1876039508742400:0@lo:13: 00000100:00100000:0.0:1789130855.511574:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130855.511692:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508742400 00000100:00100000:3.0:1789130855.511699:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508742400 00000100:00100000:3.0:1789130855.511742:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789130855.511749:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff7c03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1876039508742400:12345-0@lo:13: 00002000:00000024:3.0:1789130855.511774:0:8419:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789130855.511830:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff7c03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1876039508742400:12345-0@lo:13: Request processed in 80us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130855.511837:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:3.0:1789130855.511880:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc7ad1a40 x1876039508742400/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789130871 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130855.511907:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7ad1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1876039508742400:0@lo:13: 00000100:00100000:1.0:1789130856.017668:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789130856.017700:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7815680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1876039508742528:0@lo:13: 00000100:00100000:1.0:1789130856.017798:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130856.018001:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508742528 00000100:00100000:3.0:1789130856.018010:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508742528 00000100:00100000:3.0:1789130856.018090:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789130856.018101:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7817840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1876039508742528:12345-0@lo:13: 00002000:00000024:3.0:1789130856.018128:0:8419:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789130856.018186:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7817840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1876039508742528:12345-0@lo:13: Request processed in 86us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130856.018194:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:3.0:1789130856.018244:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc7815680 x1876039508742528/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789130872 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130856.018265:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7815680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1876039508742528:0@lo:13: 00000100:00080000:1.0:1789130856.019216:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:1.0:1789130856.035076:0:9493:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of b99c111d-b9b6-4590-88e4-9fefd4d4c3a4 00000001:02000400:0.0:1789130856.293592:0:10169:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1789130856.338324:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789130856.798896:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789130856.798961:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789130856.799037:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789130856.799070:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789130856.799102:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789130856.799136:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498207488 00000100:00100000:0.0:1789130856.799155:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498207488 00000100:00100000:0.0:1789130856.799240:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498207360 00000100:00100000:0.0:1789130856.799244:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498207360 00000100:00100000:0.0:1789130856.799270:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 55 00000100:00100000:0.0:1789130856.799280:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff7c3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+6:2385:x1876039498207488:12345-192.168.203.11@tcp:400: 00000100:00100000:0.0:1789130856.799373:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff7c3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+6:2385:x1876039498207488:12345-192.168.203.11@tcp:400: Request processed in 92us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130856.799381:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 55 00000100:00100000:0.0:1789130856.799402:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 56 00000100:00100000:0.0:1789130856.799408:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01a5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+7:2385:x1876039498207360:12345-192.168.203.11@tcp:400: 00000100:00080000:1.0:1789130856.799434:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789130856.799441:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789130856.799504:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498207744 00000100:00100000:1.0:1789130856.799508:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498207744 00000100:00100000:1.0:1789130856.799545:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498207616 00000100:00100000:1.0:1789130856.799548:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498207616 00000100:00100000:2.0:1789130856.799640:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498207232 00000100:00100000:2.0:1789130856.799645:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498207232 00000100:00100000:1.0:1789130856.802088:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 14 00000100:00100000:1.0:1789130856.802123:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01a5de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+5:2385:x1876039498207744:12345-192.168.203.11@tcp:400: 00000100:00100000:1.0:1789130856.802239:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01a5de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+5:2385:x1876039498207744:12345-192.168.203.11@tcp:400: Request processed in 134us (3200us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130856.802899:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 197 00000100:00100000:2.0:1789130856.802920:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8605050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+10:2385:x1876039498207232:12345-192.168.203.11@tcp:400: 00000100:00100000:2.0:1789130856.802978:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8605050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+10:2385:x1876039498207232:12345-192.168.203.11@tcp:400: Request processed in 52us (4082us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130856.802988:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 197 00000100:00100000:0.0:1789130856.804163:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01a5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+7:2385:x1876039498207360:12345-192.168.203.11@tcp:400: Request processed in 28us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130856.804177:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 56 00000100:00100000:3.0:1789130856.806491:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 15 00000100:00100000:1.0:1789130856.806510:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 14 00000100:00080000:1.0:1789130856.806567:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789130856.806574:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789130856.807043:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01a5d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+6:2385:x1876039498207616:12345-192.168.203.11@tcp:400: 00000100:00100000:3.0:1789130856.807305:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01a5d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+6:2385:x1876039498207616:12345-192.168.203.11@tcp:400: Request processed in 797us (8200us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130856.807315:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 15 00000001:00100000:0.0:1789130857.043368:0:6479:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of b99c111d-b9b6-4590-88e4-9fefd4d4c3a4 00000001:00100000:0.0:1789130857.045951:0:8410:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of b99c111d-b9b6-4590-88e4-9fefd4d4c3a4 00000001:00100000:3.0:1789130857.047087:0:7432:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of b99c111d-b9b6-4590-88e4-9fefd4d4c3a4 00010000:00010000:2.0:1789130857.361891:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789130858.065626:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01a5c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1876039508742656:0@lo:41: 00000100:00100000:1.0:1789130858.065717:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130858.065759:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508742656 00000100:00100000:0.0:1789130858.065768:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508742656 00000100:00100000:0.0:1789130858.065831:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789130858.065844:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7817480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1876039508742656:12345-0@lo:41: 00000004:00000024:0.0:1789130858.065892:0:6506:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1789130858.065981:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789130858.065984:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7817480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1876039508742656:12345-0@lo:41: Request processed in 141us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130858.065994:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789130858.066006:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7ad1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1876039508742784:0@lo:41: 00000100:00100000:0.0:1789130858.066054:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01a5c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1876039508742656:0@lo:41: 00000100:00100000:3.0:1789130858.066547:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130858.067995:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508742784 00000100:00100000:1.0:1789130858.068007:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508742784 00000100:00100000:1.0:1789130858.068067:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789130858.068079:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7ad30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3628:x1876039508742784:12345-0@lo:41: 00000004:00000024:1.0:1789130858.068119:0:6505:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789130858.068212:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7ad30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3628:x1876039508742784:12345-0@lo:41: Request processed in 134us (1663us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130858.068221:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789130858.068246:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7ad1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1876039508742784:0@lo:41: 00010000:00010000:0.0:1789130858.386590:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130859.412146:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789130859.815447:0:10316:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff586902d0 20000000:00000080:1.0:1789130859.815482:0:10316:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff91ddff804000 uarg=0000000000000000 20000000:01000000:1.0:1789130859.815540:0:10316:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:1.0:1789130859.815543:0:10316:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:1.0:1789130859.815545:0:10316:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:1.0:1789130859.815551:0:10316:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:1.0:1789130859.815555:0:10316:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:1.0:1789130859.815611:0:10316:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:1.0:1789130859.815613:0:10316:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1789130859.827882:0:10317:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000040:00080000:1.0:1789130859.828178:0:10316:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].43, 224 off15672 00000040:00080000:1.0:1789130859.828208:0:10316:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].44, 120 off15792 00000040:00080000:1.0:1789130859.828223:0:10316:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].45, 224 off16016 20000000:01000000:1.0:1789130859.828235:0:10316:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1789130859.828252:0:10316:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1789130859.828929:0:10318:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000040:00080000:2.0:1789130859.829578:0:10316:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 224 off15640 00000040:00080000:2.0:1789130859.829603:0:10316:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 120 off15760 00000040:00080000:2.0:1789130859.829611:0:10316:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15984 20000000:01000000:2.0:1789130859.829621:0:10316:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1789130859.829623:0:10316:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1789130859.832655:0:10319:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000040:00080000:2.0:1789130859.833534:0:10316:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10160 00000040:00080000:2.0:1789130859.833572:0:10316:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 120 off10280 00000040:00080000:2.0:1789130859.833589:0:10316:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 224 off10504 20000000:01000000:2.0:1789130859.833602:0:10316:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1789130859.833604:0:10316:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1789130859.836619:0:10320:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 8 count 8 00000040:00080000:2.0:1789130859.836928:0:10316:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9632 00000040:00080000:2.0:1789130859.836967:0:10316:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 120 off9752 00000040:00080000:2.0:1789130859.836981:0:10316:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off9976 20000000:01000000:2.0:1789130859.836992:0:10316:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1789130859.836995:0:10316:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1789130859.838275:0:10321:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000040:00080000:3.0:1789130859.839007:0:10316:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].49, 224 off16608 00000040:00080000:3.0:1789130859.839038:0:10316:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].50, 120 off16728 00000040:00080000:3.0:1789130859.839054:0:10316:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].51, 224 off16952 10000000:01000000:3.0:1789130859.839073:0:10316:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1789130859.839094:0:10316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91ddfd0b4400/0xf3fe2838e1fc21a9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130859.839112:0:10316:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91ddfd0b5c00/0xf3fe2838e1fc2044 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc203d expref: 23 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130859.839120:0:10316:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91ddc27e7800/0xf3fe2838e1fc206e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc2067 expref: 23 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130859.839126:0:10316:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91ddc27e6c00/0xf3fe2838e1fc20ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc20a6 expref: 23 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130859.839133:0:10316:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91ddc27e7c00/0xf3fe2838e1fc20bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc20b4 expref: 23 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130859.839210:0:10316:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91ddc27e7600/0xf3fe2838e1fc20c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc20c2 expref: 23 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130859.839217:0:10316:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91ddfd0b5a00/0xf3fe2838e1fc20e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc20de expref: 23 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130859.839225:0:10316:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91ddfd0b4800/0xf3fe2838e1fc210f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc2108 expref: 23 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130859.839231:0:10316:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91ddfd0b4200/0xf3fe2838e1fc212b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc2124 expref: 23 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130859.839243:0:10316:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91dde19ab600/0xf3fe2838e1fc214e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc2147 expref: 23 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130859.839253:0:10316:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91dde19aac00/0xf3fe2838e1fc2163 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d2697ea expref: 9 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130859.839261:0:10316:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91ddc0030600/0xf3fe2838e1fc216a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d2697f1 expref: 9 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130859.839269:0:10316:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91ddfd0b4400/0xf3fe2838e1fc21a9 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130859.839634:0:10316:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91ddc0030600/0xf3fe2838e1fc216a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d2697f1 expref: 9 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130859.839649:0:10316:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91ddc0030600/0xf3fe2838e1fc216a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d2697f1 expref: 9 pid: 6493 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130859.839665:0:10316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7ad0000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10316:1876039508742912:192.168.203.11@tcp:104: 00010000:00010000:3.0:1789130859.839804:0:10316:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91dde19aac00/0xf3fe2838e1fc2163 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d2697ea expref: 9 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130859.839814:0:10316:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91dde19aac00/0xf3fe2838e1fc2163 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d2697ea expref: 9 pid: 6492 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130859.839823:0:10316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7ad0780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10316:1876039508743040:192.168.203.11@tcp:104: 00010000:00010000:3.0:1789130859.839863:0:10316:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91dde19ab600/0xf3fe2838e1fc214e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf3fe2838e1fc2147 expref: 23 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130859.839882:0:10316:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91dde19ab600/0xf3fe2838e1fc214e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf3fe2838e1fc2147 expref: 23 pid: 6493 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130859.839892:0:10316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7ad2d00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10316:1876039508743168:0@lo:104: 00000100:00100000:3.0:1789130859.839926:0:10316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789130859.839975:0:10316:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91ddfd0b4200/0xf3fe2838e1fc212b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf3fe2838e1fc2124 expref: 23 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130859.839983:0:10316:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91ddfd0b4200/0xf3fe2838e1fc212b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf3fe2838e1fc2124 expref: 23 pid: 6494 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130859.839991:0:10316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7ad21c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10316:1876039508743296:0@lo:104: 00000100:00100000:3.0:1789130859.840011:0:10316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789130859.840043:0:10316:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91ddfd0b4800/0xf3fe2838e1fc210f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf3fe2838e1fc2108 expref: 23 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130859.840051:0:10316:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91ddfd0b4800/0xf3fe2838e1fc210f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf3fe2838e1fc2108 expref: 23 pid: 6494 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130859.840060:0:10316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7ad1680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10316:1876039508743424:0@lo:104: 00000100:00100000:3.0:1789130859.840080:0:10316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130859.840106:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508743168 00000100:00100000:3.0:1789130859.840112:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508743168 00000100:00100000:3.0:1789130859.840160:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508743296 00000100:00100000:3.0:1789130859.840164:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508743296 00000100:00100000:3.0:1789130859.840175:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508743424 00000100:00100000:3.0:1789130859.840177:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508743424 00000100:00100000:3.0:1789130859.840189:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789130859.840196:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7ad3c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+5:10316:x1876039508743168:12345-0@lo:104: 00010000:00010000:3.0:1789130859.840213:0:6483:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff91dcc7e36600/0xf3fe2838e1fc2147 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3fe2838e1fc214e expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130859.840251:0:6483:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789130859.840256:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7ad3c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+5:10316:x1876039508743168:12345-0@lo:104: Request processed in 61us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130859.840263:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789130859.840279:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789130859.840284:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7ad0f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+4:10316:x1876039508743296:12345-0@lo:104: 00010000:00010000:3.0:1789130859.840304:0:6483:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff91dcc7e36a00/0xf3fe2838e1fc2124 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3fe2838e1fc212b expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130859.840333:0:6483:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789130859.840337:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7ad0f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+4:10316:x1876039508743296:12345-0@lo:104: Request processed in 53us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130859.840351:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789130859.840362:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789130859.840368:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7ad0b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+3:10316:x1876039508743424:12345-0@lo:104: 00010000:00010000:3.0:1789130859.840375:0:6483:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff91ddfd0b4e00/0xf3fe2838e1fc2108 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3fe2838e1fc210f expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130859.840400:0:6483:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1789130859.840404:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7ad0b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+3:10316:x1876039508743424:12345-0@lo:104: Request processed in 37us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130859.840409:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:3.0:1789130859.840426:0:7442:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789130859.840431:0:7442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff91dcc7e36600/0xf3fe2838e1fc2147 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3fe2838e1fc214e expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130859.840443:0:7442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc7e36600 already unused, calling callback (ffffffffc124bc20) 10000000:00010000:3.0:1789130859.840447:0:7442:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff91dcc7e36600/0xf3fe2838e1fc2147 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0xf3fe2838e1fc214e expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130859.840484:0:7442:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff91dcc7e36600/0xf3fe2838e1fc2147 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0xf3fe2838e1fc214e expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789130859.840493:0:7442:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff91dcc7e36600/0xf3fe2838e1fc2147 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0xf3fe2838e1fc214e expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789130859.840498:0:7442:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789130859.840520:0:7442:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff91dcc7e36600/0xf3fe2838e1fc2147 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc214e expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130859.840526:0:7442:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789130859.840540:0:7442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff91dcc7e36600/0xf3fe2838e1fc2147 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc214e expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130859.840547:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff91dcc7e36600/0xf3fe2838e1fc2147 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc214e expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130859.840559:0:7442:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789130859.840562:0:7442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff91dcc7e36a00/0xf3fe2838e1fc2124 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3fe2838e1fc212b expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130859.840567:0:7442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc7e36a00 already unused, calling callback (ffffffffc124bc20) 10000000:00010000:3.0:1789130859.840570:0:7442:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff91dcc7e36a00/0xf3fe2838e1fc2124 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0xf3fe2838e1fc212b expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130859.840586:0:7442:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff91dcc7e36a00/0xf3fe2838e1fc2124 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xf3fe2838e1fc212b expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789130859.840592:0:7442:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff91dcc7e36a00/0xf3fe2838e1fc2124 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0xf3fe2838e1fc212b expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789130859.840598:0:7442:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789130859.840608:0:7442:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff91dcc7e36a00/0xf3fe2838e1fc2124 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc212b expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130859.840613:0:7442:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789130859.840625:0:7442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff91dcc7e36a00/0xf3fe2838e1fc2124 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc212b expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130859.840631:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff91dcc7e36a00/0xf3fe2838e1fc2124 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc212b expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130859.840639:0:7442:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789130859.840641:0:7442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff91ddfd0b4e00/0xf3fe2838e1fc2108 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3fe2838e1fc210f expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130859.840646:0:7442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddfd0b4e00 already unused, calling callback (ffffffffc124bc20) 10000000:00010000:3.0:1789130859.840648:0:7442:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff91ddfd0b4e00/0xf3fe2838e1fc2108 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xf3fe2838e1fc210f expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130859.840655:0:7442:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff91ddfd0b4e00/0xf3fe2838e1fc2108 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xf3fe2838e1fc210f expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789130859.840661:0:7442:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff91ddfd0b4e00/0xf3fe2838e1fc2108 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xf3fe2838e1fc210f expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789130859.840673:0:7442:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789130859.840686:0:7442:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff91ddfd0b4e00/0xf3fe2838e1fc2108 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc210f expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130859.840692:0:7442:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789130859.840698:0:7442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff91ddfd0b4e00/0xf3fe2838e1fc2108 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc210f expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130859.840704:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff91ddfd0b4e00/0xf3fe2838e1fc2108 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc210f expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130859.840715:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130859.840716:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130859.840718:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789130859.840730:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7ad1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3625:1876039508743680:0@lo:103: 00000100:00100000:3.0:1789130859.840760:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130859.840781:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789130859.840788:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7ad3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3625:1876039508743808:0@lo:103: 00000100:00100000:3.0:1789130859.840808:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789130859.840841:0:10316:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91ddfd0b5a00/0xf3fe2838e1fc20e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf3fe2838e1fc20de expref: 23 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130859.840851:0:10316:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91ddfd0b5a00/0xf3fe2838e1fc20e5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf3fe2838e1fc20de expref: 23 pid: 6492 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130859.840860:0:10316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7ad2580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10316:1876039508743936:0@lo:104: 00000100:00100000:3.0:1789130859.840882:0:10316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130859.840902:0:6483:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789130859.840915:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508743936 00000100:00100000:3.0:1789130859.840918:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508743936 00000100:00100000:3.0:1789130859.840937:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789130859.840943:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc7054450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+3:10316:x1876039508743936:12345-0@lo:104: 00010000:00010000:3.0:1789130859.840962:0:6483:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff91dcc7e37400/0xf3fe2838e1fc20de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3fe2838e1fc20e5 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130859.840990:0:6483:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789130859.840995:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc7054450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+3:10316:x1876039508743936:12345-0@lo:104: Request processed in 53us (113us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130859.841001:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:3.0:1789130859.841038:0:7442:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789130859.841042:0:7442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff91dcc7e37400/0xf3fe2838e1fc20de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3fe2838e1fc20e5 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130859.841048:0:7442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc7e37400 already unused, calling callback (ffffffffc124bc20) 10000000:00010000:3.0:1789130859.841052:0:7442:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff91dcc7e37400/0xf3fe2838e1fc20de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xf3fe2838e1fc20e5 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130859.841059:0:7442:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff91dcc7e37400/0xf3fe2838e1fc20de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xf3fe2838e1fc20e5 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789130859.841065:0:7442:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff91dcc7e37400/0xf3fe2838e1fc20de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xf3fe2838e1fc20e5 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789130859.841070:0:7442:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789130859.841086:0:7442:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff91dcc7e37400/0xf3fe2838e1fc20de lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc20e5 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130859.841092:0:7442:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789130859.841103:0:7442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff91dcc7e37400/0xf3fe2838e1fc20de lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc20e5 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130859.841109:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff91dcc7e37400/0xf3fe2838e1fc20de lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc20e5 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130859.841117:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130859.841119:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130859.841120:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130859.841138:0:10316:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91ddc27e7600/0xf3fe2838e1fc20c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf3fe2838e1fc20c2 expref: 23 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130859.841146:0:10316:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91ddc27e7600/0xf3fe2838e1fc20c9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf3fe2838e1fc20c2 expref: 23 pid: 6492 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130859.841153:0:10316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7ad0f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10316:1876039508744192:0@lo:104: 00000100:00100000:3.0:1789130859.841174:0:10316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130859.841193:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508744192 00000100:00100000:3.0:1789130859.841196:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508744192 00000100:00100000:3.0:1789130859.841214:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789130859.841219:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7ad0b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+3:10316:x1876039508744192:12345-0@lo:104: 00010000:00010000:3.0:1789130859.841226:0:6483:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff91ddc27e6200/0xf3fe2838e1fc20c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3fe2838e1fc20c9 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130859.841254:0:6483:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789130859.841259:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7ad0b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+3:10316:x1876039508744192:12345-0@lo:104: Request processed in 40us (85us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130859.841265:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00010000:3.0:1789130859.841278:0:7442:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789130859.841282:0:7442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff91ddc27e6200/0xf3fe2838e1fc20c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3fe2838e1fc20c9 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130859.841293:0:7442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddc27e6200 already unused, calling callback (ffffffffc124bc20) 10000000:00010000:3.0:1789130859.841296:0:7442:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff91ddc27e6200/0xf3fe2838e1fc20c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xf3fe2838e1fc20c9 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130859.841302:0:7442:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff91ddc27e6200/0xf3fe2838e1fc20c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xf3fe2838e1fc20c9 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789130859.841308:0:7442:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff91ddc27e6200/0xf3fe2838e1fc20c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xf3fe2838e1fc20c9 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789130859.841313:0:7442:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789130859.841327:0:7442:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff91ddc27e6200/0xf3fe2838e1fc20c2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc20c9 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130859.841332:0:7442:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789130859.841336:0:7442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff91ddc27e6200/0xf3fe2838e1fc20c2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc20c9 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130859.841341:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff91ddc27e6200/0xf3fe2838e1fc20c2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc20c9 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130859.841351:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130859.841352:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130859.841354:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130859.841370:0:10316:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91ddc27e7c00/0xf3fe2838e1fc20bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf3fe2838e1fc20b4 expref: 23 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130859.841377:0:10316:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91ddc27e7c00/0xf3fe2838e1fc20bb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf3fe2838e1fc20b4 expref: 23 pid: 6494 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130859.841395:0:10316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7c91e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10316:1876039508744448:0@lo:104: 00000100:00100000:3.0:1789130859.841417:0:10316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130859.841434:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508744448 00000100:00100000:3.0:1789130859.841437:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508744448 00000100:00100000:3.0:1789130859.841456:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789130859.841485:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7c912c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+3:10316:x1876039508744448:12345-0@lo:104: 00010000:00010000:3.0:1789130859.841492:0:6483:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff91dde19aae00/0xf3fe2838e1fc20b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3fe2838e1fc20bb expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130859.841520:0:6483:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789130859.841524:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7c912c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+3:10316:x1876039508744448:12345-0@lo:104: Request processed in 42us (107us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130859.841530:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00010000:3.0:1789130859.841544:0:7442:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789130859.841548:0:7442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff91dde19aae00/0xf3fe2838e1fc20b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3fe2838e1fc20bb expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130859.841553:0:7442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dde19aae00 already unused, calling callback (ffffffffc124bc20) 10000000:00010000:3.0:1789130859.841556:0:7442:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff91dde19aae00/0xf3fe2838e1fc20b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xf3fe2838e1fc20bb expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130859.841562:0:7442:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff91dde19aae00/0xf3fe2838e1fc20b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xf3fe2838e1fc20bb expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789130859.841567:0:7442:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff91dde19aae00/0xf3fe2838e1fc20b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xf3fe2838e1fc20bb expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789130859.841572:0:7442:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789130859.841592:0:7442:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff91dde19aae00/0xf3fe2838e1fc20b4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc20bb expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130859.841598:0:7442:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789130859.841606:0:7442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff91dde19aae00/0xf3fe2838e1fc20b4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc20bb expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130859.841612:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff91dde19aae00/0xf3fe2838e1fc20b4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc20bb expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130859.841621:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130859.841622:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130859.841624:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789130859.841633:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7d98780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3625:1876039508744576:0@lo:103: 00000100:00100000:3.0:1789130859.841669:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789130859.841705:0:10316:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91ddc27e6c00/0xf3fe2838e1fc20ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf3fe2838e1fc20a6 expref: 23 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130859.841714:0:10316:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91ddc27e6c00/0xf3fe2838e1fc20ad lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf3fe2838e1fc20a6 expref: 23 pid: 6492 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130859.841722:0:10316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7d98b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10316:1876039508744704:0@lo:104: 00000100:00100000:3.0:1789130859.841743:0:10316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130859.841761:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508744704 00000100:00100000:3.0:1789130859.841765:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508744704 00000100:00100000:3.0:1789130859.841786:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789130859.841792:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7d9ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+3:10316:x1876039508744704:12345-0@lo:104: 00010000:00010000:3.0:1789130859.841800:0:6483:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff91dde19abe00/0xf3fe2838e1fc20a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3fe2838e1fc20ad expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130859.841840:0:6483:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789130859.841845:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7d9ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+3:10316:x1876039508744704:12345-0@lo:104: Request processed in 54us (102us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130859.841851:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00010000:3.0:1789130859.841866:0:7442:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789130859.841869:0:7442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff91dde19abe00/0xf3fe2838e1fc20a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3fe2838e1fc20ad expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130859.841874:0:7442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dde19abe00 already unused, calling callback (ffffffffc124bc20) 10000000:00010000:3.0:1789130859.841877:0:7442:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff91dde19abe00/0xf3fe2838e1fc20a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf3fe2838e1fc20ad expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130859.841884:0:7442:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff91dde19abe00/0xf3fe2838e1fc20a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf3fe2838e1fc20ad expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789130859.841890:0:7442:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff91dde19abe00/0xf3fe2838e1fc20a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf3fe2838e1fc20ad expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789130859.841895:0:7442:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789130859.841908:0:7442:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff91dde19abe00/0xf3fe2838e1fc20a6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc20ad expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130859.841914:0:7442:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789130859.841923:0:7442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff91dde19abe00/0xf3fe2838e1fc20a6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc20ad expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130859.841929:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff91dde19abe00/0xf3fe2838e1fc20a6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc20ad expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130859.842605:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7ad3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3627:1876039508744064:0@lo:103: 00000100:00100000:1.0:1789130859.842640:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130859.842669:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789130859.842675:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7ad3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3627:1876039508743552:0@lo:103: 00000100:00100000:1.0:1789130859.842695:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130859.842705:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc5fe92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3627:1876039508744320:0@lo:103: 00000100:00100000:1.0:1789130859.842723:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130859.842745:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508743680 00000100:00100000:1.0:1789130859.842750:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508743680 00010000:00010000:1.0:1789130859.842773:0:6485:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91ddfd0b4200/0xf3fe2838e1fc212b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3fe2838e1fc2124 expref: 24 pid: 6494 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130859.842790:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508743808 00000100:00100000:1.0:1789130859.842793:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508743808 00010000:00010000:1.0:1789130859.842804:0:6485:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91ddfd0b4800/0xf3fe2838e1fc210f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3fe2838e1fc2108 expref: 25 pid: 6494 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130859.842812:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508744576 00000100:00100000:1.0:1789130859.842814:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508744576 00010000:00010000:1.0:1789130859.842837:0:6485:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91ddc27e7c00/0xf3fe2838e1fc20bb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3fe2838e1fc20b4 expref: 26 pid: 6494 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130859.842847:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508744064 00000100:00100000:1.0:1789130859.842849:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508744064 00010000:00010000:1.0:1789130859.842859:0:6485:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91ddfd0b5a00/0xf3fe2838e1fc20e5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3fe2838e1fc20de expref: 27 pid: 6492 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130859.842881:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508743552 00000100:00100000:1.0:1789130859.842884:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508743552 00010000:00010000:1.0:1789130859.842893:0:6485:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91dde19ab600/0xf3fe2838e1fc214e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3fe2838e1fc2147 expref: 28 pid: 6493 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130859.842901:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508744320 00000100:00100000:1.0:1789130859.842903:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508744320 00010000:00010000:1.0:1789130859.842911:0:6485:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91ddc27e7600/0xf3fe2838e1fc20c9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3fe2838e1fc20c2 expref: 29 pid: 6492 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130859.842920:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789130859.842926:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc33ae050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+29:3625:x1876039508743680:12345-0@lo:103: 00010000:00010000:1.0:1789130859.842936:0:6485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789130859.842940:0:6485:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91ddfd0b4200/0xf3fe2838e1fc212b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3fe2838e1fc2124 expref: 29 pid: 6494 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130859.842961:0:6485:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91ddfd0b4200/0xf3fe2838e1fc212b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf3fe2838e1fc2124 expref: 29 pid: 6494 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130859.842978:0:6485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789130859.843005:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc33ae050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+29:3625:x1876039508743680:12345-0@lo:103: Request processed in 79us (2244us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130859.843012:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789130859.843053:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789130859.843060:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7ad1a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+28:3625:x1876039508743808:12345-0@lo:103: 00010000:00010000:1.0:1789130859.843067:0:6485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789130859.843070:0:6485:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91ddfd0b4800/0xf3fe2838e1fc210f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3fe2838e1fc2108 expref: 28 pid: 6494 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130859.843088:0:6485:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91ddfd0b4800/0xf3fe2838e1fc210f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf3fe2838e1fc2108 expref: 28 pid: 6494 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130859.843098:0:6485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789130859.843122:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7ad1a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+28:3625:x1876039508743808:12345-0@lo:103: Request processed in 63us (2312us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130859.843128:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789130859.843210:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789130859.843217:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7d99a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+27:3625:x1876039508744576:12345-0@lo:103: 00010000:00010000:1.0:1789130859.843224:0:6485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789130859.843229:0:6485:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91ddc27e7c00/0xf3fe2838e1fc20bb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3fe2838e1fc20b4 expref: 27 pid: 6494 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130859.843236:0:6485:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91ddc27e7c00/0xf3fe2838e1fc20bb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf3fe2838e1fc20b4 expref: 27 pid: 6494 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130859.843244:0:6485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789130859.843268:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7d99a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+27:3625:x1876039508744576:12345-0@lo:103: Request processed in 52us (1599us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130859.843274:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789130859.843295:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789130859.843302:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7815e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+26:3627:x1876039508744064:12345-0@lo:103: 00010000:00010000:1.0:1789130859.843309:0:6485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789130859.843313:0:6485:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91ddfd0b5a00/0xf3fe2838e1fc20e5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3fe2838e1fc20de expref: 26 pid: 6492 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130859.843321:0:6485:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91ddfd0b5a00/0xf3fe2838e1fc20e5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf3fe2838e1fc20de expref: 26 pid: 6492 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130859.843337:0:6485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789130859.843486:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789130859.843508:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789130859.843518:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc78152c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+26:3627:x1876039508743552:12345-0@lo:103: 00010000:00010000:2.0:1789130859.843526:0:6486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789130859.843530:0:6486:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91dde19ab600/0xf3fe2838e1fc214e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3fe2838e1fc2147 expref: 26 pid: 6493 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130859.843540:0:6486:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91dde19ab600/0xf3fe2838e1fc214e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf3fe2838e1fc2147 expref: 26 pid: 6493 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130859.843550:0:6486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789130859.843584:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc78152c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+26:3627:x1876039508743552:12345-0@lo:103: Request processed in 69us (888us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130859.843590:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789130859.843603:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789130859.843609:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc78143c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+25:3627:x1876039508744320:12345-0@lo:103: 00010000:00010000:2.0:1789130859.843617:0:6486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789130859.843627:0:6486:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91ddc27e7600/0xf3fe2838e1fc20c9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3fe2838e1fc20c2 expref: 25 pid: 6492 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130859.843634:0:6486:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91ddc27e7600/0xf3fe2838e1fc20c9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf3fe2838e1fc20c2 expref: 25 pid: 6492 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130859.843645:0:6486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789130859.843668:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc78143c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+25:3627:x1876039508744320:12345-0@lo:103: Request processed in 60us (944us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130859.843674:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789130859.843801:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7815e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+24:3627:x1876039508744064:12345-0@lo:103: Request processed in 500us (1159us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130859.843809:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789130859.843865:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7ad3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3627:1876039508743552:0@lo:103: 00000100:00100000:1.0:1789130859.843877:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc5fe92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3627:1876039508744320:0@lo:103: 00000100:00100000:1.0:1789130859.843885:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7ad3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3627:1876039508744064:0@lo:103: 00000100:00100000:1.0:1789130859.844551:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7d9b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3626:1876039508744832:0@lo:103: 00000100:00100000:1.0:1789130859.844588:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789130859.844636:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789130859.844897:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508744832 00000100:00100000:2.0:1789130859.844903:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508744832 00010000:00010000:2.0:1789130859.844927:0:6486:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91ddc27e6c00/0xf3fe2838e1fc20ad lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3fe2838e1fc20a6 expref: 24 pid: 6492 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130859.844966:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789130859.844974:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7816580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+24:3626:x1876039508744832:12345-0@lo:103: 00010000:00010000:2.0:1789130859.844984:0:6486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789130859.844989:0:6486:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91ddc27e6c00/0xf3fe2838e1fc20ad lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3fe2838e1fc20a6 expref: 24 pid: 6492 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130859.844998:0:6486:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91ddc27e6c00/0xf3fe2838e1fc20ad lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf3fe2838e1fc20a6 expref: 24 pid: 6492 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130859.845012:0:6486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789130859.845046:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7816580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+24:3626:x1876039508744832:12345-0@lo:103: Request processed in 73us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130859.845054:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789130859.845225:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7d9b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3626:1876039508744832:0@lo:103: 00010000:00010000:2.0:1789130859.845589:0:10316:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91ddc27e7800/0xf3fe2838e1fc206e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf3fe2838e1fc2067 expref: 23 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130859.845614:0:10316:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91ddc27e7800/0xf3fe2838e1fc206e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf3fe2838e1fc2067 expref: 23 pid: 6494 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130859.845626:0:10316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddca181680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10316:1876039508744960:0@lo:104: 00000100:00100000:2.0:1789130859.845658:0:10316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789130859.845693:0:10316:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91ddfd0b5c00/0xf3fe2838e1fc2044 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf3fe2838e1fc203d expref: 23 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130859.845701:0:10316:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91ddfd0b5c00/0xf3fe2838e1fc2044 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf3fe2838e1fc203d expref: 23 pid: 6494 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130859.845709:0:10316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7890780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10316:1876039508745088:0@lo:104: 00000100:00100000:2.0:1789130859.845729:0:10316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130859.845753:0:10316:0:(client.c:2715:ptlrpc_set_wait()) set ffff91de01a87600 going to sleep for 11 seconds 00010000:00010000:2.0:1789130859.845768:0:10316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91dde19ab600/0xf3fe2838e1fc214e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf3fe2838e1fc2147 expref: 23 pid: 6493 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130859.845779:0:10316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7ad2d00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10316:1876039508743168:0@lo:104: 00010000:00010000:2.0:1789130859.845789:0:10316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91ddfd0b4200/0xf3fe2838e1fc212b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf3fe2838e1fc2124 expref: 22 pid: 6494 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130859.845795:0:10316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7ad21c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10316:1876039508743296:0@lo:104: 00010000:00010000:2.0:1789130859.845804:0:10316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91ddfd0b4800/0xf3fe2838e1fc210f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf3fe2838e1fc2108 expref: 21 pid: 6494 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130859.845811:0:10316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7ad1680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10316:1876039508743424:0@lo:104: 00010000:00010000:2.0:1789130859.845820:0:10316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91ddfd0b5a00/0xf3fe2838e1fc20e5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf3fe2838e1fc20de expref: 20 pid: 6492 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130859.845847:0:10316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7ad2580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10316:1876039508743936:0@lo:104: 00010000:00010000:2.0:1789130859.845859:0:10316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91ddc27e7600/0xf3fe2838e1fc20c9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf3fe2838e1fc20c2 expref: 19 pid: 6492 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130859.845866:0:10316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7ad0f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10316:1876039508744192:0@lo:104: 00010000:00010000:2.0:1789130859.845875:0:10316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91ddc27e7c00/0xf3fe2838e1fc20bb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf3fe2838e1fc20b4 expref: 18 pid: 6494 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130859.845881:0:10316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7c91e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10316:1876039508744448:0@lo:104: 00010000:00010000:2.0:1789130859.845889:0:10316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91ddc27e6c00/0xf3fe2838e1fc20ad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf3fe2838e1fc20a6 expref: 17 pid: 6492 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130859.845897:0:10316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7d98b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10316:1876039508744704:0@lo:104: 00000100:00100000:1.0:1789130859.846013:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508744960 00000100:00100000:1.0:1789130859.846018:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508744960 00000100:00100000:1.0:1789130859.846055:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508745088 00000100:00100000:1.0:1789130859.846058:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508745088 00000100:00100000:1.0:1789130859.846076:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789130859.846082:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7891a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+4:10316:x1876039508744960:12345-0@lo:104: 00010000:00010000:1.0:1789130859.846094:0:6483:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff91ddfd0b4600/0xf3fe2838e1fc2067 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3fe2838e1fc206e expref: -99 pid: 9492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130859.846247:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789130859.846254:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7892d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+4:10316:x1876039508745088:12345-0@lo:104: 00010000:00010000:3.0:1789130859.846262:0:6484:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff91dde19aa200/0xf3fe2838e1fc203d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3fe2838e1fc2044 expref: -99 pid: 9492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130859.846421:0:6483:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789130859.846426:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7891a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+4:10316:x1876039508744960:12345-0@lo:104: Request processed in 345us (768us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130859.846431:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789130859.846800:0:10316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddca181680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10316:1876039508744960:0@lo:104: 00000100:00100000:2.0:1789130859.846809:0:10316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7890780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10316:1876039508745088:0@lo:104: 00010000:00010000:0.0:1789130859.846857:0:6488:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789130859.846864:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff91ddfd0b4600/0xf3fe2838e1fc2067 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3fe2838e1fc206e expref: -99 pid: 9492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130859.846872:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddfd0b4600 already unused, calling callback (ffffffffc124bc20) 10000000:00010000:0.0:1789130859.846876:0:6488:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff91ddfd0b4600/0xf3fe2838e1fc2067 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf3fe2838e1fc206e expref: -99 pid: 9492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130859.846885:0:6488:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff91ddfd0b4600/0xf3fe2838e1fc2067 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf3fe2838e1fc206e expref: -99 pid: 9492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130859.846890:0:6484:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 10000000:00010000:0.0:1789130859.846892:0:6488:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff91ddfd0b4600/0xf3fe2838e1fc2067 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf3fe2838e1fc206e expref: -99 pid: 9492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130859.846896:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7892d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+3:10316:x1876039508745088:12345-0@lo:104: Request processed in 642us (1166us total) trans 0 rc 0/0 10000000:01000000:0.0:1789130859.846897:0:6488:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1789130859.846902:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789130859.846930:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7d98780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3625:1876039508744576:0@lo:103: 00010000:00010000:0.0:1789130859.846931:0:6488:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff91ddfd0b4600/0xf3fe2838e1fc2067 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc206e expref: -99 pid: 9492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130859.846937:0:6488:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1789130859.846940:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7ad3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3625:1876039508743808:0@lo:103: 00000100:00100000:3.0:1789130859.846963:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7ad1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3625:1876039508743680:0@lo:103: 00010000:00010000:0.0:1789130859.846964:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff91ddfd0b4600/0xf3fe2838e1fc2067 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc206e expref: -99 pid: 9492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130859.846970:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff91ddfd0b4600/0xf3fe2838e1fc2067 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc206e expref: -99 pid: 9492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130859.846979:0:6488:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789130859.846982:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff91dde19aa200/0xf3fe2838e1fc203d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3fe2838e1fc2044 expref: -99 pid: 9492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130859.846987:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130859.846988:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dde19aa200 already unused, calling callback (ffffffffc124bc20) 10000000:00010000:0.0:1789130859.846991:0:6488:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff91dde19aa200/0xf3fe2838e1fc203d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf3fe2838e1fc2044 expref: -99 pid: 9492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130859.847006:0:6488:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff91dde19aa200/0xf3fe2838e1fc203d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf3fe2838e1fc2044 expref: -99 pid: 9492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789130859.847012:0:6488:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff91dde19aa200/0xf3fe2838e1fc203d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf3fe2838e1fc2044 expref: -99 pid: 9492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789130859.847017:0:6488:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789130859.847031:0:6488:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff91dde19aa200/0xf3fe2838e1fc203d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc2044 expref: -99 pid: 9492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130859.847036:0:6488:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789130859.847041:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff91dde19aa200/0xf3fe2838e1fc203d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc2044 expref: -99 pid: 9492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130859.847047:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff91dde19aa200/0xf3fe2838e1fc203d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc2044 expref: -99 pid: 9492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130859.847060:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130859.847062:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130859.847063:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789130859.847074:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01a5da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3628:1876039508745344:0@lo:103: 00000100:00100000:0.0:1789130859.847112:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130859.847155:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789130859.847162:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01a5e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3628:1876039508745216:0@lo:103: 00000100:00100000:0.0:1789130859.847183:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130859.847209:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508745344 00000100:00100000:0.0:1789130859.847214:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508745344 00010000:00010000:0.0:1789130859.847233:0:6486:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91ddfd0b5c00/0xf3fe2838e1fc2044 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3fe2838e1fc203d expref: 17 pid: 6494 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130859.847250:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130859.847252:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789130859.847263:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508745216 00000100:00100000:0.0:1789130859.847267:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508745216 00010000:00010000:0.0:1789130859.847279:0:6486:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91ddc27e7800/0xf3fe2838e1fc206e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3fe2838e1fc2067 expref: 18 pid: 6494 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130859.847317:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789130859.847325:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc33acc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+18:3628:x1876039508745344:12345-0@lo:103: 00010000:00010000:0.0:1789130859.847334:0:6486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789130859.847339:0:6486:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91ddfd0b5c00/0xf3fe2838e1fc2044 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3fe2838e1fc203d expref: 18 pid: 6494 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130859.847633:0:6486:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91ddfd0b5c00/0xf3fe2838e1fc2044 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf3fe2838e1fc203d expref: 18 pid: 6494 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130859.847648:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91ddfd0b5c00/0xf3fe2838e1fc2044 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf3fe2838e1fc203d expref: 18 pid: 6494 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130859.847662:0:6486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789130859.847694:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc33acc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+17:3628:x1876039508745344:12345-0@lo:103: Request processed in 370us (581us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130859.847701:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789130859.847744:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789130859.847752:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01a5f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+16:3628:x1876039508745216:12345-0@lo:103: 00010000:00010000:0.0:1789130859.847759:0:6486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789130859.847763:0:6486:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91ddc27e7800/0xf3fe2838e1fc206e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3fe2838e1fc2067 expref: 16 pid: 6494 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130859.847772:0:6486:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91ddc27e7800/0xf3fe2838e1fc206e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf3fe2838e1fc2067 expref: 16 pid: 6494 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130859.847788:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91ddc27e7800/0xf3fe2838e1fc206e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf3fe2838e1fc2067 expref: 16 pid: 6494 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130859.847796:0:6486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789130859.847819:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01a5f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+15:3628:x1876039508745216:12345-0@lo:103: Request processed in 68us (635us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130859.847825:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789130859.847855:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01a5e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3628:1876039508745216:0@lo:103: 00000100:00100000:0.0:1789130859.847863:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01a5da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3628:1876039508745344:0@lo:103: 00000100:00100000:3.0:1789130859.849009:0:10316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7ad0000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10316:1876039508742912:192.168.203.11@tcp:104: 00000100:00100000:3.0:1789130859.849023:0:10316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7ad0780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10316:1876039508743040:192.168.203.11@tcp:104: 00010000:00010000:3.0:1789130859.849074:0:10316:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91ddfd0b4400/0xf3fe2838e1fc21a9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130859.849404:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789130859.849982:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498207872 00000100:00100000:2.0:1789130859.849991:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498207872 00010000:00010000:2.0:1789130859.850026:0:6486:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91ddc0030600/0xf3fe2838e1fc216a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d2697f1 expref: 10 pid: 6493 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130859.850058:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 33 00000100:00100000:2.0:1789130859.850067:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01a5da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+10:2388:x1876039498207872:12345-192.168.203.11@tcp:103: 00010000:00010000:2.0:1789130859.850080:0:6486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789130859.850085:0:6486:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91ddc0030600/0xf3fe2838e1fc216a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d2697f1 expref: 10 pid: 6493 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130859.850113:0:6486:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91ddc0030600/0xf3fe2838e1fc216a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d2697f1 expref: 10 pid: 6493 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130859.850130:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91ddc0030600/0xf3fe2838e1fc216a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d2697f1 expref: 10 pid: 6493 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130859.850155:0:6486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789130859.850210:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01a5da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+9:2388:x1876039498207872:12345-192.168.203.11@tcp:103: Request processed in 144us (807us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130859.850218:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 33 00010000:00010000:1.0:1789130859.851217:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789130859.851686:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789130859.851750:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498208000 00000100:00100000:0.0:1789130859.851833:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498208000 00010000:00010000:0.0:1789130859.851875:0:6485:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91dde19aac00/0xf3fe2838e1fc2163 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d2697ea expref: 9 pid: 6492 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130859.851903:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 34 00000100:00100000:0.0:1789130859.851911:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7890f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+9:2388:x1876039498208000:12345-192.168.203.11@tcp:103: 00010000:00010000:0.0:1789130859.851927:0:6485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789130859.851931:0:6485:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91dde19aac00/0xf3fe2838e1fc2163 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d2697ea expref: 9 pid: 6492 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130859.851942:0:6485:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91dde19aac00/0xf3fe2838e1fc2163 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d2697ea expref: 9 pid: 6492 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130859.851974:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91dde19aac00/0xf3fe2838e1fc2163 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d2697ea expref: 9 pid: 6492 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130859.852002:0:6485:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91ddfd0b4400/0xf3fe2838e1fc21a9 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130859.852010:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91ddfd0b4400/0xf3fe2838e1fc21a9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130859.852026:0:6485:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91ddfd0b4400/0xf3fe2838e1fc21a9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130859.852033:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91ddfd0b4400/0xf3fe2838e1fc21a9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130859.852039:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91ddfd0b4400/0xf3fe2838e1fc21a9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130859.852046:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91ddfd0b4400/0xf3fe2838e1fc21a9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130859.852052:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddfd0b4400 already unused, calling callback (ffffffffc0c4e550) 00010000:00010000:0.0:1789130859.852056:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91ddfd0b4400/0xf3fe2838e1fc21a9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130859.852064:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91ddfd0b4400/0xf3fe2838e1fc21a9 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130859.852076:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91ddfd0b4400/0xf3fe2838e1fc21a9 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130859.852086:0:6485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789130859.852134:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7890f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+8:2388:x1876039498208000:12345-192.168.203.11@tcp:103: Request processed in 224us (461us total) trans 0 rc 0/0 00010000:00010000:2.0:1789130859.852283:0:10316:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91ddfd0b4400/0xf3fe2838e1fc21a9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130859.852298:0:10316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91ddfd0b4400/0xf3fe2838e1fc21a9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130859.852306:0:10316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91ddfd0b4400/0xf3fe2838e1fc21a9 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130859.853053:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 34 00000100:00100000:3.0:1789130860.113751:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01a5e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3625:1876039508745472:0@lo:400: 00000100:00100000:0.0:1789130860.113852:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01a5c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3628:1876039508745856:0@lo:400: 00000100:00100000:3.0:1789130860.113856:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130860.113931:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01a5ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508745984:0@lo:400: 00000100:00100000:3.0:1789130860.113974:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130860.114007:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01a5d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508746496:0@lo:400: 00000100:00100000:3.0:1789130860.114035:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130860.114054:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff8e0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508747008:0@lo:400: 00000100:00100000:3.0:1789130860.114074:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130860.114097:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1789130860.114104:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01a5e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3625:1876039508745600:0@lo:400: 00000100:00100000:3.0:1789130860.114128:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130860.114148:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01a5fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3625:1876039508746112:0@lo:400: 00000100:00100000:0.0:1789130860.114167:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130860.114198:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01a5cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1876039508746368:0@lo:400: 00000100:00100000:3.0:1789130860.114299:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130860.114299:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508745600 00000100:00100000:1.0:1789130860.114308:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508745600 00000100:00100000:3.0:1789130860.114319:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01a5cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3625:1876039508746624:0@lo:400: 00000100:00100000:3.0:1789130860.114342:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130860.114378:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508745472 00000100:00100000:3.0:1789130860.114383:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508745472 00000100:00100000:2.0:1789130860.114400:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01a5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508745728:0@lo:400: 00000100:00100000:3.0:1789130860.114420:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1789130860.114429:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8607450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+15:3625:x1876039508745472:12345-0@lo:400: 00000100:00100000:2.0:1789130860.114434:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130860.114475:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01a5e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3627:1876039508746240:0@lo:400: 00000100:00100000:2.0:1789130860.114496:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130860.114503:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8607450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+15:3625:x1876039508745472:12345-0@lo:400: Request processed in 75us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130860.114512:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1789130860.114552:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508745984 00000100:00100000:3.0:1789130860.114557:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508745984 00000100:00100000:3.0:1789130860.114577:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508745728 00000100:00100000:3.0:1789130860.114580:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508745728 00000100:00100000:3.0:1789130860.114593:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789130860.114599:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7d98b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1876039508745984:12345-0@lo:400: 00000100:00100000:3.0:1789130860.114637:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7d98b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1876039508745984:12345-0@lo:400: Request processed in 38us (662us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130860.114643:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789130860.114664:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789130860.114670:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc78921c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508745728:12345-0@lo:400: 00000100:00100000:3.0:1789130860.114897:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc78921c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508745728:12345-0@lo:400: Request processed in 226us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130860.114904:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789130860.114927:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508746496 00000100:00100000:3.0:1789130860.114931:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508746496 00000100:00100000:3.0:1789130860.114985:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508747008 00000100:00100000:3.0:1789130860.114988:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508747008 00000100:00100000:3.0:1789130860.115006:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789130860.115011:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7d98780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1876039508746496:12345-0@lo:400: 00000100:00100000:3.0:1789130860.115043:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7d98780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1876039508746496:12345-0@lo:400: Request processed in 32us (1008us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130860.115049:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789130860.115060:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789130860.115065:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7d992c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1876039508747008:12345-0@lo:400: 00000100:00100000:3.0:1789130860.115087:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7d992c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1876039508747008:12345-0@lo:400: Request processed in 23us (1013us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130860.115092:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789130860.115744:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130860.115780:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01a5c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1876039508746880:0@lo:400: 00000100:00100000:0.0:1789130860.115822:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130860.119012:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01a5f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3627:1876039508746752:0@lo:400: 00000100:00100000:2.0:1789130860.119112:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130860.119381:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508745856 00000100:00100000:1.0:1789130860.119391:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508745856 00000100:00100000:1.0:1789130860.119469:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508746112 00000100:00100000:1.0:1789130860.119473:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508746112 00000100:00100000:1.0:1789130860.119495:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508746624 00000100:00100000:1.0:1789130860.119499:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508746624 00000100:00100000:1.0:1789130860.119512:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508746240 00000100:00100000:1.0:1789130860.119515:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508746240 00000100:00100000:1.0:1789130860.119532:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789130860.119541:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7d9a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1876039508745600:12345-0@lo:400: 00000100:00100000:1.0:1789130860.119626:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7d9a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1876039508745600:12345-0@lo:400: Request processed in 85us (5495us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130860.119633:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789130860.119653:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789130860.119659:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff8e1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3628:x1876039508745856:12345-0@lo:400: 00000100:00100000:1.0:1789130860.119710:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff8e1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3628:x1876039508745856:12345-0@lo:400: Request processed in 52us (5543us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130860.119717:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789130860.119728:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789130860.119735:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7d983c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1876039508746112:12345-0@lo:400: 00000100:00100000:1.0:1789130860.119764:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7d983c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1876039508746112:12345-0@lo:400: Request processed in 30us (5465us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130860.119770:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789130860.119781:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789130860.120109:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7d9b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1876039508746624:12345-0@lo:400: 00000100:00100000:1.0:1789130860.120146:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7d9b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1876039508746624:12345-0@lo:400: Request processed in 41us (5802us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130860.120169:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789130860.120185:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789130860.120191:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc78912c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1876039508746240:12345-0@lo:400: 00000100:00100000:1.0:1789130860.120223:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc78912c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1876039508746240:12345-0@lo:400: Request processed in 33us (5726us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130860.120229:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:1.0:1789130860.120268:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789130860.120274:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789130860.120277:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789130860.120281:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789130860.120328:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01a5c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3628:1876039508745856:0@lo:400: 00000100:00100000:1.0:1789130860.120435:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7815a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508747136:0@lo:13: 00000100:00100000:1.0:1789130860.120508:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130860.122975:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789130860.122991:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508746368 00000100:00100000:3.0:1789130860.123001:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508746368 00000100:00100000:0.0:1789130860.123004:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7d98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1876039508747264:0@lo:13: 00000100:00100000:3.0:1789130860.123060:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508746880 00000100:00100000:3.0:1789130860.123063:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508746880 00000100:00100000:3.0:1789130860.123082:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789130860.123086:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130860.123091:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff8e0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3628:x1876039508746368:12345-0@lo:400: 00000100:00100000:0.0:1789130860.123137:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508747136 00000100:00100000:0.0:1789130860.123141:0:8418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508747136 00000100:00100000:3.0:1789130860.123151:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff8e0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3628:x1876039508746368:12345-0@lo:400: Request processed in 61us (7410us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130860.123161:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508747264 00000100:00100000:0.0:1789130860.123164:0:8418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508747264 00000100:00100000:0.0:1789130860.123176:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789130860.123182:0:8418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc78170c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508747136:12345-0@lo:13: 00002000:00000024:0.0:1789130860.123209:0:8418:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789130860.123254:0:8418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc78170c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508747136:12345-0@lo:13: Request processed in 71us (2745us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130860.123262:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789130860.123280:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789130860.123286:0:8418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff8e1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3628:x1876039508747264:12345-0@lo:13: 00002000:00000024:0.0:1789130860.123296:0:8418:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789130860.123322:0:8418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff8e1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3628:x1876039508747264:12345-0@lo:13: Request processed in 36us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130860.123328:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789130860.123377:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:0.0:1789130860.123384:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc7d98000 x1876039508747264/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789130876 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130860.123397:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789130860.123403:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff8e3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3628:x1876039508746880:12345-0@lo:400: 00000100:00100000:0.0:1789130860.123405:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7d98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1876039508747264:0@lo:13: 00010000:00080000:0.0:1789130860.123418:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91de01a5cf00 x1876039508746368/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789130876 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789130860.123427:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01a5cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1876039508746368:0@lo:400: 00000100:00100000:3.0:1789130860.123433:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff8e3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3628:x1876039508746880:12345-0@lo:400: Request processed in 32us (7612us total) trans 0 rc 0/0 00010000:00080000:0.0:1789130860.123436:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91de01a5c3c0 x1876039508746880/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789130876 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130860.123440:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789130860.123444:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01a5c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1876039508746880:0@lo:400: 00000100:00100000:3.0:1789130860.123506:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01a5e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3625:1876039508745600:0@lo:400: 00000100:00100000:3.0:1789130860.123519:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01a5fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3625:1876039508746112:0@lo:400: 00000100:00100000:3.0:1789130860.123534:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01a5cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3625:1876039508746624:0@lo:400: 00000100:00100000:3.0:1789130860.123546:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01a5ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508745984:0@lo:400: 00000100:00080000:1.0:1789130860.123556:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789130860.123559:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91de01a5d680 x1876039508746496/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789130876 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789130860.123561:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789130860.123569:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01a5d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508746496:0@lo:400: 00010000:00080000:3.0:1789130860.123581:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91ddff8e0f00 x1876039508747008/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789130876 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1789130860.123583:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc7815a40 x1876039508747136/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789130876 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130860.123590:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff8e0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508747008:0@lo:400: 00000100:00100000:1.0:1789130860.123596:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7815a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508747136:0@lo:13: 00000100:00100000:3.0:1789130860.123623:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01a5e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3625:1876039508745472:0@lo:400: 00000100:00100000:1.0:1789130860.124912:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508746752 00000100:00100000:1.0:1789130860.124926:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508746752 00000100:00100000:1.0:1789130860.125017:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789130860.125028:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7890780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3627:x1876039508746752:12345-0@lo:400: 00000100:00100000:1.0:1789130860.125102:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7890780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3627:x1876039508746752:12345-0@lo:400: Request processed in 75us (5990us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130860.125110:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:3.0:1789130860.125245:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1789130860.125280:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91de01a5f840 x1876039508746752/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130876 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130860.125294:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01a5f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3627:1876039508746752:0@lo:400: 00000100:00100000:3.0:1789130860.125331:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01a5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508745728:0@lo:400: 00010000:00080000:3.0:1789130860.125345:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91de01a5e1c0 x1876039508746240/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130876 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130860.125372:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01a5e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3627:1876039508746240:0@lo:400: 00010000:00010000:0.0:1789130860.433640:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789130860.626678:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7d9a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1876039508747392:0@lo:13: 00000100:00100000:0.0:1789130860.626778:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130860.627534:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508747392 00000100:00100000:3.0:1789130860.627547:0:8418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508747392 00000100:00100000:3.0:1789130860.627616:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789130860.627629:0:8418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff8e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1876039508747392:12345-0@lo:13: 00002000:00000024:3.0:1789130860.627674:0:8418:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789130860.627741:0:8418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff8e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1876039508747392:12345-0@lo:13: Request processed in 115us (963us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130860.627751:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:0.0:1789130860.627792:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc7d9a580 x1876039508747392/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789130876 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789130860.627813:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7d9a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1876039508747392:0@lo:13: 00000100:00100000:3.0:1789130861.137809:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7815a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508747520:0@lo:13: 00000100:00100000:3.0:1789130861.137924:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130861.137978:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508747520 00000100:00100000:1.0:1789130861.139401:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508747520 00000100:00100000:1.0:1789130861.139495:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789130861.139506:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7d99e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508747520:12345-0@lo:13: 00002000:00000024:1.0:1789130861.139543:0:8419:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00010000:00080000:0.0:1789130861.139876:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc7815a40 x1876039508747520/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789130877 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789130861.139923:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7815a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508747520:0@lo:13: 00000100:00100000:1.0:1789130861.140216:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7d99e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508747520:12345-0@lo:13: Request processed in 710us (2291us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130861.140226:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 10000000:01000000:2.0:1789130861.202244:0:6497:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789130861.202280:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff91ddff549800 from 48 10000000:01000000:2.0:1789130861.202288:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789130861.202374:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff91dcc7e36e00/0xf3fe2838e1fc21b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130861.202388:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff91dcc7e36e00/0xf3fe2838e1fc21b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130861.202402:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff91dcc7e36e00/0xf3fe2838e1fc21b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130861.202434:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff8a4f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508747648:0@lo:101: 00000100:00100000:2.0:1789130861.202549:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130861.202627:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508747648 00000100:00100000:3.0:1789130861.202637:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508747648 00000100:00100000:2.0:1789130861.202796:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddff7d7b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789130861.203445:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1789130861.203495:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8607850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+15:6497:x1876039508747648:12345-0@lo:101: 00010000:00010000:3.0:1789130861.203514:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130861.203533:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91ddfd0b5600/0xf3fe2838e1fc21b7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3fe2838e1fc21b0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130861.203560:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91ddfd0b5600/0xf3fe2838e1fc21b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3fe2838e1fc21b0 expref: 16 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130861.203571:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91ddfd0b5600/0xf3fe2838e1fc21b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc21b0 expref: 16 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130861.203581:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ddfd0b5600, rc 0) 00000100:00100000:3.0:1789130861.203650:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8607850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+16:6497:x1876039508747648:12345-0@lo:101: Request processed in 192us (1101us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130861.203668:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1789130861.203785:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff8a4f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508747648:0@lo:101: 00010000:00010000:2.0:1789130861.203815:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff91dcc7e36e00/0xf3fe2838e1fc21b0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc21b7 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130861.203825:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff91dcc7e36e00/0xf3fe2838e1fc21b0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3fe2838e1fc21b7 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130861.203906:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff8a4f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508747776:0@lo:501: 00000100:00100000:2.0:1789130861.203947:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130861.209697:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508747776 00000100:00100000:0.0:1789130861.209718:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508747776 00000100:00100000:2.0:1789130861.209739:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddff7d7b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789130861.209793:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1789130861.209805:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8606c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+16:6497:x1876039508747776:12345-0@lo:501: 00000100:00100000:0.0:1789130861.210358:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8606c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+16:6497:x1876039508747776:12345-0@lo:501: Request processed in 554us (6420us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130861.210390:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1789130861.212542:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff8a4f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508747776:0@lo:501: 00000100:00100000:2.0:1789130861.212624:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff8a4f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508747904:0@lo:503: 00000100:00100000:2.0:1789130861.213307:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130861.213438:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddff7d7b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789130861.213503:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508747904 00000100:00100000:1.0:1789130861.213514:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508747904 00000100:00100000:1.0:1789130861.213584:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1789130861.213595:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8605450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+16:6497:x1876039508747904:12345-0@lo:503: 00000100:00100000:1.0:1789130861.213754:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8605450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+16:6497:x1876039508747904:12345-0@lo:503: Request processed in 160us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130861.213762:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1789130861.213922:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff8a4f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508747904:0@lo:503: 00000100:00100000:1.0:1789130861.214713:0:10333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7816940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:10333:1876039508748032:0@lo:502: 00000100:00100000:1.0:1789130861.214829:0:10333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130861.214868:0:10333:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddc302a480 going to sleep for 11 seconds 00000100:00100000:0.0:1789130861.214999:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508748032 00000100:00100000:0.0:1789130861.215006:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508748032 00000100:00100000:0.0:1789130861.215047:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1789130861.215057:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8604450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+16:10333:x1876039508748032:12345-0@lo:502: 00000100:00100000:0.0:1789130861.215206:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8604450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+16:10333:x1876039508748032:12345-0@lo:502: Request processed in 149us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130861.215214:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1789130861.215231:0:10333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7816940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:10333:1876039508748032:0@lo:502: 00000100:00100000:1.0:1789130861.215271:0:10333:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7816940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:10333:1876039508748160:0@lo:502: 00000100:00100000:1.0:1789130861.215308:0:10333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130861.215383:0:10333:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddc302a480 going to sleep for 11 seconds 00000100:00100000:3.0:1789130861.215500:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508748160 00000100:00100000:3.0:1789130861.215505:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508748160 00000100:00100000:3.0:1789130861.215574:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1789130861.215582:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8607c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+16:10333:x1876039508748160:12345-0@lo:502: 00000100:00100000:3.0:1789130861.215670:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8607c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+16:10333:x1876039508748160:12345-0@lo:502: Request processed in 88us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130861.215677:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1789130861.215748:0:10333:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7816940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:10333:1876039508748160:0@lo:502: 00000040:00080000:2.0:1789130861.215770:0:10333:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1789130861.215892:0:6497:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1789130861.215921:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789130861.215943:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff91dcc7e36e00/0xf3fe2838e1fc21b0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc21b7 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130861.215956:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff91dcc7e36e00/0xf3fe2838e1fc21b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc21b7 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789130861.215967:0:6497:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1789130861.215971:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:0.0:1789130861.215974:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1789130861.216004:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff91ddc0030600/0xf3fe2838e1fc21be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130861.216012:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff91ddc0030600/0xf3fe2838e1fc21be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130861.216023:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff91ddc0030600/0xf3fe2838e1fc21be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130861.216038:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff8e12c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508748288:0@lo:101: 00000100:00100000:0.0:1789130861.216082:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130861.216119:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddd8266180 going to sleep for 11 seconds 00000100:00100000:3.0:1789130861.216158:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508748288 00000100:00100000:3.0:1789130861.216162:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508748288 00000100:00100000:3.0:1789130861.216194:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1789130861.216201:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8605850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+16:6497:x1876039508748288:12345-0@lo:101: 00010000:00010000:3.0:1789130861.216212:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130861.216227:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91ddfd0b4e00/0xf3fe2838e1fc21c5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3fe2838e1fc21be expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130861.216257:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91ddfd0b4e00/0xf3fe2838e1fc21c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3fe2838e1fc21be expref: 17 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130861.216269:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91ddfd0b4e00/0xf3fe2838e1fc21c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc21be expref: 17 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130861.216280:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ddfd0b4e00, rc 0) 00000100:00100000:3.0:1789130861.216319:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8605850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+17:6497:x1876039508748288:12345-0@lo:101: Request processed in 118us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130861.216326:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1789130861.216592:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff8e12c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508748288:0@lo:101: 00010000:00010000:0.0:1789130861.216605:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff91ddc0030600/0xf3fe2838e1fc21be lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc21c5 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130861.216615:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff91ddc0030600/0xf3fe2838e1fc21be lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3fe2838e1fc21c5 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130861.216672:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff8e12c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508748416:0@lo:501: 00000100:00100000:0.0:1789130861.216700:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130861.216797:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddd8266180 going to sleep for 11 seconds 00000100:00100000:3.0:1789130861.216887:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508748416 00000100:00100000:3.0:1789130861.216891:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508748416 00000100:00100000:3.0:1789130861.216981:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1789130861.216989:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8604850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+17:6497:x1876039508748416:12345-0@lo:501: 00000100:00100000:3.0:1789130861.217133:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8604850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+17:6497:x1876039508748416:12345-0@lo:501: Request processed in 145us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130861.217141:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1789130861.217370:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff8e12c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508748416:0@lo:501: 00000100:00100000:0.0:1789130861.217399:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff8e12c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508748544:0@lo:503: 00000100:00100000:0.0:1789130861.217441:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130861.217802:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddd8266180 going to sleep for 11 seconds 00000100:00100000:1.0:1789130861.217837:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508748544 00000100:00100000:1.0:1789130861.217843:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508748544 00000100:00100000:1.0:1789130861.217871:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1789130861.217885:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8604050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+17:6497:x1876039508748544:12345-0@lo:503: 00000100:00100000:1.0:1789130861.217995:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8604050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+17:6497:x1876039508748544:12345-0@lo:503: Request processed in 110us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130861.218009:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1789130861.218164:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff8e12c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508748544:0@lo:503: 00000100:00100000:0.0:1789130861.218547:0:10334:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff8e12c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:10334:1876039508748672:0@lo:502: 00000100:00100000:0.0:1789130861.218586:0:10334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130861.218606:0:10334:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddd8266540 going to sleep for 11 seconds 00000100:00100000:1.0:1789130861.218662:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508748672 00000100:00100000:1.0:1789130861.218667:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508748672 00000100:00100000:1.0:1789130861.218688:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1789130861.218694:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8606850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+17:10334:x1876039508748672:12345-0@lo:502: 00000100:00100000:1.0:1789130861.218777:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8606850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+17:10334:x1876039508748672:12345-0@lo:502: Request processed in 82us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130861.218785:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1789130861.218866:0:10334:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff8e12c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:10334:1876039508748672:0@lo:502: 00000020:01000000:0.0:1789130861.218897:0:10334:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789130861.218909:0:10334:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789130861.218911:0:10334:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789130861.218916:0:10334:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1789130861.218948:0:10334:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff8e12c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:10334:1876039508748800:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789130861.218983:0:10334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130861.219011:0:10334:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddd8266540 going to sleep for 11 seconds 00000100:00100000:1.0:1789130861.219102:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508748800 00000100:00100000:1.0:1789130861.219106:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508748800 00000100:00100000:1.0:1789130861.219123:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1789130861.219129:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8606450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+17:10334:x1876039508748800:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789130861.219194:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8606450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+17:10334:x1876039508748800:12345-0@lo:502:llog_process_th.0 Request processed in 65us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130861.219201:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1789130861.219421:0:10334:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff8e12c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:10334:1876039508748800:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789130861.219438:0:10334:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789130861.219442:0:10334:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789130861.219444:0:10334:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789130861.219448:0:10334:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 11 count 11 00000020:01000000:1.0:1789130861.219639:0:6497:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:1.0:1789130861.219659:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1789130861.219669:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff91ddc0030600/0xf3fe2838e1fc21be lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc21c5 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130861.219680:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff91ddc0030600/0xf3fe2838e1fc21be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc21c5 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789130861.219706:0:6497:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789130861.219709:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff91ddff4f9000 from 48 10000000:01000000:1.0:1789130861.219712:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789130861.219740:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff91dde19aa400/0xf3fe2838e1fc21cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130861.219755:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff91dde19aa400/0xf3fe2838e1fc21cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130861.219765:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff91dde19aa400/0xf3fe2838e1fc21cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130861.219781:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7814000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508748928:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789130861.219815:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130861.219847:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddd029a300 going to sleep for 11 seconds 00000100:00100000:0.0:1789130861.219959:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508748928 00000100:00100000:0.0:1789130861.219963:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508748928 00000100:00100000:0.0:1789130861.219998:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1789130861.220007:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8607050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+17:6497:x1876039508748928:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789130861.220018:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130861.220032:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91ddc0030e00/0xf3fe2838e1fc21d3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3fe2838e1fc21cc expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130861.220054:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91ddc0030e00/0xf3fe2838e1fc21d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3fe2838e1fc21cc expref: 18 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130861.220066:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91ddc0030e00/0xf3fe2838e1fc21d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc21cc expref: 18 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130861.220076:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ddc0030e00, rc 0) 00000100:00100000:0.0:1789130861.220193:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8607050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+18:6497:x1876039508748928:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 187us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130861.220201:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1789130861.220300:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7814000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508748928:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789130861.220314:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff91dde19aa400/0xf3fe2838e1fc21cc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc21d3 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130861.220323:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff91dde19aa400/0xf3fe2838e1fc21cc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3fe2838e1fc21d3 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130861.220448:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7814000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508749056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789130861.220644:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130861.220706:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddd029a300 going to sleep for 11 seconds 00000100:00100000:3.0:1789130861.220741:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508749056 00000100:00100000:3.0:1789130861.220746:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508749056 00000100:00100000:3.0:1789130861.220807:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1789130861.220816:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8605c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+18:6497:x1876039508749056:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789130861.221014:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8605c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+18:6497:x1876039508749056:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 199us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130861.221021:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1789130861.221084:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7814000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508749056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789130861.221114:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7814000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508749184:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789130861.221160:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130861.221221:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddd029a300 going to sleep for 11 seconds 00000100:00100000:0.0:1789130861.221277:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508749184 00000100:00100000:0.0:1789130861.221282:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508749184 00000100:00100000:0.0:1789130861.221303:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1789130861.221310:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8603850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+18:6497:x1876039508749184:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789130861.221406:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8603850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+18:6497:x1876039508749184:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 96us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130861.221414:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1789130861.221545:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7814000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508749184:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789130861.221902:0:10335:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff8e12c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:10335:1876039508749312:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789130861.221947:0:10335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130861.222014:0:10335:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddff7e3cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789130861.222216:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508749312 00000100:00100000:3.0:1789130861.222221:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508749312 00000100:00100000:2.0:1789130861.222323:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1789130861.222333:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8602c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+18:10335:x1876039508749312:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789130861.222475:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8602c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+18:10335:x1876039508749312:12345-0@lo:502:llog_process_th.0 Request processed in 124us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130861.222484:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1789130861.222652:0:10335:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff8e12c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:10335:1876039508749312:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789130861.222694:0:10335:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff8e12c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:10335:1876039508749440:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789130861.222727:0:10335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130861.222757:0:10335:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddff7e3cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789130861.222812:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508749440 00000100:00100000:1.0:1789130861.222823:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508749440 00000100:00100000:1.0:1789130861.222845:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1789130861.222851:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8601450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+18:10335:x1876039508749440:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789130861.222948:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8601450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+18:10335:x1876039508749440:12345-0@lo:502:llog_process_th.0 Request processed in 96us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130861.222955:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1789130861.223069:0:10335:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff8e12c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:10335:1876039508749440:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1789130861.223089:0:10335:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1789130861.223263:0:6497:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:1.0:1789130861.223284:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789130861.223295:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff91dde19aa400/0xf3fe2838e1fc21cc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc21d3 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130861.223307:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff91dde19aa400/0xf3fe2838e1fc21cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc21d3 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789130861.223319:0:6497:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1789130861.223323:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:1.0:1789130861.223327:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1789130861.223364:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff91dde19aa000/0xf3fe2838e1fc21da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130861.223373:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff91dde19aa000/0xf3fe2838e1fc21da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130861.223383:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff91dde19aa000/0xf3fe2838e1fc21da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130861.223399:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7814000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508749568:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789130861.223429:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130861.223452:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddd2f29300 going to sleep for 11 seconds 00000100:00100000:0.0:1789130861.223590:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508749568 00000100:00100000:0.0:1789130861.223595:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508749568 00000100:00100000:0.0:1789130861.223615:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1789130861.223621:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8600450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+18:6497:x1876039508749568:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789130861.223632:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130861.223646:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91ddc0030000/0xf3fe2838e1fc21e1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3fe2838e1fc21da expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130861.223669:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91ddc0030000/0xf3fe2838e1fc21e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3fe2838e1fc21da expref: 19 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130861.223681:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91ddc0030000/0xf3fe2838e1fc21e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc21da expref: 19 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130861.223702:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ddc0030000, rc 0) 00000100:00100000:0.0:1789130861.223741:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8600450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+19:6497:x1876039508749568:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130861.223748:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1789130861.223819:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7814000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508749568:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789130861.223833:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff91dde19aa000/0xf3fe2838e1fc21da lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc21e1 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130861.223843:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff91dde19aa000/0xf3fe2838e1fc21da lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3fe2838e1fc21e1 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130861.223906:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7814000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508749696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789130861.223931:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130861.224044:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddd2f29300 going to sleep for 11 seconds 00000100:00100000:3.0:1789130861.224161:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508749696 00000100:00100000:3.0:1789130861.224166:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508749696 00000100:00100000:3.0:1789130861.224187:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1789130861.224194:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8603c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+19:6497:x1876039508749696:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789130861.224371:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8603c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+19:6497:x1876039508749696:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 177us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130861.224379:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1789130861.224645:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7814000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508749696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789130861.224677:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7814000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508749824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789130861.224722:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130861.224784:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddd2f29300 going to sleep for 11 seconds 00000100:00100000:3.0:1789130861.224817:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508749824 00000100:00100000:3.0:1789130861.224822:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508749824 00000100:00100000:3.0:1789130861.224952:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1789130861.224960:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8601850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+19:6497:x1876039508749824:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789130861.225052:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8601850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+19:6497:x1876039508749824:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 92us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130861.225072:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1789130861.225131:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7814000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508749824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789130861.225574:0:10336:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7814000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:10336:1876039508749952:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789130861.225614:0:10336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130861.225833:0:10336:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddd2f29300 going to sleep for 11 seconds 00000100:00100000:2.0:1789130861.225964:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508749952 00000100:00100000:2.0:1789130861.225970:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508749952 00000100:00100000:2.0:1789130861.226003:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1789130861.226012:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8600850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+19:10336:x1876039508749952:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789130861.226120:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8600850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+19:10336:x1876039508749952:12345-0@lo:502:llog_process_th.0 Request processed in 109us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130861.226128:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1789130861.226223:0:10336:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7814000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:10336:1876039508749952:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789130861.226247:0:10336:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789130861.226256:0:10336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789130861.226259:0:10336:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789130861.226266:0:10336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1789130861.226287:0:10336:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7814000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:10336:1876039508750080:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789130861.226318:0:10336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130861.226353:0:10336:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddff84c6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789130861.226446:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508750080 00000100:00100000:2.0:1789130861.226450:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508750080 00000100:00100000:2.0:1789130861.226497:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1789130861.226504:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8600050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+19:10336:x1876039508750080:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789130861.226560:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8600050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+19:10336:x1876039508750080:12345-0@lo:502:llog_process_th.0 Request processed in 55us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130861.226567:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1789130861.226638:0:10336:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7814000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:10336:1876039508750080:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789130861.226655:0:10336:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789130861.226659:0:10336:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789130861.226661:0:10336:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789130861.226665:0:10336:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 14 count 14 00000020:01000000:2.0:1789130861.226866:0:6497:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:2.0:1789130861.226971:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1789130861.226982:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff91dde19aa000/0xf3fe2838e1fc21da lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc21e1 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130861.227001:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff91dde19aa000/0xf3fe2838e1fc21da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc21e1 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789130861.227014:0:6497:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789130861.227017:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff91ddfce33000 from 48 10000000:01000000:2.0:1789130861.227020:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789130861.227050:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff91dcc7e37a00/0xf3fe2838e1fc21e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130861.227059:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff91dcc7e37a00/0xf3fe2838e1fc21e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130861.227069:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff91dcc7e37a00/0xf3fe2838e1fc21e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130861.227084:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff8a4f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508750208:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789130861.227116:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130861.227201:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddff7d7780 going to sleep for 11 seconds 00000100:00100000:3.0:1789130861.227314:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508750208 00000100:00100000:3.0:1789130861.227319:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508750208 00000100:00100000:1.0:1789130861.227360:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1789130861.227367:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8602850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+19:6497:x1876039508750208:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789130861.227377:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130861.227389:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91dde19aaa00/0xf3fe2838e1fc21ef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3fe2838e1fc21e8 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130861.227412:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91dde19aaa00/0xf3fe2838e1fc21ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3fe2838e1fc21e8 expref: 20 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130861.227421:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91dde19aaa00/0xf3fe2838e1fc21ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc21e8 expref: 20 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130861.227431:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dde19aaa00, rc 0) 00000100:00100000:1.0:1789130861.227491:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8602850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+20:6497:x1876039508750208:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130861.227498:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1789130861.227640:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff8a4f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508750208:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789130861.227652:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff91dcc7e37a00/0xf3fe2838e1fc21e8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc21ef expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130861.227662:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff91dcc7e37a00/0xf3fe2838e1fc21e8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3fe2838e1fc21ef expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130861.227716:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff8a4f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508750336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789130861.227745:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130861.227777:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddff7d7780 going to sleep for 11 seconds 00000100:00100000:1.0:1789130861.227818:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508750336 00000100:00100000:1.0:1789130861.227822:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508750336 00000100:00100000:1.0:1789130861.227842:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1789130861.227848:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8602450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+20:6497:x1876039508750336:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789130861.228117:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8602450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+20:6497:x1876039508750336:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 269us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130861.228135:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1789130861.228272:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff8a4f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508750336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789130861.228297:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff8a4f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508750464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789130861.228331:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130861.228422:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddff7d7780 going to sleep for 11 seconds 00000100:00100000:1.0:1789130861.228448:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508750464 00000100:00100000:1.0:1789130861.228451:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508750464 00000100:00100000:1.0:1789130861.228639:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1789130861.228645:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8603050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+20:6497:x1876039508750464:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789130861.228731:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8603050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+20:6497:x1876039508750464:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 86us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130861.228739:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1789130861.228796:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff8a4f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508750464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789130861.229228:0:10337:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff8a4f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:10337:1876039508750592:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789130861.229263:0:10337:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130861.229318:0:10337:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddff7d7e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789130861.229410:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508750592 00000100:00100000:1.0:1789130861.229414:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508750592 00000100:00100000:1.0:1789130861.229444:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1789130861.229451:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8601c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+20:10337:x1876039508750592:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789130861.229555:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8601c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+20:10337:x1876039508750592:12345-0@lo:502:llog_process_th.0 Request processed in 104us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130861.229563:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1789130861.229635:0:10337:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff8a4f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:10337:1876039508750592:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789130861.229670:0:10337:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff8a4f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:10337:1876039508750720:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789130861.229700:0:10337:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130861.229725:0:10337:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddff7d7e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789130861.229760:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508750720 00000100:00100000:1.0:1789130861.229764:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508750720 00000100:00100000:1.0:1789130861.229780:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1789130861.229786:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8602050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+20:10337:x1876039508750720:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789130861.229847:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8602050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+20:10337:x1876039508750720:12345-0@lo:502:llog_process_th.0 Request processed in 60us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130861.229854:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1789130861.229963:0:10337:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff8a4f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:10337:1876039508750720:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1789130861.229981:0:10337:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1789130861.231988:0:6497:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1789130861.232034:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789130861.232048:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff91dcc7e37a00/0xf3fe2838e1fc21e8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc21ef expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130861.232061:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff91dcc7e37a00/0xf3fe2838e1fc21e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc21ef expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789130861.232074:0:6497:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1789130861.232078:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 43 10000000:01000000:0.0:1789130861.232081:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1789130861.232125:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff91ddc0031600/0xf3fe2838e1fc21f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130861.232133:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff91ddc0031600/0xf3fe2838e1fc21f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130861.232144:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff91ddc0031600/0xf3fe2838e1fc21f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130861.232171:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff8e12c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508750848:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789130861.232243:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130861.232355:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddff7e3300 going to sleep for 11 seconds 00000100:00100000:2.0:1789130861.232664:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508750848 00000100:00100000:2.0:1789130861.232672:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508750848 00000100:00100000:2.0:1789130861.232764:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1789130861.232776:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8600c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+20:6497:x1876039508750848:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789130861.232993:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130861.233013:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91dcc7e36000/0xf3fe2838e1fc21fd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3fe2838e1fc21f6 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130861.233045:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91dcc7e36000/0xf3fe2838e1fc21fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3fe2838e1fc21f6 expref: 21 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130861.233079:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91dcc7e36000/0xf3fe2838e1fc21fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc21f6 expref: 21 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130861.233090:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dcc7e36000, rc 0) 00000100:00100000:2.0:1789130861.233281:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8600c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+21:6497:x1876039508750848:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 508us (1037us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130861.233287:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1789130861.233730:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff8e12c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508750848:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789130861.233760:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff91ddc0031600/0xf3fe2838e1fc21f6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc21fd expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130861.233772:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff91ddc0031600/0xf3fe2838e1fc21f6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3fe2838e1fc21fd expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130861.233974:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7814000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508750976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789130861.234013:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130861.234048:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddff84c900 going to sleep for 11 seconds 00000100:00100000:0.0:1789130861.234060:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508750976 00000100:00100000:0.0:1789130861.234067:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508750976 00000100:00100000:0.0:1789130861.234112:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1789130861.234121:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8601050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+21:6497:x1876039508750976:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789130861.234274:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8601050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+21:6497:x1876039508750976:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 154us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130861.234282:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1789130861.234291:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7814000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508750976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789130861.234321:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7814000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508751104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789130861.234519:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130861.234548:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddff84c900 going to sleep for 11 seconds 00000100:00100000:2.0:1789130861.234633:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508751104 00000100:00100000:2.0:1789130861.234639:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508751104 00000100:00100000:2.0:1789130861.234672:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1789130861.234679:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8603450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+21:6497:x1876039508751104:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789130861.234780:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8603450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+21:6497:x1876039508751104:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 101us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130861.234786:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1789130861.234870:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7814000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508751104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789130861.235540:0:10338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7d9b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:10338:1876039508751232:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789130861.235594:0:10338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130861.235620:0:10338:0:(client.c:2715:ptlrpc_set_wait()) set ffff91de01a87480 going to sleep for 11 seconds 00000100:00100000:0.0:1789130861.235631:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508751232 00000100:00100000:0.0:1789130861.235636:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508751232 00000100:00100000:0.0:1789130861.235674:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1789130861.235683:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddf5cc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+21:10338:x1876039508751232:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789130861.235789:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddf5cc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+21:10338:x1876039508751232:12345-0@lo:502:llog_process_th.0 Request processed in 107us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130861.235797:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1789130861.235983:0:10338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7d9b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:10338:1876039508751232:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789130861.236002:0:10338:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789130861.236011:0:10338:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789130861.236013:0:10338:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789130861.236017:0:10338:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1789130861.236033:0:10338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7d9b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:10338:1876039508751360:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789130861.236076:0:10338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130861.236100:0:10338:0:(client.c:2715:ptlrpc_set_wait()) set ffff91de01a87480 going to sleep for 11 seconds 00000100:00100000:0.0:1789130861.236202:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508751360 00000100:00100000:0.0:1789130861.236207:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508751360 00000100:00100000:0.0:1789130861.236240:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1789130861.236248:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddf5cc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+21:10338:x1876039508751360:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789130861.236362:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddf5cc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+21:10338:x1876039508751360:12345-0@lo:502:llog_process_th.0 Request processed in 115us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130861.236370:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1789130861.236683:0:10338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7d9b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:10338:1876039508751360:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789130861.236703:0:10338:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789130861.236708:0:10338:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789130861.236710:0:10338:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789130861.236714:0:10338:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 46 count 46 00000020:01000000:1.0:1789130861.236977:0:6497:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 43-45 (rc=0) 10000000:01000000:1.0:1789130861.237006:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1789130861.237017:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff91ddc0031600/0xf3fe2838e1fc21f6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc21fd expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130861.237029:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff91ddc0031600/0xf3fe2838e1fc21f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc21fd expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789130861.237101:0:6497:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789130861.237105:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff91dded7b6800 from 48 10000000:01000000:1.0:1789130861.237108:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789130861.237139:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff91dde19ab200/0xf3fe2838e1fc2204 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130861.237147:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff91dde19ab200/0xf3fe2838e1fc2204 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130861.237155:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff91dde19ab200/0xf3fe2838e1fc2204 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130861.237170:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7814000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508751488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789130861.237204:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130861.237268:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddff84c900 going to sleep for 11 seconds 00000100:00100000:0.0:1789130861.237306:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508751488 00000100:00100000:0.0:1789130861.237311:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508751488 00000100:00100000:2.0:1789130861.237982:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1789130861.237999:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddf5cc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+21:6497:x1876039508751488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789130861.238012:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130861.238030:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91dcc7e36800/0xf3fe2838e1fc220b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3fe2838e1fc2204 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130861.238060:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91dcc7e36800/0xf3fe2838e1fc220b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3fe2838e1fc2204 expref: 22 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130861.238091:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91dcc7e36800/0xf3fe2838e1fc220b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc2204 expref: 22 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130861.238118:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dcc7e36800, rc 0) 00000100:00100000:2.0:1789130861.238304:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddf5cc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+22:6497:x1876039508751488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 310us (1097us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130861.238312:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1789130861.238691:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7814000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508751488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789130861.238710:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff91dde19ab200/0xf3fe2838e1fc2204 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc220b expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130861.238720:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff91dde19ab200/0xf3fe2838e1fc2204 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3fe2838e1fc220b expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130861.238789:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7814000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508751616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789130861.238820:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130861.238891:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddff84c900 going to sleep for 11 seconds 00000100:00100000:0.0:1789130861.239094:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508751616 00000100:00100000:0.0:1789130861.239101:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508751616 00000100:00100000:0.0:1789130861.239144:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1789130861.239154:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddf5cc6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+22:6497:x1876039508751616:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789130861.239313:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddf5cc6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+22:6497:x1876039508751616:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 160us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130861.239321:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1789130861.239581:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7814000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508751616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789130861.239618:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff8a4f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508751744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789130861.239667:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130861.239782:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508751744 00000100:00100000:1.0:1789130861.239786:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508751744 00000100:00100000:1.0:1789130861.239820:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1789130861.239826:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddf5cc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+22:6497:x1876039508751744:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789130861.239907:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddf5cc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+22:6497:x1876039508751744:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 82us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130861.239913:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1789130861.239978:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddff7d7780 going to sleep for 11 seconds 00000100:00100000:2.0:1789130861.239991:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff8a4f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508751744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789130861.240757:0:10339:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7814000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:10339:1876039508751872:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789130861.240801:0:10339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130861.240829:0:10339:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddff84c180 going to sleep for 11 seconds 00000100:00100000:2.0:1789130861.240833:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508751872 00000100:00100000:2.0:1789130861.240838:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508751872 00000100:00100000:2.0:1789130861.241198:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1789130861.241207:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddf5cc4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+22:10339:x1876039508751872:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789130861.241346:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddf5cc4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+22:10339:x1876039508751872:12345-0@lo:502:llog_process_th.0 Request processed in 140us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130861.241355:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1789130861.241619:0:10339:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7814000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:10339:1876039508751872:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789130861.241668:0:10339:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7814000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:10339:1876039508752000:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789130861.241703:0:10339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130861.241763:0:10339:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddff84c180 going to sleep for 11 seconds 00000100:00100000:3.0:1789130861.241844:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508752000 00000100:00100000:3.0:1789130861.241853:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508752000 00000100:00100000:3.0:1789130861.241892:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1789130861.241901:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddf5cc5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+22:10339:x1876039508752000:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789130861.242003:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddf5cc5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+22:10339:x1876039508752000:12345-0@lo:502:llog_process_th.0 Request processed in 103us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130861.242011:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1789130861.242055:0:10339:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7814000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:10339:1876039508752000:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1789130861.242081:0:10339:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1789130861.242388:0:6497:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:2.0:1789130861.242413:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789130861.242424:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff91dde19ab200/0xf3fe2838e1fc2204 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc220b expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130861.242438:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff91dde19ab200/0xf3fe2838e1fc2204 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc220b expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789130861.242448:0:6497:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1789130861.242452:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 43 10000000:01000000:2.0:1789130861.242455:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1789130861.242521:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff91dcc7e37400/0xf3fe2838e1fc2212 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130861.242538:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff91dcc7e37400/0xf3fe2838e1fc2212 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130861.242548:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff91dcc7e37400/0xf3fe2838e1fc2212 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130861.242564:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff8a4f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508752128:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789130861.242598:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130861.242622:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddff7d7000 going to sleep for 11 seconds 00000100:00100000:1.0:1789130861.242726:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508752128 00000100:00100000:1.0:1789130861.242731:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508752128 00000100:00100000:1.0:1789130861.242767:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1789130861.242775:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddf5cc7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+22:6497:x1876039508752128:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789130861.242787:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130861.242800:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91dde19aac00/0xf3fe2838e1fc2219 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3fe2838e1fc2212 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130861.242825:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91dde19aac00/0xf3fe2838e1fc2219 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3fe2838e1fc2212 expref: 23 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130861.242836:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91dde19aac00/0xf3fe2838e1fc2219 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc2212 expref: 23 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130861.242846:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dde19aac00, rc 0) 00000100:00100000:1.0:1789130861.242897:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddf5cc7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+23:6497:x1876039508752128:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130861.242904:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1789130861.243252:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff8a4f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508752128:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789130861.243267:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff91dcc7e37400/0xf3fe2838e1fc2212 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc2219 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130861.243276:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff91dcc7e37400/0xf3fe2838e1fc2212 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3fe2838e1fc2219 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130861.243337:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7d9b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508752256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789130861.243365:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130861.243397:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff91de01a87480 going to sleep for 11 seconds 00000100:00100000:1.0:1789130861.243404:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508752256 00000100:00100000:1.0:1789130861.243409:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508752256 00000100:00100000:1.0:1789130861.243491:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1789130861.243499:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddf5cc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+23:6497:x1876039508752256:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789130861.243646:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddf5cc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+23:6497:x1876039508752256:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 147us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130861.243654:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1789130861.243708:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7d9b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508752256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789130861.243735:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7d9b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508752384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789130861.243773:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130861.244247:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff91de01a87480 going to sleep for 11 seconds 00000100:00100000:2.0:1789130861.244317:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508752384 00000100:00100000:2.0:1789130861.244321:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508752384 00000100:00100000:2.0:1789130861.244355:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1789130861.244362:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddf5cc6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+23:6497:x1876039508752384:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789130861.244476:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddf5cc6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+23:6497:x1876039508752384:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 96us (684us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130861.244483:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1789130861.244583:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7d9b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508752384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789130861.245009:0:10340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7d9b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:10340:1876039508752512:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789130861.245056:0:10340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130861.245082:0:10340:0:(client.c:2715:ptlrpc_set_wait()) set ffff91de01a87000 going to sleep for 11 seconds 00000100:00100000:2.0:1789130861.245171:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508752512 00000100:00100000:2.0:1789130861.245176:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508752512 00000100:00100000:2.0:1789130861.245207:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1789130861.245215:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddf5cc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+23:10340:x1876039508752512:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789130861.245297:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddf5cc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+23:10340:x1876039508752512:12345-0@lo:502:llog_process_th.0 Request processed in 83us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130861.245305:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1789130861.245492:0:10340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7d9b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:10340:1876039508752512:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789130861.245517:0:10340:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789130861.245527:0:10340:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789130861.245530:0:10340:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789130861.245536:0:10340:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1789130861.245560:0:10340:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7d9b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:10340:1876039508752640:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789130861.245595:0:10340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130861.245619:0:10340:0:(client.c:2715:ptlrpc_set_wait()) set ffff91de01a87000 going to sleep for 11 seconds 00000100:00100000:2.0:1789130861.245721:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508752640 00000100:00100000:2.0:1789130861.245726:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508752640 00000100:00100000:2.0:1789130861.245754:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1789130861.245767:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddf5cc4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+23:10340:x1876039508752640:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789130861.245834:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddf5cc4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+23:10340:x1876039508752640:12345-0@lo:502:llog_process_th.0 Request processed in 67us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130861.245842:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1789130861.246087:0:10340:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7d9b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:10340:1876039508752640:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789130861.246107:0:10340:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789130861.246112:0:10340:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789130861.246114:0:10340:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789130861.246118:0:10340:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:2.0:1789130861.246709:0:6497:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 43-45 (rc=0) 10000000:01000000:2.0:1789130861.246736:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1789130861.246746:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff91dcc7e37400/0xf3fe2838e1fc2212 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc2219 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130861.246759:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff91dcc7e37400/0xf3fe2838e1fc2212 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc2219 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789130861.246770:0:6497:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1789130861.246773:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff91ddd10e8000 from 1 10000000:01000000:2.0:1789130861.246777:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789130861.246811:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff91dcc7e36a00/0xf3fe2838e1fc2220 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130861.246818:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff91dcc7e36a00/0xf3fe2838e1fc2220 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130861.246827:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff91dcc7e36a00/0xf3fe2838e1fc2220 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130861.246847:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff8a5680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508752768:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789130861.246904:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130861.246945:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddff7d7000 going to sleep for 11 seconds 00000100:00100000:1.0:1789130861.247059:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508752768 00000100:00100000:1.0:1789130861.247066:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508752768 00000100:00100000:1.0:1789130861.247120:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1789130861.247128:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddf5cc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+23:6497:x1876039508752768:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789130861.247141:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130861.247157:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91dde19ab600/0xf3fe2838e1fc2227 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3fe2838e1fc2220 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130861.247183:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91dde19ab600/0xf3fe2838e1fc2227 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3fe2838e1fc2220 expref: 24 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130861.247195:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91dde19ab600/0xf3fe2838e1fc2227 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc2220 expref: 24 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130861.247205:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dde19ab600, rc 0) 00000100:00100000:1.0:1789130861.247254:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddf5cc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+24:6497:x1876039508752768:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130861.247263:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1789130861.247621:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff8a5680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508752768:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789130861.247649:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff91dcc7e36a00/0xf3fe2838e1fc2220 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc2227 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130861.247659:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff91dcc7e36a00/0xf3fe2838e1fc2220 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3fe2838e1fc2227 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130861.247725:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff8a5680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508752896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789130861.247755:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130861.247792:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddff7d7000 going to sleep for 11 seconds 00000100:00100000:3.0:1789130861.247841:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508752896 00000100:00100000:3.0:1789130861.247848:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508752896 00000100:00100000:3.0:1789130861.247897:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1789130861.247905:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddf5cc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+24:6497:x1876039508752896:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789130861.247996:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddf5cc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+24:6497:x1876039508752896:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 92us (240us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789130861.248003:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1789130861.248215:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff8a5680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508752896:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1789130861.248246:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1789130861.248254:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff91dcc7e36a00/0xf3fe2838e1fc2220 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc2227 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130861.248262:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff91dcc7e36a00/0xf3fe2838e1fc2220 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc2227 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130861.405658:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789130861.405799:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498208128 00000100:00100000:1.0:1789130861.405813:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498208128 00000100:00100000:1.0:1789130861.405916:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 241 00000100:00100000:1.0:1789130861.405926:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddf5cc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+8:6161:x1876039498208128:12345-192.168.203.11@tcp:101: 00010000:00010000:1.0:1789130861.405955:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130861.405977:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91dde19aa200/0xf3fe2838e1fc222e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269861 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130861.406008:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91dde19aa200/0xf3fe2838e1fc222e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269861 expref: 9 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130861.406018:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91dde19aa200/0xf3fe2838e1fc222e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269861 expref: 9 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130861.406054:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dde19aa200, rc 0) 00000100:00100000:1.0:1789130861.406117:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddf5cc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+9:6161:x1876039498208128:12345-192.168.203.11@tcp:101: Request processed in 194us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130861.406124:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 241 00000100:00100000:0.0:1789130861.409673:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789130861.409835:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498208256 00000100:00100000:1.0:1789130861.409848:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498208256 00000100:00100000:1.0:1789130861.410163:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 242 00000100:00100000:1.0:1789130861.410176:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddf5cc4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+9:6161:x1876039498208256:12345-192.168.203.11@tcp:501: 00000100:00100000:1.0:1789130861.410373:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddf5cc4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+9:6161:x1876039498208256:12345-192.168.203.11@tcp:501: Request processed in 200us (714us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130861.410381:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 242 00000100:00100000:3.0:1789130861.413159:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789130861.413330:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498208384 00000100:00100000:1.0:1789130861.413340:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498208384 00000100:00100000:1.0:1789130861.413398:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 243 00000100:00100000:1.0:1789130861.413410:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddcf4fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+9:6161:x1876039498208384:12345-192.168.203.11@tcp:503: 00000100:00100000:1.0:1789130861.413672:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddcf4fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+9:6161:x1876039498208384:12345-192.168.203.11@tcp:503: Request processed in 264us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130861.413681:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 243 00000100:00100000:3.0:1789130861.419801:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789130861.419873:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498208512 00000100:00100000:1.0:1789130861.419886:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498208512 00000100:00100000:1.0:1789130861.419972:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 244 00000100:00100000:1.0:1789130861.419992:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddcf4fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+9:6642:x1876039498208512:12345-192.168.203.11@tcp:502: 00000100:00100000:1.0:1789130861.420700:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddcf4fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+9:6642:x1876039498208512:12345-192.168.203.11@tcp:502: Request processed in 710us (901us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130861.420723:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 244 00000100:00100000:0.0:1789130861.435801:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789130861.435953:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498208640 00000100:00100000:1.0:1789130861.435968:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498208640 00000100:00100000:1.0:1789130861.436050:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 245 00000100:00100000:1.0:1789130861.436300:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddcf4fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+9:6642:x1876039498208640:12345-192.168.203.11@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789130861.436843:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddcf4fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+9:6642:x1876039498208640:12345-192.168.203.11@tcp:502:llog_process_th.0 Request processed in 780us (1052us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130861.436853:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 245 00000100:00100000:3.0:1789130861.440749:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789130861.440827:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498208768 00000100:00100000:1.0:1789130861.440841:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498208768 00000100:00100000:1.0:1789130861.440926:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 246 00000100:00100000:1.0:1789130861.440950:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddcf4f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+9:6161:x1876039498208768:12345-192.168.203.11@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789130861.440973:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130861.440997:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91dde19abe00/0xf3fe2838e1fc2235 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269868 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130861.441035:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91dde19abe00/0xf3fe2838e1fc2235 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269868 expref: 10 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130861.441048:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91dde19abe00/0xf3fe2838e1fc2235 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269868 expref: 10 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130861.441058:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dde19abe00, rc 0) 00000100:00100000:1.0:1789130861.441270:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddcf4f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+10:6161:x1876039498208768:12345-192.168.203.11@tcp:101:ll_cfg_requeue.0 Request processed in 274us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130861.441277:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 246 00000100:00100000:3.0:1789130861.446291:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789130861.446836:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498208896 00000100:00100000:1.0:1789130861.446847:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498208896 00000100:00100000:1.0:1789130861.446911:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 247 00000100:00100000:1.0:1789130861.446919:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddcf4fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+10:6161:x1876039498208896:12345-192.168.203.11@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789130861.447316:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddcf4fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+10:6161:x1876039498208896:12345-192.168.203.11@tcp:501:ll_cfg_requeue.0 Request processed in 395us (1039us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789130861.447325:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 247 00010000:00010000:3.0:1789130861.458097:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789130861.918908:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789130861.918971:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789130861.919022:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789130861.919056:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789130861.919083:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789130861.919173:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498209152 00000100:00100000:3.0:1789130861.919187:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498209152 00000100:00100000:3.0:1789130861.919263:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498209280 00000100:00100000:3.0:1789130861.919266:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498209280 00000100:00100000:3.0:1789130861.919292:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 63 00000100:00100000:3.0:1789130861.919302:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff8e12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+6:2387:x1876039498209152:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1789130861.919402:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff8e12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+6:2387:x1876039498209152:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 100us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130861.919411:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 63 00000100:00100000:3.0:1789130861.919452:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 64 00000100:00100000:3.0:1789130861.919506:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff8e2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+5:2387:x1876039498209280:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1789130861.919538:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff8e2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+5:2387:x1876039498209280:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 80us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130861.919545:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 64 00000100:00100000:3.0:1789130861.919566:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498209408 00000100:00100000:3.0:1789130861.919570:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498209408 00000100:00100000:3.0:1789130861.919600:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498209536 00000100:00100000:3.0:1789130861.919604:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498209536 00000100:00100000:3.0:1789130861.919624:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 20 00000100:00100000:3.0:1789130861.919631:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff8e03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+5:2387:x1876039498209408:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1789130861.919660:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff8e03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+5:2387:x1876039498209408:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 29us (689us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130861.919666:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 20 00000100:00100000:3.0:1789130861.919678:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 21 00000100:00100000:3.0:1789130861.919684:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff8e1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+5:2387:x1876039498209536:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1789130861.919707:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff8e1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+5:2387:x1876039498209536:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 24us (624us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130861.919714:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 21 00000100:00080000:0.0:1789130861.920433:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789130861.920439:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789130861.920443:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789130861.920446:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789130861.920820:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498209024 00000100:00100000:2.0:1789130861.920830:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498209024 00000100:00100000:2.0:1789130861.920895:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 248 00000100:00100000:2.0:1789130861.920905:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddcf4f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+10:2387:x1876039498209024:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1789130861.920971:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddcf4f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+10:2387:x1876039498209024:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 67us (1948us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130861.920980:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 248 00010000:00010000:2.0:1789130862.483117:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789130862.899320:0:10378:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff97ce6b40 20000000:00000080:1.0:1789130862.899345:0:10378:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff91dcc7c4e400 uarg=0000000000000000 20000000:01000000:1.0:1789130862.899397:0:10378:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1789130862.899404:0:10378:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1789130862.899408:0:10378:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1789130862.901966:0:10379:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:0.0:1789130862.902098:0:10378:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:0.0:1789130862.904855:0:10378:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:0.0:1789130862.904892:0:10378:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:0.0:1789130862.904906:0:10378:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:0.0:1789130862.904936:0:10378:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789130862.904960:0:10378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91ddc0031a00/0xf3fe2838e1fc223c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130862.904982:0:10378:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91ddc27e6e00/0xf3fe2838e1fc1ed8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc1ed1 expref: 23 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130862.905011:0:10378:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91ddc27e6a00/0xf3fe2838e1fc1ee6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc1edf expref: 23 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130862.905020:0:10378:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91ddfa80e400/0xf3fe2838e1fc1f3a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc1f33 expref: 23 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130862.905027:0:10378:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91ddfd0b4a00/0xf3fe2838e1fc2060 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc2059 expref: 23 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130862.905038:0:10378:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91dcc7e36c00/0xf3fe2838e1fc2178 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269829 expref: 9 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130862.905047:0:10378:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91ddc0031a00/0xf3fe2838e1fc223c lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130862.905093:0:10378:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91dcc7e36c00/0xf3fe2838e1fc2178 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269829 expref: 9 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130862.905110:0:10378:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91dcc7e36c00/0xf3fe2838e1fc2178 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269829 expref: 9 pid: 6492 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130862.905128:0:10378:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff8e2940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10378:1876039508753024:192.168.203.11@tcp:104: 00010000:00010000:0.0:1789130862.905243:0:10378:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91ddfd0b4a00/0xf3fe2838e1fc2060 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf3fe2838e1fc2059 expref: 23 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130862.905252:0:10378:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91ddfd0b4a00/0xf3fe2838e1fc2060 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf3fe2838e1fc2059 expref: 23 pid: 6494 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130862.905263:0:10378:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff8e0000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10378:1876039508753152:0@lo:104: 00000100:00100000:0.0:1789130862.905313:0:10378:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789130862.905364:0:10378:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91ddfa80e400/0xf3fe2838e1fc1f3a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf3fe2838e1fc1f33 expref: 23 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130862.905373:0:10378:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91ddfa80e400/0xf3fe2838e1fc1f3a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf3fe2838e1fc1f33 expref: 23 pid: 6492 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130862.905382:0:10378:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff8e2d00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10378:1876039508753280:0@lo:104: 00000100:00100000:0.0:1789130862.905405:0:10378:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789130862.905438:0:10378:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91ddc27e6a00/0xf3fe2838e1fc1ee6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf3fe2838e1fc1edf expref: 23 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130862.905447:0:10378:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91ddc27e6a00/0xf3fe2838e1fc1ee6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf3fe2838e1fc1edf expref: 23 pid: 6493 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130862.905455:0:10378:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff8e3c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10378:1876039508753408:0@lo:104: 00010000:00010000:0.0:1789130862.905504:0:10378:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91ddc27e6e00/0xf3fe2838e1fc1ed8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf3fe2838e1fc1ed1 expref: 23 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130862.905513:0:10378:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91ddc27e6e00/0xf3fe2838e1fc1ed8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf3fe2838e1fc1ed1 expref: 23 pid: 6492 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130862.905522:0:10378:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff8e21c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10378:1876039508753536:0@lo:104: 00000100:00100000:0.0:1789130862.905537:0:10378:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddff9d6780 going to sleep for 11 seconds 00000100:00100000:1.0:1789130862.906183:0:6483:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1789130862.906205:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130862.906233:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130862.906251:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508753152 00000100:00100000:2.0:1789130862.906257:0:9504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508753280 00000100:00100000:1.0:1789130862.906260:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508753152 00000100:00100000:2.0:1789130862.906264:0:9504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508753280 00000100:00100000:2.0:1789130862.906319:0:9504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508753408 00000100:00100000:2.0:1789130862.906323:0:9504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508753408 00000100:00100000:1.0:1789130862.906323:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508753536 00000100:00100000:1.0:1789130862.906331:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508753536 00000100:00100000:2.0:1789130862.906419:0:9504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789130862.906432:0:9504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff7d9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+6:10378:x1876039508753280:12345-0@lo:104: 00010000:00010000:2.0:1789130862.906449:0:9504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff91ddc27e7e00/0xf3fe2838e1fc1f33 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3fe2838e1fc1f3a expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130862.906608:0:9504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789130862.906615:0:9504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff7d9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+6:10378:x1876039508753280:12345-0@lo:104: Request processed in 186us (1209us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130862.907573:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789130862.907753:0:9503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789130862.907765:0:9503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7814000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+6:10378:x1876039508753408:12345-0@lo:104: 00000100:00100000:2.0:1789130862.907774:0:9504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00010000:3.0:1789130862.907779:0:9503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff91ddc27e6400/0xf3fe2838e1fc1edf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3fe2838e1fc1ee6 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130862.907803:0:9504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789130862.907813:0:9504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7816940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+5:10378:x1876039508753536:12345-0@lo:104: 00010000:00010000:2.0:1789130862.907824:0:9504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff91ddfa939e00/0xf3fe2838e1fc1ed1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3fe2838e1fc1ed8 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130862.907853:0:9503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789130862.907870:0:9503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7814000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+5:10378:x1876039508753408:12345-0@lo:104: Request processed in 108us (1664us total) trans 0 rc 0/0 00010000:00010000:2.0:1789130862.907877:0:9504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1789130862.907889:0:9503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789130862.907890:0:9504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7816940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+5:10378:x1876039508753536:12345-0@lo:104: Request processed in 75us (1652us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130862.907901:0:9504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00010000:3.0:1789130862.907935:0:7442:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789130862.907943:0:7442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff91ddc27e7e00/0xf3fe2838e1fc1f33 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3fe2838e1fc1f3a expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130862.907954:0:7442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddc27e7e00 already unused, calling callback (ffffffffc124bc20) 00010000:00010000:2.0:1789130862.907954:0:6488:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 10000000:00010000:3.0:1789130862.907961:0:7442:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff91ddc27e7e00/0xf3fe2838e1fc1f33 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xf3fe2838e1fc1f3a expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130862.907963:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff91ddc27e6400/0xf3fe2838e1fc1edf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3fe2838e1fc1ee6 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130862.907976:0:7442:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff91ddc27e7e00/0xf3fe2838e1fc1f33 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xf3fe2838e1fc1f3a expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789130862.907985:0:7442:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff91ddc27e7e00/0xf3fe2838e1fc1f33 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xf3fe2838e1fc1f3a expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789130862.907992:0:7442:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789130862.908031:0:7442:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff91ddc27e7e00/0xf3fe2838e1fc1f33 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc1f3a expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130862.908037:0:7442:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789130862.908060:0:7442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff91ddc27e7e00/0xf3fe2838e1fc1f33 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc1f3a expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130862.908068:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff91ddc27e7e00/0xf3fe2838e1fc1f33 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc1f3a expref: -99 pid: 8408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130862.908083:0:7442:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789130862.908086:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddc27e6400 already unused, calling callback (ffffffffc124bc20) 00010000:00010000:3.0:1789130862.908088:0:7442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff91ddfa939e00/0xf3fe2838e1fc1ed1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3fe2838e1fc1ed8 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789130862.908091:0:6488:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff91ddc27e6400/0xf3fe2838e1fc1edf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xf3fe2838e1fc1ee6 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130862.908102:0:6488:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff91ddc27e6400/0xf3fe2838e1fc1edf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xf3fe2838e1fc1ee6 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130862.908109:0:7442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddfa939e00 already unused, calling callback (ffffffffc124bc20) 10000000:00010000:3.0:1789130862.908114:0:7442:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff91ddfa939e00/0xf3fe2838e1fc1ed1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xf3fe2838e1fc1ed8 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789130862.908123:0:6488:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff91ddc27e6400/0xf3fe2838e1fc1edf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xf3fe2838e1fc1ee6 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130862.908127:0:7442:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff91ddfa939e00/0xf3fe2838e1fc1ed1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xf3fe2838e1fc1ed8 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789130862.908138:0:6488:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789130862.908156:0:6488:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff91ddc27e6400/0xf3fe2838e1fc1edf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc1ee6 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130862.908162:0:6488:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789130862.908182:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff91ddc27e6400/0xf3fe2838e1fc1edf lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc1ee6 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130862.908191:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff91ddc27e6400/0xf3fe2838e1fc1edf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc1ee6 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130862.908202:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130862.908204:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130862.908206:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130862.908212:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789130862.908236:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7d9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3626:1876039508753664:0@lo:103:ldlm_bl.0 10000000:00010000:3.0:1789130862.908239:0:7442:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff91ddfa939e00/0xf3fe2838e1fc1ed1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf3fe2838e1fc1ed8 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789130862.908249:0:7442:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789130862.908272:0:7442:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff91ddfa939e00/0xf3fe2838e1fc1ed1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc1ed8 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130862.908279:0:7442:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789130862.908285:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789130862.908289:0:7442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff91ddfa939e00/0xf3fe2838e1fc1ed1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc1ed8 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130862.908298:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff91ddfa939e00/0xf3fe2838e1fc1ed1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc1ed8 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130862.908309:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130862.908312:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130862.908315:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789130862.908350:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff8a4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3627:1876039508753792:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789130862.908377:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7d9a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3628:1876039508753920:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789130862.908378:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130862.908415:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130862.908427:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508753664 00000100:00100000:2.0:1789130862.908434:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508753664 00000100:00100000:3.0:1789130862.908501:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508753792 00000100:00100000:3.0:1789130862.908505:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508753792 00010000:00010000:2.0:1789130862.908510:0:6486:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91ddfa80e400/0xf3fe2838e1fc1f3a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3fe2838e1fc1f33 expref: 24 pid: 6492 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130862.908525:0:8431:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91ddc27e6a00/0xf3fe2838e1fc1ee6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3fe2838e1fc1edf expref: 25 pid: 6493 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130862.908549:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508753920 00000100:00100000:3.0:1789130862.908553:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789130862.908561:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508753920 00000100:00100000:3.0:1789130862.908563:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff8a7840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+25:3626:x1876039508753664:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789130862.908580:0:6486:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91ddc27e6e00/0xf3fe2838e1fc1ed8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3fe2838e1fc1ed1 expref: 26 pid: 6492 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130862.908597:0:8431:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1789130862.908599:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00010000:00010000:3.0:1789130862.908606:0:8431:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91ddfa80e400/0xf3fe2838e1fc1f3a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3fe2838e1fc1f33 expref: 26 pid: 6492 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130862.908611:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff8a5e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+26:3627:x1876039508753792:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789130862.908625:0:8431:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91ddfa80e400/0xf3fe2838e1fc1f3a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf3fe2838e1fc1f33 expref: 26 pid: 6492 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130862.908640:0:6486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789130862.908647:0:6486:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91ddc27e6a00/0xf3fe2838e1fc1ee6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3fe2838e1fc1edf expref: 26 pid: 6493 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130862.908648:0:8431:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789130862.908677:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff8a7840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+26:3626:x1876039508753664:12345-0@lo:103:ldlm_bl.0 Request processed in 116us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130862.908684:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789130862.908717:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789130862.908724:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7d98000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+25:3628:x1876039508753920:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789130862.908731:0:8431:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789130862.908736:0:8431:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91ddc27e6e00/0xf3fe2838e1fc1ed8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3fe2838e1fc1ed1 expref: 25 pid: 6492 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130862.908744:0:8431:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91ddc27e6e00/0xf3fe2838e1fc1ed8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf3fe2838e1fc1ed1 expref: 25 pid: 6492 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130862.908754:0:8431:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789130862.908776:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7d98000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+25:3628:x1876039508753920:12345-0@lo:103:ldlm_bl.0 Request processed in 53us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130862.908782:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789130862.908816:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7d9a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3628:1876039508753920:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789130862.908865:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7d9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3626:1876039508753664:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789130862.908967:0:6486:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91ddc27e6a00/0xf3fe2838e1fc1ee6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf3fe2838e1fc1edf expref: 24 pid: 6493 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130862.908979:0:6486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789130862.909108:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff8a5e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+24:3627:x1876039508753792:12345-0@lo:103:ldlm_bl.0 Request processed in 500us (729us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130862.909116:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789130862.909368:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff8a4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3627:1876039508753792:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789130862.909540:0:10378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91ddfa80e400/0xf3fe2838e1fc1f3a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf3fe2838e1fc1f33 expref: 23 pid: 6492 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130862.909555:0:10378:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff8e2d00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10378:1876039508753280:0@lo:104: 00010000:00010000:0.0:1789130862.909567:0:10378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91ddc27e6a00/0xf3fe2838e1fc1ee6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf3fe2838e1fc1edf expref: 22 pid: 6493 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130862.909641:0:10378:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff8e3c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10378:1876039508753408:0@lo:104: 00010000:00010000:0.0:1789130862.909656:0:10378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91ddc27e6e00/0xf3fe2838e1fc1ed8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf3fe2838e1fc1ed1 expref: 21 pid: 6492 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130862.909666:0:10378:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff8e21c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10378:1876039508753536:0@lo:104: 00000100:00100000:1.0:1789130862.910130:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff8e0780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+6:10378:x1876039508753152:12345-0@lo:104: 00010000:00010000:1.0:1789130862.910148:0:6483:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff91ddfd0b5800/0xf3fe2838e1fc2059 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3fe2838e1fc2060 expref: -99 pid: 9492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130862.910261:0:6483:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789130862.910269:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff8e0780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+3:10378:x1876039508753152:12345-0@lo:104: Request processed in 2686us (4955us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130862.910279:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789130862.910295:0:10378:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff8e0000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10378:1876039508753152:0@lo:104: 00010000:00010000:2.0:1789130862.910658:0:6488:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789130862.910666:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff91ddfd0b5800/0xf3fe2838e1fc2059 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3fe2838e1fc2060 expref: -99 pid: 9492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130862.910676:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddfd0b5800 already unused, calling callback (ffffffffc124bc20) 10000000:00010000:2.0:1789130862.910681:0:6488:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff91ddfd0b5800/0xf3fe2838e1fc2059 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf3fe2838e1fc2060 expref: -99 pid: 9492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130862.910690:0:6488:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff91ddfd0b5800/0xf3fe2838e1fc2059 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf3fe2838e1fc2060 expref: -99 pid: 9492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789130862.910697:0:6488:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff91ddfd0b5800/0xf3fe2838e1fc2059 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf3fe2838e1fc2060 expref: -99 pid: 9492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789130862.910715:0:6488:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789130862.911008:0:6488:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff91ddfd0b5800/0xf3fe2838e1fc2059 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc2060 expref: -99 pid: 9492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130862.911020:0:6488:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789130862.911052:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff91ddfd0b5800/0xf3fe2838e1fc2059 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc2060 expref: -99 pid: 9492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130862.911060:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff91ddfd0b5800/0xf3fe2838e1fc2059 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc2060 expref: -99 pid: 9492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130862.911077:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130862.911079:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130862.911081:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789130862.911229:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff8a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3625:1876039508754048:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789130862.911301:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130862.911346:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508754048 00000100:00100000:2.0:1789130862.911354:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508754048 00010000:00010000:2.0:1789130862.911384:0:8431:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91ddfd0b4a00/0xf3fe2838e1fc2060 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3fe2838e1fc2059 expref: 21 pid: 6494 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130862.911422:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789130862.911430:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc33ad050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+21:3625:x1876039508754048:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789130862.911441:0:8431:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789130862.911446:0:8431:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91ddfd0b4a00/0xf3fe2838e1fc2060 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3fe2838e1fc2059 expref: 21 pid: 6494 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130862.911481:0:8431:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91ddfd0b4a00/0xf3fe2838e1fc2060 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf3fe2838e1fc2059 expref: 21 pid: 6494 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130862.911499:0:8431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91ddfd0b4a00/0xf3fe2838e1fc2060 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf3fe2838e1fc2059 expref: 21 pid: 6494 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130862.911532:0:8431:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789130862.911578:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc33ad050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+20:3625:x1876039508754048:12345-0@lo:103:ldlm_bl.0 Request processed in 149us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130862.911586:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789130862.912332:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff8a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3625:1876039508754048:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789130862.912714:0:10378:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff8e2940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10378:1876039508753024:192.168.203.11@tcp:104: 00010000:00010000:0.0:1789130862.912749:0:10378:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91ddc0031a00/0xf3fe2838e1fc223c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130862.914293:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789130862.914695:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498209664 00000100:00100000:0.0:1789130862.914706:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498209664 00010000:00010000:0.0:1789130862.914746:0:6487:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91dcc7e36c00/0xf3fe2838e1fc2178 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269829 expref: 10 pid: 6492 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130862.914783:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 39 00000100:00100000:0.0:1789130862.914792:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7d9b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+10:2387:x1876039498209664:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789130862.914808:0:6487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789130862.914814:0:6487:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91dcc7e36c00/0xf3fe2838e1fc2178 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269829 expref: 10 pid: 6492 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130862.914827:0:6487:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91dcc7e36c00/0xf3fe2838e1fc2178 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269829 expref: 10 pid: 6492 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130862.914848:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91dcc7e36c00/0xf3fe2838e1fc2178 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269829 expref: 10 pid: 6492 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130862.914887:0:6487:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91ddc0031a00/0xf3fe2838e1fc223c lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130862.914896:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91ddc0031a00/0xf3fe2838e1fc223c lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130862.914914:0:6487:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91ddc0031a00/0xf3fe2838e1fc223c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130862.914953:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91ddc0031a00/0xf3fe2838e1fc223c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130862.914962:0:6487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91ddc0031a00/0xf3fe2838e1fc223c lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130862.914970:0:6487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91ddc0031a00/0xf3fe2838e1fc223c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130862.914976:0:6487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddc0031a00 already unused, calling callback (ffffffffc0c4e550) 00010000:00010000:0.0:1789130862.914980:0:6487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91ddc0031a00/0xf3fe2838e1fc223c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130862.914990:0:6487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91ddc0031a00/0xf3fe2838e1fc223c lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130862.915014:0:6487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91ddc0031a00/0xf3fe2838e1fc223c lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130862.915025:0:6487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789130862.915079:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7d9b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+9:2387:x1876039498209664:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 287us (794us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130862.915093:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 39 00010000:00010000:2.0:1789130862.915756:0:10378:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91ddc0031a00/0xf3fe2838e1fc223c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130862.915769:0:10378:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91ddc0031a00/0xf3fe2838e1fc223c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130862.915777:0:10378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91ddc0031a00/0xf3fe2838e1fc223c lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130863.188194:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789130863.188221:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff8e2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508754176:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789130863.188292:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130863.188388:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508754176 00000100:00100000:2.0:1789130863.188395:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508754176 00000100:00100000:2.0:1789130863.188442:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789130863.188452:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff8a7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508754176:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789130863.188513:0:6506:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789130863.188560:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff8a7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508754176:12345-0@lo:41:osp-pre-0-1.0 Request processed in 110us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130863.188568:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789130863.188626:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff8e2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508754176:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789130863.189801:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789130863.190115:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7d9a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1876039508754304:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789130863.190289:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130863.190530:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508754304 00000100:00100000:2.0:1789130863.190536:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508754304 00000100:00100000:2.0:1789130863.190698:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789130863.190708:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff8e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3628:x1876039508754304:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789130863.190737:0:6506:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789130863.190787:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff8e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3628:x1876039508754304:12345-0@lo:41:osp-pre-1-0.0 Request processed in 81us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130863.190795:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789130863.190863:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7d9a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1876039508754304:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1789130863.505802:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789130864.031929:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789130864.031972:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498209792 00000100:00100000:3.0:1789130864.031980:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498209792 00000100:00100000:3.0:1789130864.032030:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 249 00000100:00100000:3.0:1789130864.032039:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddcf4f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+9:6161:x1876039498209792:12345-192.168.203.11@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789130864.032057:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130864.032077:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91ddfd0b4400/0xf3fe2838e1fc2243 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf8eae2996d26986f expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130864.032105:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91ddfd0b4400/0xf3fe2838e1fc2243 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d26986f expref: 10 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130864.032116:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91ddfd0b4400/0xf3fe2838e1fc2243 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d26986f expref: 10 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130864.032136:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ddfd0b4400, rc 0) 00000100:00100000:3.0:1789130864.032191:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddcf4f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+10:6161:x1876039498209792:12345-192.168.203.11@tcp:101:ll_cfg_requeue.0 Request processed in 153us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130864.032214:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 249 00000100:00100000:3.0:1789130864.038781:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789130864.038820:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498209920 00000100:00100000:3.0:1789130864.038829:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498209920 00000100:00100000:3.0:1789130864.038893:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 250 00000100:00100000:3.0:1789130864.038903:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddcf4fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+10:6161:x1876039498209920:12345-192.168.203.11@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789130864.039056:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddcf4fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+10:6161:x1876039498209920:12345-192.168.203.11@tcp:501:ll_cfg_requeue.0 Request processed in 154us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130864.039064:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 250 00000100:00100000:0.0:1789130864.060877:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789130864.069119:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498210048 00000100:00100000:1.0:1789130864.069258:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498210048 00000100:00100000:2.0:1789130864.069406:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 251 00000100:00100000:2.0:1789130864.069417:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddcf4fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+10:6161:x1876039498210048:12345-192.168.203.11@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789130864.069613:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddcf4fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+10:6161:x1876039498210048:12345-192.168.203.11@tcp:503:ll_cfg_requeue.0 Request processed in 197us (8744us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130864.069622:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 251 00000100:00100000:3.0:1789130864.077285:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789130864.077788:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498210176 00000100:00100000:0.0:1789130864.077798:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498210176 00000100:00100000:0.0:1789130864.078120:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 252 00000100:00100000:0.0:1789130864.078143:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddcf4fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+10:6699:x1876039498210176:12345-192.168.203.11@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789130864.078447:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddcf4fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+10:6699:x1876039498210176:12345-192.168.203.11@tcp:502:llog_process_th.0 Request processed in 316us (1169us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130864.078455:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 252 00000100:00100000:2.0:1789130864.087926:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789130864.088067:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498210304 00000100:00100000:3.0:1789130864.088076:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498210304 00000100:00100000:0.0:1789130864.088218:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 253 00000100:00100000:0.0:1789130864.088230:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddcf4f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+10:6699:x1876039498210304:12345-192.168.203.11@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789130864.088381:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddcf4f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+10:6699:x1876039498210304:12345-192.168.203.11@tcp:502:llog_process_th.0 Request processed in 152us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130864.088390:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 253 10000000:01000000:0.0:1789130864.150036:0:6497:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789130864.150043:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91ddff549800 from 4 10000000:01000000:0.0:1789130864.150048:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789130864.150094:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff91ddc0030200/0xf3fe2838e1fc224a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130864.150106:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff91ddc0030200/0xf3fe2838e1fc224a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130864.150124:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff91ddc0030200/0xf3fe2838e1fc224a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130864.150161:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff8e21c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508754432:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789130864.150220:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130864.150270:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff91dcc7d68840 going to sleep for 11 seconds 00000100:00100000:2.0:1789130864.150371:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508754432 00000100:00100000:2.0:1789130864.150378:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508754432 00000100:00100000:2.0:1789130864.150431:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1789130864.150440:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddcf4f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+20:6497:x1876039508754432:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789130864.150453:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130864.150488:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91dcc7e37e00/0xf3fe2838e1fc2251 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3fe2838e1fc224a expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130864.150527:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91dcc7e37e00/0xf3fe2838e1fc2251 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3fe2838e1fc224a expref: 21 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130864.150538:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91dcc7e37e00/0xf3fe2838e1fc2251 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc224a expref: 21 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130864.150547:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dcc7e37e00, rc 0) 00000100:00100000:2.0:1789130864.150751:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddcf4f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+21:6497:x1876039508754432:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 311us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130864.150759:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1789130864.150806:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff8e21c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508754432:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789130864.150821:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff91ddc0030200/0xf3fe2838e1fc224a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc2251 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130864.150830:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff91ddc0030200/0xf3fe2838e1fc224a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3fe2838e1fc2251 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130864.150893:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff8a5e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508754560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789130864.151003:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130864.151024:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddd85edf00 going to sleep for 11 seconds 00000100:00100000:3.0:1789130864.151103:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508754560 00000100:00100000:3.0:1789130864.151108:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508754560 00000100:00100000:3.0:1789130864.151256:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1789130864.151264:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddcf4fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+21:6497:x1876039508754560:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789130864.151368:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddcf4fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+21:6497:x1876039508754560:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 104us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130864.151375:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1789130864.153945:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff8a5e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508754560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789130864.154005:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc78152c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508754688:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789130864.154077:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130864.154978:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddff8bec00 going to sleep for 11 seconds 00000100:00100000:0.0:1789130864.155083:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508754688 00000100:00100000:0.0:1789130864.155091:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508754688 00000100:00100000:0.0:1789130864.155200:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1789130864.155210:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddcf7c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+21:6497:x1876039508754688:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789130864.155366:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddcf7c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+21:6497:x1876039508754688:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 158us (1289us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130864.155374:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1789130864.159250:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc78152c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508754688:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789130864.160155:0:10422:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7d9b0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:10422:1876039508754816:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789130864.160228:0:10422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130864.160272:0:10422:0:(client.c:2715:ptlrpc_set_wait()) set ffff91de01a87480 going to sleep for 11 seconds 00000100:00100000:1.0:1789130864.160387:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508754816 00000100:00100000:1.0:1789130864.160393:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508754816 00000100:00100000:1.0:1789130864.160434:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1789130864.160443:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddcf7c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+21:10422:x1876039508754816:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789130864.160691:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddcf7c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+21:10422:x1876039508754816:12345-0@lo:502:llog_process_th.0 Request processed in 248us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130864.160699:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1789130864.161239:0:10422:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7d9b0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:10422:1876039508754816:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789130864.161265:0:10422:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789130864.161275:0:10422:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789130864.161283:0:10422:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789130864.161289:0:10422:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff91ddff549800 00000020:00000080:3.0:1789130864.161292:0:10422:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789130864.161368:0:10422:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7d9b0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:10422:1876039508754944:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789130864.161408:0:10422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130864.161429:0:10422:0:(client.c:2715:ptlrpc_set_wait()) set ffff91de01a87480 going to sleep for 11 seconds 00000100:00100000:2.0:1789130864.163864:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508754944 00000100:00100000:2.0:1789130864.163876:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508754944 00000100:00100000:3.0:1789130864.165743:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1789130864.165757:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddcf7cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+21:10422:x1876039508754944:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789130864.165987:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddcf7cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+21:10422:x1876039508754944:12345-0@lo:502:llog_process_th.0 Request processed in 232us (4577us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130864.165995:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1789130864.166070:0:10422:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7d9b0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:10422:1876039508754944:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789130864.166101:0:10422:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789130864.166109:0:10422:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789130864.166111:0:10422:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1789130864.166115:0:10422:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1789130864.167230:0:6497:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1789130864.167255:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789130864.167265:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff91ddc0030200/0xf3fe2838e1fc224a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc2251 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130864.167277:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff91ddc0030200/0xf3fe2838e1fc224a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc2251 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789130864.167287:0:6497:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789130864.167289:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91ddff4f9000 from 4 10000000:01000000:2.0:1789130864.167292:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789130864.167324:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff91dcc7e36c00/0xf3fe2838e1fc2258 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130864.167333:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff91dcc7e36c00/0xf3fe2838e1fc2258 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130864.167350:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff91dcc7e36c00/0xf3fe2838e1fc2258 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130864.167371:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff8a52c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508755072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789130864.167415:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130864.167448:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddd85edf00 going to sleep for 11 seconds 00000100:00100000:2.0:1789130864.167478:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508755072 00000100:00100000:2.0:1789130864.167483:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508755072 00000100:00100000:2.0:1789130864.167516:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1789130864.167523:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8606050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+21:6497:x1876039508755072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789130864.167534:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130864.167544:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91dcc7e37000/0xf3fe2838e1fc225f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3fe2838e1fc2258 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130864.167564:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91dcc7e37000/0xf3fe2838e1fc225f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3fe2838e1fc2258 expref: 22 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130864.167574:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91dcc7e37000/0xf3fe2838e1fc225f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc2258 expref: 22 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130864.168201:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dcc7e37000, rc 0) 00000100:00100000:3.0:1789130864.168539:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8606050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+22:6497:x1876039508755072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1012us (1119us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130864.168548:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1789130864.169850:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff8a52c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508755072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789130864.169879:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff91dcc7e36c00/0xf3fe2838e1fc2258 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc225f expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130864.169890:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff91dcc7e36c00/0xf3fe2838e1fc2258 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3fe2838e1fc225f expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130864.169997:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff8a52c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508755200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789130864.170042:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130864.170080:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddd85edf00 going to sleep for 11 seconds 00000100:00100000:0.0:1789130864.172865:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508755200 00000100:00100000:0.0:1789130864.172878:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508755200 00000100:00100000:0.0:1789130864.172953:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1789130864.172963:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8604c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+22:6497:x1876039508755200:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789130864.173122:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8604c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+22:6497:x1876039508755200:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 156us (3075us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130864.173142:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1789130864.173196:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff8a52c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508755200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789130864.173245:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff8e3c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508755328:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789130864.173288:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130864.173315:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff91dcc7d68b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789130864.173333:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508755328 00000100:00100000:0.0:1789130864.173336:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508755328 00000100:00100000:0.0:1789130864.173359:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1789130864.173365:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8605050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+22:6497:x1876039508755328:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789130864.173437:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8605050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+22:6497:x1876039508755328:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 71us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130864.173443:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1789130864.173507:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff8e3c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508755328:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789130864.175808:0:10427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc78152c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:10427:1876039508755456:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789130864.175878:0:10427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130864.175935:0:10427:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddff8be480 going to sleep for 11 seconds 00000100:00100000:0.0:1789130864.176134:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508755456 00000100:00100000:0.0:1789130864.176141:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508755456 00000100:00100000:0.0:1789130864.176180:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1789130864.176189:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8607450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+22:10427:x1876039508755456:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789130864.176298:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8607450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+22:10427:x1876039508755456:12345-0@lo:502:llog_process_th.0 Request processed in 109us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130864.176306:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1789130864.176358:0:10427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc78152c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:10427:1876039508755456:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789130864.176386:0:10427:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789130864.176395:0:10427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789130864.176397:0:10427:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789130864.176404:0:10427:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff91ddff4f9000 00000020:00000080:0.0:1789130864.176406:0:10427:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789130864.177354:0:10427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff8e3c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:10427:1876039508755584:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789130864.177408:0:10427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130864.177445:0:10427:0:(client.c:2715:ptlrpc_set_wait()) set ffff91dcc7d68000 going to sleep for 11 seconds 00000100:00100000:0.0:1789130864.177494:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508755584 00000100:00100000:0.0:1789130864.177499:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508755584 00000100:00100000:0.0:1789130864.177545:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1789130864.177552:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8607850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+22:10427:x1876039508755584:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789130864.177700:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8607850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+22:10427:x1876039508755584:12345-0@lo:502:llog_process_th.0 Request processed in 148us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130864.177708:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1789130864.177756:0:10427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff8e3c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:10427:1876039508755584:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789130864.177778:0:10427:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789130864.177785:0:10427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789130864.177787:0:10427:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1789130864.177791:0:10427:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1789130864.177856:0:6497:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1789130864.177875:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789130864.177884:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff91dcc7e36c00/0xf3fe2838e1fc2258 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc225f expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130864.177979:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff91dcc7e36c00/0xf3fe2838e1fc2258 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc225f expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789130864.177992:0:6497:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789130864.177995:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91ddfce33000 from 4 10000000:01000000:0.0:1789130864.177998:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789130864.178022:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff91ddc0031a00/0xf3fe2838e1fc2266 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130864.178030:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff91ddc0031a00/0xf3fe2838e1fc2266 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130864.178038:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff91ddc0031a00/0xf3fe2838e1fc2266 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130864.178062:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff8e3c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508755712:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789130864.178091:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130864.178112:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff91dcc7d68000 going to sleep for 11 seconds 00000100:00100000:0.0:1789130864.178125:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508755712 00000100:00100000:0.0:1789130864.178128:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508755712 00000100:00100000:0.0:1789130864.178402:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1789130864.178409:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8606c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+22:6497:x1876039508755712:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789130864.178418:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130864.178430:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91ddc0031400/0xf3fe2838e1fc226d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3fe2838e1fc2266 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130864.178449:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91ddc0031400/0xf3fe2838e1fc226d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3fe2838e1fc2266 expref: 23 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130864.178476:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91ddc0031400/0xf3fe2838e1fc226d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc2266 expref: 23 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130864.178485:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ddc0031400, rc 0) 00000100:00100000:0.0:1789130864.178518:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8606c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+23:6497:x1876039508755712:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 109us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130864.178525:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1789130864.178558:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff8e3c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508755712:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789130864.178570:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff91ddc0031a00/0xf3fe2838e1fc2266 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc226d expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130864.178579:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff91ddc0031a00/0xf3fe2838e1fc2266 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3fe2838e1fc226d expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130864.178651:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff8e3c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508755840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789130864.178676:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130864.178700:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff91dcc7d68000 going to sleep for 11 seconds 00000100:00100000:0.0:1789130864.178712:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508755840 00000100:00100000:0.0:1789130864.178715:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508755840 00000100:00100000:0.0:1789130864.178738:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1789130864.178744:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8605450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+23:6497:x1876039508755840:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789130864.178828:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8605450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+23:6497:x1876039508755840:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 83us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130864.178835:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1789130864.178859:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff8e3c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508755840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789130864.178884:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff8e3c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508755968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789130864.179058:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130864.179072:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff91dcc7d68000 going to sleep for 11 seconds 00000100:00100000:0.0:1789130864.179083:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508755968 00000100:00100000:0.0:1789130864.179087:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508755968 00000100:00100000:0.0:1789130864.179107:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1789130864.179113:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8604450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+23:6497:x1876039508755968:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789130864.179254:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8604450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+23:6497:x1876039508755968:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 140us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130864.179261:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1789130864.179299:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff8e3c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508755968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789130864.181760:0:10428:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff8a43c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:10428:1876039508756096:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789130864.181828:0:10428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130864.181868:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508756096 00000100:00100000:2.0:1789130864.181873:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508756096 00000100:00100000:2.0:1789130864.181928:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1789130864.181938:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8607c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+23:10428:x1876039508756096:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789130864.182038:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8607c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+23:10428:x1876039508756096:12345-0@lo:502:llog_process_th.0 Request processed in 101us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130864.182046:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1789130864.182092:0:10428:0:(client.c:2715:ptlrpc_set_wait()) set ffff91dcc7c5a540 going to sleep for 11 seconds 00000100:00100000:2.0:1789130864.182112:0:10428:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff8a43c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:10428:1876039508756096:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789130864.182675:0:10428:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789130864.182686:0:10428:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789130864.182688:0:10428:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789130864.182695:0:10428:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff91ddfce33000 00000020:00000080:2.0:1789130864.182698:0:10428:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789130864.183104:0:10428:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff8a43c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:10428:1876039508756224:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789130864.183220:0:10428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130864.183241:0:10428:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddff7d7480 going to sleep for 11 seconds 00000100:00100000:0.0:1789130864.183788:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508756224 00000100:00100000:0.0:1789130864.183800:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508756224 00000100:00100000:0.0:1789130864.183840:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1789130864.183848:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8605850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+23:10428:x1876039508756224:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789130864.184218:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8605850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+23:10428:x1876039508756224:12345-0@lo:502:llog_process_th.0 Request processed in 370us (997us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130864.184226:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1789130864.184228:0:10428:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff8a43c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:10428:1876039508756224:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789130864.184251:0:10428:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789130864.184261:0:10428:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789130864.184263:0:10428:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1789130864.184267:0:10428:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1789130864.185063:0:6497:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1789130864.185090:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789130864.185100:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff91ddc0031a00/0xf3fe2838e1fc2266 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc226d expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130864.185112:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff91ddc0031a00/0xf3fe2838e1fc2266 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc226d expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789130864.185121:0:6497:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789130864.185124:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91dded7b6800 from 4 10000000:01000000:1.0:1789130864.185202:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789130864.185231:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff91dde19aa600/0xf3fe2838e1fc2274 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130864.185239:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff91dde19aa600/0xf3fe2838e1fc2274 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130864.185248:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff91dde19aa600/0xf3fe2838e1fc2274 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130864.185266:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc78143c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508756352:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789130864.185308:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130864.185688:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddff8be9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789130864.185748:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508756352 00000100:00100000:3.0:1789130864.185755:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508756352 00000100:00100000:3.0:1789130864.185792:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1789130864.185800:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8604850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+23:6497:x1876039508756352:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789130864.185810:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130864.185823:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91ddfd0b5e00/0xf3fe2838e1fc227b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3fe2838e1fc2274 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130864.185843:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91ddfd0b5e00/0xf3fe2838e1fc227b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3fe2838e1fc2274 expref: 24 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130864.185861:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91ddfd0b5e00/0xf3fe2838e1fc227b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc2274 expref: 24 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130864.185871:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ddfd0b5e00, rc 0) 00000100:00100000:3.0:1789130864.186223:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8604850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+24:6497:x1876039508756352:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 423us (913us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130864.186230:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1789130864.186305:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc78143c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508756352:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789130864.186319:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff91dde19aa600/0xf3fe2838e1fc2274 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc227b expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130864.186328:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff91dde19aa600/0xf3fe2838e1fc2274 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3fe2838e1fc227b expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130864.186384:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc78143c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508756480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789130864.186412:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130864.186434:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddff8be9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789130864.186711:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508756480 00000100:00100000:3.0:1789130864.186716:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508756480 00000100:00100000:3.0:1789130864.186748:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1789130864.186755:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8604050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+24:6497:x1876039508756480:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789130864.186854:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8604050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+24:6497:x1876039508756480:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 98us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130864.186861:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1789130864.187244:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc78143c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508756480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789130864.187276:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc78143c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508756608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789130864.187319:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130864.187345:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddff8be9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789130864.187386:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508756608 00000100:00100000:3.0:1789130864.187390:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508756608 00000100:00100000:3.0:1789130864.187413:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1789130864.187420:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8606850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+24:6497:x1876039508756608:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789130864.187520:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8606850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+24:6497:x1876039508756608:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 101us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130864.187527:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1789130864.187675:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc78143c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508756608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789130864.188424:0:10431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7d9b0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:10431:1876039508756736:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789130864.188490:0:10431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130864.188519:0:10431:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddcf7a5000 going to sleep for 11 seconds 00000100:00100000:1.0:1789130864.188691:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508756736 00000100:00100000:1.0:1789130864.188701:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508756736 00000100:00100000:1.0:1789130864.188737:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:1.0:1789130864.188743:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8606450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+24:10431:x1876039508756736:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789130864.188834:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8606450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+24:10431:x1876039508756736:12345-0@lo:502:llog_process_th.0 Request processed in 90us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130864.188841:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1789130864.189023:0:10431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7d9b0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:10431:1876039508756736:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789130864.189058:0:10431:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789130864.189066:0:10431:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789130864.189068:0:10431:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789130864.189075:0:10431:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff91dded7b6800 00000020:00000080:3.0:1789130864.189078:0:10431:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789130864.189221:0:10431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7d9b0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:10431:1876039508756864:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789130864.189257:0:10431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130864.189284:0:10431:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddd2f29d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789130864.189326:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508756864 00000100:00100000:1.0:1789130864.189330:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508756864 00000100:00100000:1.0:1789130864.189361:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:1.0:1789130864.189368:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8607050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+24:10431:x1876039508756864:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789130864.189432:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8607050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+24:10431:x1876039508756864:12345-0@lo:502:llog_process_th.0 Request processed in 64us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130864.189438:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1789130864.189657:0:10431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7d9b0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:10431:1876039508756864:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789130864.189675:0:10431:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789130864.189680:0:10431:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789130864.189681:0:10431:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1789130864.189685:0:10431:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1789130864.189809:0:6497:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1789130864.189831:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789130864.189840:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff91dde19aa600/0xf3fe2838e1fc2274 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc227b expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130864.189850:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff91dde19aa600/0xf3fe2838e1fc2274 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc227b expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130864.536102:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789130865.238008:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789130865.238034:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7815e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1876039508756992:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789130865.238129:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130865.238331:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508756992 00000100:00100000:1.0:1789130865.238340:0:8418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508756992 00000100:00100000:1.0:1789130865.238408:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789130865.238418:0:8418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7d99a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1876039508756992:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789130865.238446:0:8418:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789130865.238514:0:8418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7d99a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1876039508756992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130865.238533:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:3.0:1789130865.239039:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789130865.239088:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc7815e00 x1876039508756992/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789130881 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130865.239108:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7815e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1876039508756992:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789130865.239640:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7814f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508757376:0@lo:400:kworker.0 00000100:00100000:3.0:1789130865.239679:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130865.239702:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc78143c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3627:1876039508757888:0@lo:400:kworker.0 00000100:00100000:3.0:1789130865.239734:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130865.239750:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7892d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3627:1876039508758400:0@lo:400:kworker.0 00000100:00100000:3.0:1789130865.239769:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130865.239812:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1789130865.239818:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7817c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3627:1876039508757504:0@lo:400:kworker.0 00000100:00100000:3.0:1789130865.239851:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130865.239868:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc78152c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508758016:0@lo:400:kworker.0 00000100:00100000:3.0:1789130865.239888:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130865.239917:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01a5f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508758528:0@lo:400:kworker.0 00000100:00100000:3.0:1789130865.239938:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130865.239968:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508757376 00000100:00100000:3.0:1789130865.239973:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508757376 00000100:00100000:3.0:1789130865.240006:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789130865.240013:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7d98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508757376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130865.240052:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7d98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508757376:12345-0@lo:400:kworker.0 Request processed in 40us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130865.240060:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789130865.240076:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508757888 00000100:00100000:2.0:1789130865.240303:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7816580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3625:1876039508757120:0@lo:400:kworker.0 00000100:00100000:2.0:1789130865.240335:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130865.240358:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7815e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508757632:0@lo:400:kworker.0 00000100:00100000:2.0:1789130865.240377:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130865.240390:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7890f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508758144:0@lo:400:kworker.0 00000100:00100000:2.0:1789130865.240406:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130865.240419:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7d9a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508758656:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789130865.240435:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130865.240451:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1789130865.240471:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7815680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3625:1876039508757248:0@lo:400:kworker.0 00000100:00100000:2.0:1789130865.240491:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130865.240504:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7815a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3625:1876039508757760:0@lo:400:kworker.0 00000100:00100000:2.0:1789130865.240520:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130865.240528:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7891a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3625:1876039508758272:0@lo:400:kworker.0 00000100:00100000:2.0:1789130865.240543:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130865.240559:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508758656 00000100:00100000:2.0:1789130865.240563:0:8418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508758656 00000100:00100000:2.0:1789130865.240608:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789130865.240615:0:8418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff8a5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508758656:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789130865.240629:0:8418:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789130865.240666:0:8418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff8a5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508758656:12345-0@lo:13:osp-pre-1-1.0 Request processed in 52us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130865.240674:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:2.0:1789130865.240717:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc7d9a580 x1876039508758656/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789130881 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789130865.240735:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7d9a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508758656:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789130865.241904:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508758400 00000100:00100000:0.0:1789130865.241922:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508758400 00000100:00100000:0.0:1789130865.241958:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508757504 00000100:00100000:0.0:1789130865.241961:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508757504 00000100:00100000:0.0:1789130865.241970:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508757248 00000100:00100000:0.0:1789130865.241972:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508757248 00000100:00100000:0.0:1789130865.241980:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508757760 00000100:00100000:0.0:1789130865.241982:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508757760 00000100:00100000:0.0:1789130865.241991:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508758272 00000100:00100000:0.0:1789130865.241993:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508758272 00000100:00100000:0.0:1789130865.242006:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789130865.242014:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddca181680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3627:x1876039508758400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130865.242087:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddca181680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3627:x1876039508758400:12345-0@lo:400:kworker.0 Request processed in 74us (2317us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130865.242094:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789130865.242106:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789130865.242111:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7ffcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1876039508757504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130865.242144:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7ffcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1876039508757504:12345-0@lo:400:kworker.0 Request processed in 33us (2293us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130865.242149:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789130865.242169:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789130865.242174:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff8a70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1876039508757248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130865.242201:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff8a70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1876039508757248:12345-0@lo:400:kworker.0 Request processed in 27us (1709us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130865.242206:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789130865.242214:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789130865.242219:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff8a6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1876039508757760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130865.242238:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff8a6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1876039508757760:12345-0@lo:400:kworker.0 Request processed in 19us (1717us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130865.242252:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789130865.242261:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789130865.242267:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff8a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1876039508758272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130865.242289:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff8a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1876039508758272:12345-0@lo:400:kworker.0 Request processed in 23us (1745us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130865.242294:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789130865.242874:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508757888 00000100:00100000:3.0:1789130865.242922:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789130865.242929:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7d9ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1876039508757888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130865.242969:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7d9ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1876039508757888:12345-0@lo:400:kworker.0 Request processed in 41us (3245us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130865.242975:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789130865.243003:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508758016 00000100:00100000:3.0:1789130865.243006:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508758016 00000100:00100000:3.0:1789130865.243032:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508758528 00000100:00100000:3.0:1789130865.243034:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508758528 00000100:00100000:3.0:1789130865.243043:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508758144 00000100:00100000:3.0:1789130865.243045:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508758144 00000100:00100000:3.0:1789130865.243056:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789130865.243351:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7ffd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508758016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130865.243383:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7ffd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508758016:12345-0@lo:400:kworker.0 Request processed in 37us (3495us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130865.243389:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789130865.243400:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789130865.243405:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7ffcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508758528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130865.243425:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7ffcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508758528:12345-0@lo:400:kworker.0 Request processed in 19us (3486us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130865.243430:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789130865.243438:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789130865.243443:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff8a6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1876039508758144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130865.243482:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff8a6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1876039508758144:12345-0@lo:400:kworker.0 Request processed in 39us (3075us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130865.243488:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789130865.243507:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508757632 00000100:00100000:3.0:1789130865.243510:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508757632 00000100:00100000:3.0:1789130865.243527:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789130865.243532:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff8a43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1876039508757632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130865.243564:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff8a43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1876039508757632:12345-0@lo:400:kworker.0 Request processed in 32us (3186us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130865.243570:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789130865.243883:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508757120 00000100:00100000:3.0:1789130865.243888:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508757120 00000100:00100000:3.0:1789130865.243925:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1789130865.243932:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8605c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+24:3625:x1876039508757120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130865.243963:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8605c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+24:3625:x1876039508757120:12345-0@lo:400:kworker.0 Request processed in 32us (3627us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130865.243976:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00080000:3.0:1789130865.244008:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789130865.244013:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789130865.244015:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789130865.244017:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789130865.244049:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7817c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3627:1876039508757504:0@lo:400:kworker.0 00010000:00080000:3.0:1789130865.244074:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc78152c0 x1876039508758016/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789130881 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789130865.244285:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7815680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3625:1876039508757248:0@lo:400:kworker.0 00000100:00100000:2.0:1789130865.244297:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7815a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3625:1876039508757760:0@lo:400:kworker.0 00000100:00100000:2.0:1789130865.244309:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7891a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3625:1876039508758272:0@lo:400:kworker.0 00000100:00100000:2.0:1789130865.244316:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7816580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3625:1876039508757120:0@lo:400:kworker.0 00000100:00100000:2.0:1789130865.244325:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7815e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508757632:0@lo:400:kworker.0 00010000:00080000:2.0:1789130865.244334:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc7890f00 x1876039508758144/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789130881 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789130865.244344:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7890f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508758144:0@lo:400:kworker.0 00000100:00100000:3.0:1789130865.244539:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc78152c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508758016:0@lo:400:kworker.0 00010000:00080000:3.0:1789130865.244553:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91de01a5f0c0 x1876039508758528/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789130881 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130865.244560:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01a5f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508758528:0@lo:400:kworker.0 00000100:00100000:3.0:1789130865.244571:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7814f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508757376:0@lo:400:kworker.0 00010000:00080000:3.0:1789130865.244645:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc78143c0 x1876039508757888/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130881 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130865.244654:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc78143c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3627:1876039508757888:0@lo:400:kworker.0 00010000:00080000:3.0:1789130865.244665:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc7892d00 x1876039508758400/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130881 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130865.244672:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7892d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3627:1876039508758400:0@lo:400:kworker.0 00010000:00010000:1.0:1789130865.553932:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789130865.747530:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff8e3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508758784:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789130865.747592:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130865.751145:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508758784 00000100:00100000:1.0:1789130865.751158:0:8418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508758784 00000100:00100000:1.0:1789130865.751215:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789130865.751226:0:8418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff8e2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508758784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789130865.751258:0:8418:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789130865.751352:0:8418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff8e2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508758784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 127us (3758us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130865.751360:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:1.0:1789130865.751412:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91ddff8e3c00 x1876039508758784/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789130881 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789130865.751429:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff8e3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508758784:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789130866.258341:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789130866.258365:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01a5da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1876039508758912:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789130866.258436:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130866.258845:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508758912 00000100:00100000:1.0:1789130866.258853:0:8418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508758912 00000100:00100000:1.0:1789130866.258911:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789130866.258920:0:8418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff8e3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1876039508758912:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789130866.258942:0:8418:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789130866.258997:0:8418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff8e3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1876039508758912:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (561us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130866.259004:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:0.0:1789130866.259085:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91de01a5da40 x1876039508758912/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789130882 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789130866.259103:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01a5da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1876039508758912:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1789130866.577701:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789130867.057832:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789130867.057858:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498210432 00000100:00100000:1.0:1789130867.057868:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789130867.057869:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498210432 00000100:00100000:1.0:1789130867.057920:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789130867.057943:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 275 00000100:00100000:1.0:1789130867.057953:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789130867.057968:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8603850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+10:2386:x1876039498210432:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1789130867.057991:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789130867.058034:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8603850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+10:2386:x1876039498210432:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 70us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130867.058044:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 275 00000100:00100000:0.0:1789130867.058055:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498210560 00000100:00100000:0.0:1789130867.058061:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498210560 00000100:00100000:3.0:1789130867.058101:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498210816 00000100:00100000:3.0:1789130867.058112:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498210816 00000100:00100000:0.0:1789130867.058127:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498210688 00000100:00100000:0.0:1789130867.058132:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498210688 00000100:00100000:3.0:1789130867.058145:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498210944 00000100:00100000:3.0:1789130867.058150:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498210944 00000100:00100000:0.0:1789130867.058167:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 71 00000100:00100000:0.0:1789130867.058179:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01a5e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+6:2385:x1876039498210560:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1789130867.058183:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 25 00000100:00100000:3.0:1789130867.058195:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01a5f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+5:2385:x1876039498210816:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1789130867.070294:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 72 00000100:00100000:1.0:1789130867.070316:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01a5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+5:2386:x1876039498210688:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1789130867.070389:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01a5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+5:2386:x1876039498210688:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 82us (12469us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130867.070397:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 72 00000100:00080000:1.0:1789130867.070426:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789130867.070432:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789130867.070434:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789130867.070437:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789130867.070500:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 26 00000100:00100000:1.0:1789130867.070509:0:9827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01a5e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+5:2386:x1876039498210944:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1789130867.070537:0:9827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01a5e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+5:2386:x1876039498210944:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 30us (12546us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130867.070543:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 26 00000100:00100000:0.0:1789130867.072678:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01a5e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+6:2385:x1876039498210560:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 14493us (14801us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130867.072690:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 71 00000100:00100000:3.0:1789130867.075825:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01a5f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+5:2385:x1876039498210816:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 17619us (17861us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130867.075839:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 25 00010000:00010000:0.0:1789130867.607883:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789130868.305935:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff8e2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1876039508759040:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789130868.306007:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130868.306133:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508759040 00000100:00100000:0.0:1789130868.306141:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508759040 00000100:00100000:0.0:1789130868.306191:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789130868.306201:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01a5d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3628:x1876039508759040:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789130868.306248:0:6506:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789130868.306299:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01a5d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3628:x1876039508759040:12345-0@lo:41:osp-pre-1-0.0 Request processed in 99us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130868.306307:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789130868.306350:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff8e2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1876039508759040:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789130868.306863:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff8e2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508759168:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789130868.306908:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130868.306979:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508759168 00000100:00100000:2.0:1789130868.306986:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508759168 00000100:00100000:2.0:1789130868.307014:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789130868.307020:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01a5ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508759168:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789130868.307037:0:6506:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789130868.321119:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01a5ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508759168:12345-0@lo:41:osp-pre-0-1.0 Request processed in 14088us (14199us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130868.321134:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789130868.329530:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff8e2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508759168:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789130868.625768:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130869.651092:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789130870.353722:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7ffde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508759296:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789130870.353800:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130870.353884:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508759296 00000100:00100000:3.0:1789130870.353891:0:8418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508759296 00000100:00100000:3.0:1789130870.353945:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789130870.353954:0:8418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7fff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508759296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789130870.353981:0:8418:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789130870.354036:0:8418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7fff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508759296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130870.354044:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:3.0:1789130870.354064:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789130870.354094:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc7ffde00 x1876039508759296/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789130886 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130870.354122:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7ffde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508759296:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789130870.354627:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789130870.354637:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7ffde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1876039508759424:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789130870.354669:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130870.354698:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508759424 00000100:00100000:3.0:1789130870.354701:0:8418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508759424 00000100:00100000:3.0:1789130870.354729:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789130870.354736:0:8418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7ffd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1876039508759424:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789130870.354758:0:8418:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789130870.354788:0:8418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7ffd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1876039508759424:12345-0@lo:13:osp-pre-1-1.0 Request processed in 52us (119us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130870.354796:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:3.0:1789130870.354811:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789130870.354827:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc7ffde00 x1876039508759424/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789130886 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130870.354840:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7ffde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1876039508759424:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789130870.362349:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7ffc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3625:1876039508759680:0@lo:400:kworker.0 00000100:00100000:3.0:1789130870.362427:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130870.362477:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7ffe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3625:1876039508760192:0@lo:400:kworker.0 00000100:00100000:3.0:1789130870.362512:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130870.362541:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7fffc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3625:1876039508760704:0@lo:400:kworker.0 00000100:00100000:3.0:1789130870.362562:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130870.362589:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1789130870.362595:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7ffe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508759808:0@lo:400:kworker.0 00000100:00100000:2.0:1789130870.363348:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7ffda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3627:1876039508759936:0@lo:400:kworker.0 00000100:00100000:2.0:1789130870.363388:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130870.363415:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7ffc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508760448:0@lo:400:kworker.0 00000100:00100000:2.0:1789130870.363451:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130870.363499:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1789130870.363507:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7ffde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3627:1876039508759552:0@lo:400:kworker.0 00000100:00100000:2.0:1789130870.363535:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130870.363556:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7fff0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1876039508760064:0@lo:400:kworker.0 00000100:00100000:2.0:1789130870.363578:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130870.363595:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7ffed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1876039508760576:0@lo:400:kworker.0 00000100:00100000:2.0:1789130870.363613:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130870.363643:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508759680 00000100:00100000:2.0:1789130870.363649:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508759680 00000100:00100000:2.0:1789130870.363687:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508760192 00000100:00100000:2.0:1789130870.363691:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508760192 00000100:00100000:2.0:1789130870.363713:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508760704 00000100:00100000:2.0:1789130870.363716:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508760704 00000100:00100000:2.0:1789130870.363727:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508759936 00000100:00100000:2.0:1789130870.363729:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508759936 00000100:00100000:2.0:1789130870.363743:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789130870.363765:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc843da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1876039508759680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130870.363809:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc843da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1876039508759680:12345-0@lo:400:kworker.0 Request processed in 58us (1382us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130870.363817:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789130870.363833:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789130870.363839:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc843f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1876039508760192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130870.363867:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc843f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1876039508760192:12345-0@lo:400:kworker.0 Request processed in 28us (1354us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130870.363881:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789130870.363893:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789130870.363906:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc843e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1876039508760704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130870.363936:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc843e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1876039508760704:12345-0@lo:400:kworker.0 Request processed in 32us (1373us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130870.363943:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789130870.363954:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789130870.363959:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff8a4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1876039508759936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130870.364121:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff8a4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1876039508759936:12345-0@lo:400:kworker.0 Request processed in 161us (732us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130870.364128:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789130870.364147:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508760448 00000100:00100000:2.0:1789130870.364151:0:9827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508760448 00000100:00100000:2.0:1789130870.364176:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508760576 00000100:00100000:2.0:1789130870.364179:0:9827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508760576 00000100:00100000:2.0:1789130870.364197:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789130870.364203:0:9827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff8a6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508760448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130870.364235:0:9827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff8a6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508760448:12345-0@lo:400:kworker.0 Request processed in 31us (783us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130870.364241:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789130870.364251:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789130870.364256:0:9827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff8a61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3627:x1876039508760576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130870.364280:0:9827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff8a61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3627:x1876039508760576:12345-0@lo:400:kworker.0 Request processed in 24us (666us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130870.364285:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789130870.364302:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508760064 00000100:00100000:2.0:1789130870.364306:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508760064 00000100:00100000:2.0:1789130870.364328:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789130870.364334:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff8a7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1876039508760064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130870.364370:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff8a7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1876039508760064:12345-0@lo:400:kworker.0 Request processed in 36us (791us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130870.364377:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789130870.364417:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7fff0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1876039508760064:0@lo:400:kworker.0 00010000:00080000:2.0:1789130870.364429:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc7ffed00 x1876039508760576/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789130886 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789130870.364440:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7ffed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1876039508760576:0@lo:400:kworker.0 00000100:00100000:2.0:1789130870.364449:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7ffda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3627:1876039508759936:0@lo:400:kworker.0 00010000:00080000:2.0:1789130870.364478:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc7ffc780 x1876039508760448/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789130886 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789130870.364487:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7ffc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508760448:0@lo:400:kworker.0 00000100:00100000:2.0:1789130870.364554:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508759552 00000100:00100000:2.0:1789130870.364557:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508759552 00000100:00100000:2.0:1789130870.364583:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1789130870.364589:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8602c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+24:3627:x1876039508759552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130870.364622:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8602c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+24:3627:x1876039508759552:12345-0@lo:400:kworker.0 Request processed in 33us (1086us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130870.364628:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00080000:2.0:1789130870.364652:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789130870.364657:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789130870.364671:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7ffde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3627:1876039508759552:0@lo:400:kworker.0 00000100:00100000:3.0:1789130870.365699:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130870.365729:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7ffc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3625:1876039508760320:0@lo:400:kworker.0 00000100:00100000:3.0:1789130870.365828:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130870.365848:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7ffe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3625:1876039508760832:0@lo:400:kworker.0 00000100:00100000:3.0:1789130870.365879:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130870.365909:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7ffc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3625:1876039508759680:0@lo:400:kworker.0 00000100:00100000:3.0:1789130870.365920:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7ffe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3625:1876039508760192:0@lo:400:kworker.0 00000100:00100000:3.0:1789130870.365930:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7fffc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3625:1876039508760704:0@lo:400:kworker.0 00000100:00100000:3.0:1789130870.365960:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508760320 00000100:00100000:3.0:1789130870.365964:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508760320 00000100:00100000:3.0:1789130870.370248:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508760832 00000100:00100000:3.0:1789130870.370261:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508760832 00000100:00100000:3.0:1789130870.370295:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789130870.370304:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc843c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1876039508760320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130870.370388:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc843c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1876039508760320:12345-0@lo:400:kworker.0 Request processed in 86us (4560us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130870.370396:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789130870.370411:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789130870.370417:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc843ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1876039508760832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130870.370444:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc843ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1876039508760832:12345-0@lo:400:kworker.0 Request processed in 27us (4573us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130870.370450:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:3.0:1789130870.371151:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789130870.371168:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508759808 00000100:00100000:3.0:1789130870.371174:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508759808 00000100:00100000:3.0:1789130870.371226:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789130870.371233:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc843c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508759808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130870.371276:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc843c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508759808:12345-0@lo:400:kworker.0 Request processed in 44us (5577us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130870.371282:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789130870.371326:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7ffe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508759808:0@lo:400:kworker.0 00010000:00080000:3.0:1789130870.371339:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc7ffc000 x1876039508760320/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130886 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130870.371350:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7ffc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3625:1876039508760320:0@lo:400:kworker.0 00010000:00080000:3.0:1789130870.371360:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc7ffe1c0 x1876039508760832/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130886 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130870.371368:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7ffe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3625:1876039508760832:0@lo:400:kworker.0 00010000:00010000:0.0:1789130870.691894:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789130870.869321:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789130870.869344:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff8e30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1876039508760960:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789130870.869407:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130870.869500:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508760960 00000100:00100000:0.0:1789130870.869508:0:8418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508760960 00000100:00100000:0.0:1789130870.869552:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789130870.869561:0:8418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff8e0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1876039508760960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789130870.869588:0:8418:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789130870.869630:0:8418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff8e0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1876039508760960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130870.869645:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:0.0:1789130870.869686:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91ddff8e30c0 x1876039508760960/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789130886 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789130870.869704:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff8e30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1876039508760960:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789130871.388530:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01a5cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1876039508761088:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789130871.388607:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130871.388721:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508761088 00000100:00100000:2.0:1789130871.388730:0:8418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508761088 00000100:00100000:2.0:1789130871.388774:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789130871.388784:0:8418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff8a52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1876039508761088:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789130871.391331:0:8418:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789130871.391421:0:8418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff8a52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1876039508761088:12345-0@lo:13:osp-pre-0-1.0 Request processed in 2636us (2811us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130871.391431:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:2.0:1789130871.391515:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91de01a5cb40 x1876039508761088/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789130887 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789130871.391534:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01a5cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1876039508761088:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1789130871.704554:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789130872.162299:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789130872.162342:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789130872.162377:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789130872.162398:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789130872.162434:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789130872.162474:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498211584 00000100:00100000:2.0:1789130872.162483:0:9827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498211584 00000100:00100000:2.0:1789130872.162535:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498211456 00000100:00100000:2.0:1789130872.162538:0:9827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498211456 00000100:00100000:2.0:1789130872.162572:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 29 00000100:00100000:2.0:1789130872.162582:0:9827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff8a5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+5:2388:x1876039498211584:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1789130872.162646:0:9827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff8a5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+5:2388:x1876039498211584:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 66us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130872.162654:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 29 00000100:00100000:2.0:1789130872.162670:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 30 00000100:00100000:2.0:1789130872.162688:0:9827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff8a4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+5:2387:x1876039498211456:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1789130872.162714:0:9827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff8a4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+5:2387:x1876039498211456:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 28us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130872.162720:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 30 00000100:00100000:2.0:1789130872.162738:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498211328 00000100:00100000:2.0:1789130872.162741:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498211328 00000100:00100000:2.0:1789130872.162767:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498211200 00000100:00100000:2.0:1789130872.162770:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498211200 00000100:00100000:2.0:1789130872.162790:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 79 00000100:00100000:2.0:1789130872.162796:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff8a5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+5:2388:x1876039498211328:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1789130872.162823:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff8a5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+5:2388:x1876039498211328:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 28us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130872.162830:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 79 00000100:00100000:1.0:1789130872.163171:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 80 00000100:00100000:1.0:1789130872.163182:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff8a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+6:2387:x1876039498211200:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1789130872.163400:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff8a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+6:2387:x1876039498211200:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 220us (1001us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130872.163408:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 80 00000100:00080000:2.0:1789130872.163652:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789130872.163657:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789130872.163660:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789130872.163662:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789130872.164262:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498211072 00000100:00100000:0.0:1789130872.164271:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498211072 00000100:00100000:0.0:1789130872.164321:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 277 00000100:00100000:0.0:1789130872.164330:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8601450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+10:2388:x1876039498211072:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1789130872.164386:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8601450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+10:2388:x1876039498211072:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 57us (2095us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130872.164393:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 277 00000001:02000400:1.0:1789130872.271001:0:10677:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg311-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:0.0:1789130872.735449:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789130873.425793:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff8e21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508761216:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789130873.425873:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130873.426116:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789130873.426124:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc843e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508761344:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789130873.426150:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130873.426208:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508761216 00000100:00100000:1.0:1789130873.426216:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508761216 00000100:00100000:1.0:1789130873.426249:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508761344 00000100:00100000:1.0:1789130873.426252:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508761344 00000100:00100000:1.0:1789130873.426280:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789130873.426289:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc843fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1876039508761216:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789130873.426321:0:6506:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789130873.426371:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc843fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1876039508761216:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130873.426378:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789130873.426394:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789130873.426400:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc843cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508761344:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789130873.426416:0:6506:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789130873.426445:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc843cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508761344:12345-0@lo:41:osp-pre-0-1.0 Request processed in 45us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130873.426451:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789130873.427425:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc843e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508761344:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789130873.427445:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff8e21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508761216:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789130873.750261:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130874.775420:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789130875.475886:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc843e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3627:1876039508761472:0@lo:400:kworker.0 00000100:00100000:3.0:1789130875.475985:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130875.476041:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc843de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1876039508761984:0@lo:400:kworker.0 00000100:00100000:3.0:1789130875.476079:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130875.476104:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc843e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1876039508762496:0@lo:400:kworker.0 00000100:00100000:3.0:1789130875.476126:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130875.476142:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8414f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1876039508763008:0@lo:400:kworker.0 00000100:00100000:3.0:1789130875.476161:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130875.476188:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1789130875.476193:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc843d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3627:1876039508761600:0@lo:400:kworker.0 00000100:00100000:3.0:1789130875.476215:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130875.476228:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc843f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3627:1876039508762112:0@lo:400:kworker.0 00000100:00100000:3.0:1789130875.476246:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130875.476261:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8416d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3627:1876039508762624:0@lo:400:kworker.0 00000100:00100000:3.0:1789130875.476278:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130875.476306:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc843cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508761728:0@lo:400:kworker.0 00000100:00100000:3.0:1789130875.476329:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130875.476344:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc843d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3625:1876039508762240:0@lo:400:kworker.0 00000100:00100000:3.0:1789130875.476361:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130875.476374:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8417c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3625:1876039508762752:0@lo:400:kworker.0 00000100:00100000:3.0:1789130875.476390:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130875.476399:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1789130875.476404:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc843f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3625:1876039508761856:0@lo:400:kworker.0 00000100:00100000:3.0:1789130875.476422:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130875.476432:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc843c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508762368:0@lo:400:kworker.0 00000100:00100000:3.0:1789130875.476478:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130875.476497:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc84161c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508762880:0@lo:400:kworker.0 00000100:00100000:3.0:1789130875.476520:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130875.476556:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508761472 00000100:00100000:3.0:1789130875.476564:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508761472 00000100:00100000:3.0:1789130875.476615:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1789130875.476624:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8600450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+24:3627:x1876039508761472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130875.476673:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8600450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+24:3627:x1876039508761472:12345-0@lo:400:kworker.0 Request processed in 50us (690us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130875.476681:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1789130875.476714:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508762496 00000100:00100000:3.0:1789130875.476717:0:9827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508762496 00000100:00100000:3.0:1789130875.476747:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508763008 00000100:00100000:3.0:1789130875.476749:0:9827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508763008 00000100:00100000:3.0:1789130875.476761:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508762368 00000100:00100000:3.0:1789130875.476763:0:9827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508762368 00000100:00100000:3.0:1789130875.476774:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508762880 00000100:00100000:3.0:1789130875.476776:0:9827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508762880 00000100:00100000:3.0:1789130875.476788:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789130875.476794:0:9827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8414b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3627:x1876039508762496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130875.476823:0:9827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8414b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3627:x1876039508762496:12345-0@lo:400:kworker.0 Request processed in 30us (696us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130875.476830:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789130875.476855:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789130875.476861:0:9827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8417840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3627:x1876039508763008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130875.476886:0:9827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8417840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3627:x1876039508763008:12345-0@lo:400:kworker.0 Request processed in 26us (724us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130875.476892:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789130875.476901:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789130875.476906:0:9827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8416940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508762368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130875.476932:0:9827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8416940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508762368:12345-0@lo:400:kworker.0 Request processed in 26us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130875.476943:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789130875.476953:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789130875.476958:0:9827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddffc0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508762880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130875.476981:0:9827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddffc0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508762880:12345-0@lo:400:kworker.0 Request processed in 23us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130875.476986:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789130875.477151:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508761600 00000100:00100000:3.0:1789130875.477154:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508761600 00000100:00100000:3.0:1789130875.477172:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508762112 00000100:00100000:3.0:1789130875.477174:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508762112 00000100:00100000:3.0:1789130875.477185:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508762624 00000100:00100000:3.0:1789130875.477188:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508762624 00000100:00100000:3.0:1789130875.477196:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508762240 00000100:00100000:3.0:1789130875.477199:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508762240 00000100:00100000:3.0:1789130875.477208:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508762752 00000100:00100000:3.0:1789130875.477211:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508762752 00000100:00100000:3.0:1789130875.477220:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508761856 00000100:00100000:3.0:1789130875.477222:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508761856 00000100:00100000:3.0:1789130875.477234:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789130875.477240:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8415e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1876039508761600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130875.477268:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8415e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1876039508761600:12345-0@lo:400:kworker.0 Request processed in 29us (1052us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130875.477275:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789130875.477285:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789130875.477290:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8417480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1876039508762112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130875.477310:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8417480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1876039508762112:12345-0@lo:400:kworker.0 Request processed in 21us (1064us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130875.477317:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789130875.477332:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789130875.477338:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc84152c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3627:x1876039508762624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130875.477360:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc84152c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3627:x1876039508762624:12345-0@lo:400:kworker.0 Request processed in 23us (1081us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130875.477365:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789130875.477375:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789130875.477379:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8416580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1876039508762240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130875.477400:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8416580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1876039508762240:12345-0@lo:400:kworker.0 Request processed in 21us (1038us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130875.477405:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789130875.477414:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789130875.477419:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8415a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1876039508762752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130875.477440:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8415a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1876039508762752:12345-0@lo:400:kworker.0 Request processed in 21us (1049us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130875.477446:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789130875.477455:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789130875.477482:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc84170c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1876039508761856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130875.477506:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc84170c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1876039508761856:12345-0@lo:400:kworker.0 Request processed in 25us (1083us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130875.477511:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789130875.477532:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508761984 00000100:00100000:3.0:1789130875.477535:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508761984 00000100:00100000:3.0:1789130875.477551:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508761728 00000100:00100000:3.0:1789130875.477553:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508761728 00000100:00100000:3.0:1789130875.477564:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789130875.477570:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8415680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1876039508761984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130875.477608:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8415680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1876039508761984:12345-0@lo:400:kworker.0 Request processed in 38us (1528us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130875.477614:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789130875.477623:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789130875.477629:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc84143c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508761728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130875.477650:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc84143c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508761728:12345-0@lo:400:kworker.0 Request processed in 21us (1321us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130875.477655:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:3.0:1789130875.477686:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789130875.477690:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789130875.477693:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789130875.477695:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789130875.477725:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc843f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3625:1876039508761856:0@lo:400:kworker.0 00010000:00080000:3.0:1789130875.477739:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc843c3c0 x1876039508762368/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789130891 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130875.477751:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc843c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508762368:0@lo:400:kworker.0 00010000:00080000:3.0:1789130875.477760:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc84161c0 x1876039508762880/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789130891 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130875.477769:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc84161c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508762880:0@lo:400:kworker.0 00000100:00100000:3.0:1789130875.477776:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc843cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508761728:0@lo:400:kworker.0 00010000:00080000:3.0:1789130875.477784:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc843d2c0 x1876039508762240/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130891 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130875.477792:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc843d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3625:1876039508762240:0@lo:400:kworker.0 00010000:00080000:3.0:1789130875.477800:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc8417c00 x1876039508762752/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130891 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130875.477814:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8417c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3625:1876039508762752:0@lo:400:kworker.0 00000100:00100000:3.0:1789130875.477864:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc843d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3627:1876039508761600:0@lo:400:kworker.0 00000100:00100000:3.0:1789130875.477873:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc843f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3627:1876039508762112:0@lo:400:kworker.0 00000100:00100000:3.0:1789130875.477881:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8416d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3627:1876039508762624:0@lo:400:kworker.0 00000100:00100000:3.0:1789130875.477890:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc843e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3627:1876039508761472:0@lo:400:kworker.0 00000100:00100000:3.0:1789130875.477900:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc843de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1876039508761984:0@lo:400:kworker.0 00010000:00080000:3.0:1789130875.477909:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc843e580 x1876039508762496/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789130891 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130875.477918:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc843e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1876039508762496:0@lo:400:kworker.0 00010000:00080000:3.0:1789130875.477927:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc8414f00 x1876039508763008/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789130891 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130875.477935:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8414f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1876039508763008:0@lo:400:kworker.0 00000100:00100000:1.0:1789130875.479056:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789130875.479072:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01a5e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1876039508763136:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789130875.479130:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130875.479180:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508763136 00000100:00100000:1.0:1789130875.479186:0:8418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508763136 00000100:00100000:1.0:1789130875.479228:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789130875.479235:0:8418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01a5c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1876039508763136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789130875.479265:0:8418:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789130875.479305:0:8418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01a5c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1876039508763136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130875.479329:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:1.0:1789130875.479369:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91de01a5e940 x1876039508763136/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789130891 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789130875.479385:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01a5e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1876039508763136:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789130875.479703:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789130875.479713:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff8e0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1876039508763264:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789130875.479738:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130875.479963:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508763264 00000100:00100000:0.0:1789130875.479968:0:8418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508763264 00000100:00100000:0.0:1789130875.479999:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789130875.480006:0:8418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01a5e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1876039508763264:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789130875.480016:0:8418:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789130875.480062:0:8418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01a5e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1876039508763264:12345-0@lo:13:osp-pre-1-1.0 Request processed in 56us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130875.480067:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:1.0:1789130875.484989:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91ddff8e0f00 x1876039508763264/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789130891 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789130875.485025:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff8e0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1876039508763264:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1789130875.793629:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789130875.987404:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789130875.987434:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff8e0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508763392:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789130875.987538:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130875.987719:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508763392 00000100:00100000:0.0:1789130875.987729:0:8418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508763392 00000100:00100000:0.0:1789130875.987792:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789130875.987803:0:8418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8414f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1876039508763392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789130875.987857:0:8418:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789130875.987914:0:8418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8414f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1876039508763392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130875.987923:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:3.0:1789130875.988475:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91ddff8e0f00 x1876039508763392/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789130891 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130875.988497:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff8e0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508763392:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789130876.512379:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789130876.512424:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01a5cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1876039508763520:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789130876.512857:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130876.513042:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508763520 00000100:00100000:1.0:1789130876.513051:0:8418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508763520 00000100:00100000:1.0:1789130876.513107:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789130876.513117:0:8418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01a5c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1876039508763520:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789130876.513144:0:8418:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789130876.513194:0:8418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01a5c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1876039508763520:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130876.513202:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:1.0:1789130876.513341:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91de01a5cf00 x1876039508763520/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789130892 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789130876.513360:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01a5cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1876039508763520:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1789130876.821839:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789130877.293949:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789130877.294002:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789130877.294044:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789130877.294278:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498211712 00000100:00100000:3.0:1789130877.294290:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498211712 00000100:00100000:3.0:1789130877.294370:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 279 00000100:00100000:3.0:1789130877.294382:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8603c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+10:2385:x1876039498211712:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1789130877.294494:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8603c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+10:2385:x1876039498211712:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 115us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130877.294503:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 279 00000100:00100000:3.0:1789130877.294547:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498211968 00000100:00100000:3.0:1789130877.294551:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498211968 00000100:00100000:3.0:1789130877.294592:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498211840 00000100:00100000:3.0:1789130877.294595:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498211840 00000100:00100000:3.0:1789130877.294618:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 87 00000100:00100000:3.0:1789130877.294639:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff8e0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+5:2385:x1876039498211968:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1789130877.294674:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff8e0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+5:2385:x1876039498211968:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 49us (671us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130877.294680:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 87 00000100:00100000:3.0:1789130877.294694:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 88 00000100:00100000:3.0:1789130877.294700:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff8e3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+6:2385:x1876039498211840:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1789130877.294724:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff8e3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+6:2385:x1876039498211840:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 25us (680us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130877.294730:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 88 00000100:00080000:3.0:1789130877.295256:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789130877.295262:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789130877.299941:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789130877.299993:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789130877.300032:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498212096 00000100:00100000:3.0:1789130877.300115:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498212096 00000100:00100000:3.0:1789130877.300186:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498212224 00000100:00100000:3.0:1789130877.300201:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498212224 00000100:00100000:3.0:1789130877.300229:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 18 00000100:00100000:3.0:1789130877.300241:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8416d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+5:2384:x1876039498212096:12345-192.168.203.11@tcp:9:kworker.0 00000020:00000080:3.0:1789130877.300289:0:8414:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf3fe2838e1fc218d 00000100:00080000:3.0:1789130877.300300:0:8414:0:(import.c:65:import_set_state_nolock()) ffff91dcc7e70000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789130877.300354:0:8414:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:0.0:1789130877.300777:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 19 00000100:00100000:0.0:1789130877.300788:0:9827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8417c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+5:2384:x1876039498212224:12345-192.168.203.11@tcp:9:kworker.0 00000020:00000080:0.0:1789130877.300810:0:9827:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf3fe2838e1fc2194 00000100:00080000:0.0:1789130877.300817:0:9827:0:(import.c:65:import_set_state_nolock()) ffff91dcc1ee6800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789130877.300865:0:9827:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:0.0:1789130877.300984:0:9827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8417c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+2:2384:x1876039498212224:12345-192.168.203.11@tcp:9:kworker.0 Request processed in 198us (990us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130877.300993:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 19 00010000:00010000:0.0:1789130877.301174:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789130877.302427:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8416d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+2:2384:x1876039498212096:12345-192.168.203.11@tcp:9:kworker.0 Request processed in 2178us (2492us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130877.302438:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 18 00010000:00010000:3.0:1789130877.303119:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789130877.303172:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789130877.303177:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789130877.842285:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789130878.554830:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789130878.554860:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01a5cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1876039508763776:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789130878.554951:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130878.555051:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508763776 00000100:00100000:1.0:1789130878.555070:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508763776 00000100:00100000:1.0:1789130878.555137:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789130878.555148:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01a5de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1876039508763776:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789130878.555191:0:6505:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789130878.555246:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01a5de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1876039508763776:12345-0@lo:41:osp-pre-0-1.0 Request processed in 99us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130878.555254:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789130878.555307:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01a5cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1876039508763776:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789130878.555553:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc84161c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1876039508763648:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789130878.555592:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130878.565966:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508763648 00000100:00100000:1.0:1789130878.565986:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508763648 00000100:00100000:1.0:1789130878.566078:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789130878.566097:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff8a6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3628:x1876039508763648:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789130878.566143:0:6505:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789130878.566255:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff8a6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3628:x1876039508763648:12345-0@lo:41:osp-pre-1-0.0 Request processed in 160us (10661us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130878.566263:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789130878.566348:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc84161c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1876039508763648:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789130878.867316:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130879.895146:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789130880.168391:0:10922:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg311-server.virtnet: executing yml_node 00000100:00100000:3.0:1789130880.595279:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8414000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3625:1876039508764288:0@lo:400:kworker.0 00000100:00100000:3.0:1789130880.595349:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130880.595398:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc843de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508764800:0@lo:400:kworker.0 00000100:00100000:3.0:1789130880.595423:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130880.595443:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc843d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508765312:0@lo:400:kworker.0 00000100:00100000:3.0:1789130880.595476:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130880.595502:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:3.0:1789130880.595507:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8414b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3625:1876039508763904:0@lo:400:kworker.0 00000100:00100000:3.0:1789130880.595532:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130880.595549:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8414780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508764416:0@lo:400:kworker.0 00000100:00100000:3.0:1789130880.595570:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130880.595587:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc843e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508764928:0@lo:400:kworker.0 00000100:00100000:3.0:1789130880.595607:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130880.595637:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc843cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508765440:0@lo:400:kworker.0 00000100:00100000:3.0:1789130880.595661:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130880.595685:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8417840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3627:1876039508764032:0@lo:400:kworker.0 00000100:00100000:3.0:1789130880.595714:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130880.595730:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc84161c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3627:1876039508764544:0@lo:400:kworker.0 00000100:00100000:3.0:1789130880.595749:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130880.596082:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc843f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3627:1876039508765056:0@lo:400:kworker.0 00000100:00100000:3.0:1789130880.596106:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130880.596125:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1789130880.596131:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8416940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508764160:0@lo:400:kworker.0 00000100:00100000:3.0:1789130880.596154:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130880.596172:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc843e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3627:1876039508764672:0@lo:400:kworker.0 00000100:00100000:3.0:1789130880.596205:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130880.596216:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc843d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3627:1876039508765184:0@lo:400:kworker.0 00000100:00100000:3.0:1789130880.596235:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130880.596257:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508764288 00000100:00100000:3.0:1789130880.596324:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508764288 00000100:00100000:3.0:1789130880.596363:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508764032 00000100:00100000:3.0:1789130880.596366:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508764032 00000100:00100000:3.0:1789130880.596378:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508764544 00000100:00100000:3.0:1789130880.596381:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508764544 00000100:00100000:3.0:1789130880.596401:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508765056 00000100:00100000:3.0:1789130880.596404:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508765056 00000100:00100000:3.0:1789130880.596415:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508764672 00000100:00100000:3.0:1789130880.596417:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508764672 00000100:00100000:3.0:1789130880.596428:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508765184 00000100:00100000:3.0:1789130880.596430:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508765184 00000100:00100000:3.0:1789130880.596445:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789130880.596481:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc843c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1876039508764288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130880.596533:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc843c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1876039508764288:12345-0@lo:400:kworker.0 Request processed in 54us (1184us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130880.596541:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789130880.596559:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789130880.596564:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7b25680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1876039508764032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130880.596595:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7b25680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1876039508764032:12345-0@lo:400:kworker.0 Request processed in 31us (881us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130880.596601:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789130880.596612:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789130880.596617:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7b27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1876039508764544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130880.596643:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7b27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1876039508764544:12345-0@lo:400:kworker.0 Request processed in 27us (894us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130880.596649:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789130880.596660:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789130880.596666:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc6bede00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3627:x1876039508765056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130880.596691:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc6bede00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3627:x1876039508765056:12345-0@lo:400:kworker.0 Request processed in 25us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130880.596696:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1789130880.597737:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508764800 00000100:00100000:0.0:1789130880.597745:0:9827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508764800 00000100:00100000:0.0:1789130880.597892:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508765312 00000100:00100000:0.0:1789130880.597896:0:9827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508765312 00000100:00100000:0.0:1789130880.597910:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508764928 00000100:00100000:0.0:1789130880.597913:0:9827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508764928 00000100:00100000:0.0:1789130880.597925:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508765440 00000100:00100000:0.0:1789130880.597928:0:9827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508765440 00000100:00100000:0.0:1789130880.597943:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789130880.597950:0:9827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc843f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508764800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130880.598004:0:9827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc843f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508764800:12345-0@lo:400:kworker.0 Request processed in 54us (2580us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130880.598017:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789130880.598032:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789130880.598037:0:9827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddca0c4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508765312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130880.598067:0:9827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddca0c4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508765312:12345-0@lo:400:kworker.0 Request processed in 30us (2590us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130880.598073:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789130880.598084:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789130880.598090:0:9827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc6d67840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3625:x1876039508764928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130880.598116:0:9827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc6d67840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3625:x1876039508764928:12345-0@lo:400:kworker.0 Request processed in 26us (2508us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130880.598122:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789130880.598132:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789130880.598137:0:9827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7b25e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3625:x1876039508765440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130880.598163:0:9827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7b25e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3625:x1876039508765440:12345-0@lo:400:kworker.0 Request processed in 26us (2501us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130880.598169:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789130880.598242:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789130880.598249:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddffa83840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1876039508764672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130880.598352:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddffa83840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1876039508764672:12345-0@lo:400:kworker.0 Request processed in 103us (2146us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130880.598359:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789130880.598370:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789130880.598385:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddffa812c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3627:x1876039508765184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130880.598416:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddffa812c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3627:x1876039508765184:12345-0@lo:400:kworker.0 Request processed in 33us (2179us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130880.598422:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789130880.598447:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508763904 00000100:00100000:3.0:1789130880.598451:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508763904 00000100:00100000:0.0:1789130880.598996:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508764416 00000100:00100000:0.0:1789130880.599001:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508764416 00000100:00100000:0.0:1789130880.599022:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508764160 00000100:00100000:0.0:1789130880.599025:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508764160 00000100:00100000:0.0:1789130880.599037:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789130880.599043:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc6d65680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1876039508764416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130880.599080:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc6d65680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1876039508764416:12345-0@lo:400:kworker.0 Request processed in 37us (3508us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130880.599085:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789130880.599105:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789130880.599110:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddffa80b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508764160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130880.599141:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddffa80b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508764160:12345-0@lo:400:kworker.0 Request processed in 31us (2986us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130880.599147:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789130880.599234:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:3.0:1789130880.599241:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8601850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+24:3625:x1876039508763904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130880.599577:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8601850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+24:3625:x1876039508763904:12345-0@lo:400:kworker.0 Request processed in 336us (4043us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130880.599583:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00080000:3.0:1789130880.599632:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789130880.599637:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789130880.599640:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789130880.599642:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789130880.599671:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8416940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508764160:0@lo:400:kworker.0 00010000:00080000:3.0:1789130880.599687:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc843e580 x1876039508764672/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130896 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130880.599866:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc843e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3627:1876039508764672:0@lo:400:kworker.0 00010000:00080000:3.0:1789130880.599882:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc843d680 x1876039508765184/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130896 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130880.599890:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc843d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3627:1876039508765184:0@lo:400:kworker.0 00000100:00100000:3.0:1789130880.599901:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8417840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3627:1876039508764032:0@lo:400:kworker.0 00000100:00100000:3.0:1789130880.599911:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc84161c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3627:1876039508764544:0@lo:400:kworker.0 00000100:00100000:3.0:1789130880.599934:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc843f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3627:1876039508765056:0@lo:400:kworker.0 00000100:00100000:3.0:1789130880.599967:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8414b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3625:1876039508763904:0@lo:400:kworker.0 00000100:00100000:3.0:1789130880.599978:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8414780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508764416:0@lo:400:kworker.0 00010000:00080000:3.0:1789130880.599988:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc843e1c0 x1876039508764928/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789130896 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130880.599996:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc843e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508764928:0@lo:400:kworker.0 00010000:00080000:3.0:1789130880.600007:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc843cb40 x1876039508765440/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789130896 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130880.600014:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc843cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508765440:0@lo:400:kworker.0 00000100:00100000:3.0:1789130880.600025:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8414000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3625:1876039508764288:0@lo:400:kworker.0 00010000:00080000:3.0:1789130880.600036:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc843de00 x1876039508764800/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789130896 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130880.600043:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc843de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508764800:0@lo:400:kworker.0 00010000:00080000:3.0:1789130880.600053:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc843d2c0 x1876039508765312/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789130896 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130880.600060:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc843d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508765312:0@lo:400:kworker.0 00000100:00100000:1.0:1789130880.601728:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff8a6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1876039508765568:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789130880.601811:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130880.601959:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508765568 00000100:00100000:2.0:1789130880.601967:0:8418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508765568 00000100:00100000:2.0:1789130880.602016:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789130880.602026:0:8418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01a5cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1876039508765568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789130880.602066:0:8418:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789130880.602111:0:8418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01a5cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1876039508765568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130880.602125:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:1.0:1789130880.604538:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91ddff8a6d00 x1876039508765568/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789130896 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789130880.604563:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff8a6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1876039508765568:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789130880.607171:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789130880.607191:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01a5d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508765696:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789130880.607254:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130880.607304:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508765696 00000100:00100000:1.0:1789130880.607311:0:8418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508765696 00000100:00100000:1.0:1789130880.607350:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789130880.607359:0:8418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01a5e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508765696:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789130880.607380:0:8418:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789130880.607420:0:8418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01a5e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508765696:12345-0@lo:13:osp-pre-1-1.0 Request processed in 61us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130880.607427:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:1.0:1789130880.607481:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91de01a5d2c0 x1876039508765696/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789130896 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789130880.607500:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01a5d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508765696:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1789130880.917941:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789130881.106862:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789130881.106887:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff8e03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508765824:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789130881.106958:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130881.107060:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508765824 00000100:00100000:0.0:1789130881.107076:0:8418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508765824 00000100:00100000:0.0:1789130881.107127:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789130881.107138:0:8418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01a5d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508765824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789130881.107169:0:8418:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789130881.107219:0:8418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01a5d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508765824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130881.107226:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:1.0:1789130881.107709:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91ddff8e03c0 x1876039508765824/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789130897 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789130881.107731:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff8e03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508765824:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789130881.625269:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff8a61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1876039508765952:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789130881.625344:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130881.628579:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508765952 00000100:00100000:3.0:1789130881.628591:0:8418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508765952 00000100:00100000:3.0:1789130881.628643:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789130881.628652:0:8418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01a5f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1876039508765952:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789130881.628676:0:8418:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789130881.628767:0:8418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01a5f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1876039508765952:12345-0@lo:13:osp-pre-0-1.0 Request processed in 116us (3422us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130881.628774:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:3.0:1789130881.628832:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91ddff8a61c0 x1876039508765952/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789130897 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130881.628851:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff8a61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1876039508765952:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1789130881.939258:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789130882.396970:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789130882.397035:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789130882.397075:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789130882.397119:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498212608 00000100:00100000:3.0:1789130882.397131:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498212608 00000100:00100000:2.0:1789130882.397152:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498212480 00000100:00100000:2.0:1789130882.397167:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498212480 00000100:00100000:3.0:1789130882.397227:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 95 00000100:00100000:2.0:1789130882.397249:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 96 00000100:00100000:3.0:1789130882.397256:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddffa81680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+5:2387:x1876039498212608:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1789130882.397267:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc843d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+6:2387:x1876039498212480:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1789130882.397378:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498212352 00000100:00100000:1.0:1789130882.397384:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498212352 00000100:00100000:1.0:1789130882.397425:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 281 00000100:00100000:1.0:1789130882.397433:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8600850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+10:2387:x1876039498212352:12345-192.168.203.11@tcp:400:kworker.0 00000100:00080000:0.0:1789130882.397453:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789130882.397496:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789130882.399504:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc843d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+6:2387:x1876039498212480:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 2233us (2415us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130882.399523:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 96 00000100:00100000:3.0:1789130882.400764:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddffa81680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+5:2387:x1876039498212608:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 3507us (3710us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130882.400802:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 95 00000100:00100000:1.0:1789130882.404554:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8600850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+10:2387:x1876039498212352:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 7108us (7588us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130882.404569:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 281 00010000:00010000:2.0:1789130882.961965:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789130883.156350:0:9493:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of b99c111d-b9b6-4590-88e4-9fefd4d4c3a4 00000020:00000080:1.0:1789130883.156360:0:9493:0:(genops.c:885:class_export_put()) final put ffff91dcc1ee1800/b99c111d-b9b6-4590-88e4-9fefd4d4c3a4 00000020:00000080:2.0:1789130883.159318:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff91dcc1ee1800/b99c111d-b9b6-4590-88e4-9fefd4d4c3a4 for lustre-OST0001 00000020:00000080:2.0:1789130883.159407:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff91dcc1ee6800 for lustre-OST0001 00000001:00100000:0.0:1789130883.159528:0:8410:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of b99c111d-b9b6-4590-88e4-9fefd4d4c3a4 00000020:00000080:0.0:1789130883.159534:0:8410:0:(genops.c:885:class_export_put()) final put ffff91dcc7e70800/b99c111d-b9b6-4590-88e4-9fefd4d4c3a4 00000020:00000080:2.0:1789130883.159599:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff91dcc7e70800/b99c111d-b9b6-4590-88e4-9fefd4d4c3a4 for lustre-OST0000 00000020:00000080:2.0:1789130883.159621:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff91dcc7e70000 for lustre-OST0000 00000100:00100000:2.0:1789130883.665897:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01a5fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508766080:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789130883.666008:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130883.666197:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508766080 00000100:00100000:0.0:1789130883.666208:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508766080 00000100:00100000:0.0:1789130883.666275:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789130883.666286:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff8a5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508766080:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789130883.666330:0:6505:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789130883.666549:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc843de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1876039508766208:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789130883.666585:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130883.666646:0:6506:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:1.0:1789130883.666656:0:6506:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:1.0:1789130883.666843:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508766208 00000100:00100000:1.0:1789130883.666847:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508766208 00000100:00100000:1.0:1789130883.666959:0:11069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789130883.666967:0:11069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01a5cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3628:x1876039508766208:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789130883.667001:0:11069:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789130883.667045:0:11069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01a5cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3628:x1876039508766208:12345-0@lo:41:osp-pre-1-0.0 Request processed in 78us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130883.667053:0:11069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789130883.667102:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc843de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1876039508766208:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789130883.671419:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff8a5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508766080:12345-0@lo:41:osp-pre-0-1.0 Request processed in 5116us (5393us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130883.671439:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789130883.673200:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01a5fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508766080:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789130883.985835:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130885.009642:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789130885.136043:0:11107:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.132 00000100:00100000:1.0:1789130885.713643:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789130885.713672:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff8a4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508766464:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789130885.713777:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130885.713850:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01a5da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1876039508766336:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789130885.713877:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130885.713917:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508766464 00000100:00100000:1.0:1789130885.713925:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508766464 00000100:00100000:1.0:1789130885.713991:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508766336 00000100:00100000:1.0:1789130885.713994:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508766336 00000100:00100000:1.0:1789130885.714012:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789130885.714021:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01a5f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508766464:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789130885.714059:0:8419:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789130885.714104:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01a5f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508766464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130885.714111:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789130885.714130:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789130885.714136:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01a5fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1876039508766336:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789130885.714146:0:8419:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789130885.714170:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01a5fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1876039508766336:12345-0@lo:13:osp-pre-1-1.0 Request processed in 34us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130885.714175:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:1.0:1789130885.714191:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789130885.714220:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91ddff8a4b40 x1876039508766464/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789130901 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789130885.714241:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff8a4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508766464:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1789130885.714252:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91de01a5da40 x1876039508766336/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789130901 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789130885.714274:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01a5da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1876039508766336:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789130885.714925:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01a5da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3627:1876039508766592:0@lo:400:kworker.0 00000100:00100000:2.0:1789130885.715166:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130885.715295:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7ad03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508766848:0@lo:400:kworker.0 00000100:00100000:1.0:1789130885.715331:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130885.715366:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7ad0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3625:1876039508767360:0@lo:400:kworker.0 00000100:00100000:1.0:1789130885.715393:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130885.715410:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7ad21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3625:1876039508767872:0@lo:400:kworker.0 00000100:00100000:0.0:1789130885.715431:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508766848 00000100:00100000:0.0:1789130885.715439:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508766848 00000100:00100000:1.0:1789130885.715446:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130885.715490:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789130885.715496:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7ad0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3625:1876039508766976:0@lo:400:kworker.0 00000100:00100000:1.0:1789130885.715592:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130885.715610:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7ad2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1876039508767104:0@lo:400:kworker.0 00000100:00100000:0.0:1789130885.715637:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789130885.715647:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130885.715648:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7ad2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508766848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130885.715674:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7ad0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508767488:0@lo:400:kworker.0 00000100:00100000:2.0:1789130885.715681:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7ad2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1876039508767616:0@lo:400:kworker.0 00000100:00100000:0.0:1789130885.715707:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7ad2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508766848:12345-0@lo:400:kworker.0 Request processed in 62us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130885.715716:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789130885.715719:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130885.715735:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508767104 00000100:00100000:0.0:1789130885.715738:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508767104 00000100:00100000:2.0:1789130885.715756:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789130885.715775:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789130885.715783:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7ad12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3627:1876039508766720:0@lo:400:kworker.0 00000100:00100000:1.0:1789130885.715784:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130885.715792:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff8a4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3627:x1876039508767104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130885.715847:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7ad03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508766848:0@lo:400:kworker.0 00000100:00100000:2.0:1789130885.715849:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130885.715891:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7ad0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3627:1876039508767232:0@lo:400:kworker.0 00000100:00100000:0.0:1789130885.715899:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff8a4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3627:x1876039508767104:12345-0@lo:400:kworker.0 Request processed in 113us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130885.715906:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789130885.715918:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130885.715932:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7ad1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3627:1876039508767744:0@lo:400:kworker.0 00000100:00100000:0.0:1789130885.715938:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508767360 00000100:00100000:0.0:1789130885.715942:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508767360 00000100:00100000:2.0:1789130885.715957:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130885.715984:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508767872 00000100:00100000:0.0:1789130885.715987:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508767872 00000100:00100000:2.0:1789130885.715994:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7ad2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1876039508767104:0@lo:400:kworker.0 00000100:00080000:1.0:1789130885.715996:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789130885.716009:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508766976 00000100:00100000:0.0:1789130885.716014:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508766976 00000100:00100000:0.0:1789130885.716028:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508766720 00000100:00100000:2.0:1789130885.716029:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508767232 00000100:00100000:0.0:1789130885.716031:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508766720 00000100:00100000:2.0:1789130885.716032:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508767232 00000100:00100000:0.0:1789130885.716042:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508767744 00000100:00100000:0.0:1789130885.716044:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508767744 00000100:00100000:0.0:1789130885.716064:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789130885.716067:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789130885.716069:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7ad1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1876039508767360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130885.716073:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7ad1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1876039508767872:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1789130885.716138:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789130885.716500:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7ad1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1876039508767360:12345-0@lo:400:kworker.0 Request processed in 428us (1105us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130885.716508:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789130885.716533:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00010000:00080000:1.0:1789130885.716536:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc7ad0000 x1876039508767360/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130901 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789130885.716541:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7ad3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1876039508766976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130885.716548:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7ad0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3625:1876039508767360:0@lo:400:kworker.0 00000100:00100000:0.0:1789130885.716599:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7ad3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1876039508766976:12345-0@lo:400:kworker.0 Request processed in 59us (1017us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130885.716606:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1789130885.716619:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1789130885.716624:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff8a61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1876039508766720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130885.716659:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff8a61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1876039508766720:12345-0@lo:400:kworker.0 Request processed in 36us (814us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130885.716665:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1789130885.716677:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1789130885.716682:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7ffd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3627:x1876039508767744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130885.716710:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7ffd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3627:x1876039508767744:12345-0@lo:400:kworker.0 Request processed in 28us (754us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130885.716715:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789130885.716722:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7ad0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3625:1876039508766976:0@lo:400:kworker.0 00000100:00100000:0.0:1789130885.716726:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789130885.716732:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff8a6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1876039508767232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130885.716759:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff8a6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1876039508767232:12345-0@lo:400:kworker.0 Request processed in 28us (841us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130885.716774:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1789130885.717428:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508766592 00000100:00100000:3.0:1789130885.717437:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508766592 00000100:00100000:3.0:1789130885.717512:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1789130885.717627:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8600050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+24:3627:x1876039508766592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130885.717682:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8600050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+24:3627:x1876039508766592:12345-0@lo:400:kworker.0 Request processed in 62us (2517us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130885.717689:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1789130885.717728:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508767616 00000100:00100000:3.0:1789130885.717732:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508767616 00000100:00080000:1.0:1789130885.717798:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789130885.718159:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7ad1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1876039508767872:12345-0@lo:400:kworker.0 Request processed in 2082us (2709us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130885.718168:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508767488 00000100:00100000:2.0:1789130885.718168:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1789130885.718182:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508767488 00000100:00100000:2.0:1789130885.718195:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789130885.718203:0:9827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff8a4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3627:x1876039508767616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130885.718213:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789130885.718219:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7ad3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508767488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130885.718238:0:9827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff8a4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3627:x1876039508767616:12345-0@lo:400:kworker.0 Request processed in 36us (2518us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130885.718244:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789130885.718260:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7ad3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508767488:12345-0@lo:400:kworker.0 Request processed in 42us (2505us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130885.718266:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789130885.718286:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7ad12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3627:1876039508766720:0@lo:400:kworker.0 00000100:00100000:2.0:1789130885.718307:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7ad0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3627:1876039508767232:0@lo:400:kworker.0 00000100:00100000:2.0:1789130885.718320:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7ad1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3627:1876039508767744:0@lo:400:kworker.0 00010000:00080000:2.0:1789130885.718332:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc7ad2580 x1876039508767616/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789130901 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789130885.718357:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7ad2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1876039508767616:0@lo:400:kworker.0 00000100:00100000:2.0:1789130885.718369:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01a5da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3627:1876039508766592:0@lo:400:kworker.0 00000100:00080000:3.0:1789130885.718663:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789130885.719422:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc7ad21c0 x1876039508767872/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130901 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789130885.719439:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7ad21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3625:1876039508767872:0@lo:400:kworker.0 00010000:00080000:0.0:1789130885.719746:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc7ad0f00 x1876039508767488/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789130901 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789130885.719756:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7ad0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508767488:0@lo:400:kworker.0 00010000:00010000:3.0:1789130886.034733:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789130886.235703:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff8e1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508768000:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789130886.235812:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130886.235958:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508768000 00000100:00100000:3.0:1789130886.235968:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508768000 00000100:00100000:3.0:1789130886.236033:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789130886.236045:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7ffcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508768000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789130886.236087:0:8419:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789130886.247788:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7ffcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508768000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 11729us (11961us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130886.247807:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:2.0:1789130886.248021:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91ddff8e1a40 x1876039508768000/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789130902 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789130886.248049:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff8e1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508768000:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789130886.739415:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7fff840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508768128:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789130886.739561:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130886.740126:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508768128 00000100:00100000:3.0:1789130886.740138:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508768128 00000100:00100000:3.0:1789130886.740254:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789130886.740266:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff8e21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508768128:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789130886.740297:0:8419:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789130886.740376:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff8e21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508768128:12345-0@lo:13:osp-pre-0-1.0 Request processed in 112us (815us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130886.740385:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:0.0:1789130886.740507:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc7fff840 x1876039508768128/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789130902 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789130886.740553:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7fff840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508768128:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1789130887.058183:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789130887.526936:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789130887.526993:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789130887.527024:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789130887.527059:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498212864 00000100:00100000:2.0:1789130887.527071:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498212864 00000100:00100000:2.0:1789130887.527155:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498212992 00000100:00100000:2.0:1789130887.527159:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498212992 00000100:00100000:2.0:1789130887.527184:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 103 00000100:00100000:2.0:1789130887.527195:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7ffe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+6:2385:x1876039498212864:12345-192.168.203.11@tcp:400:kworker.0 00000100:00080000:0.0:1789130887.527220:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789130887.527226:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789130887.527303:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7ffe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+6:2385:x1876039498212864:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 109us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130887.527312:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 103 00000100:00100000:2.0:1789130887.527331:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 104 00000100:00100000:2.0:1789130887.527337:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7ffc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+5:2385:x1876039498212992:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1789130887.527359:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7ffc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+5:2385:x1876039498212992:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 24us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130887.527385:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 104 00000100:00100000:2.0:1789130887.527405:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498212736 00000100:00100000:2.0:1789130887.527408:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498212736 00000100:00100000:2.0:1789130887.527433:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 283 00000100:00100000:2.0:1789130887.527438:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8602850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+10:2385:x1876039498212736:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1789130887.527485:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8602850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+10:2385:x1876039498212736:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 46us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130887.527492:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 283 00000001:02000400:0.0:1789130887.982301:0:11204:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.132 00010000:00010000:0.0:1789130888.087583:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789130888.787434:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789130888.787481:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff8e2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1876039508768256:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789130888.787575:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130888.790753:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7ad0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508768384:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789130888.790842:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130888.790919:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508768256 00000100:00100000:0.0:1789130888.790928:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508768256 00000100:00100000:0.0:1789130888.790973:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508768384 00000100:00100000:0.0:1789130888.790975:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508768384 00000100:00100000:0.0:1789130888.790990:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789130888.791000:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff8e1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3627:x1876039508768256:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789130888.791040:0:6506:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789130888.791086:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff8e1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3627:x1876039508768256:12345-0@lo:41:osp-pre-1-0.0 Request processed in 87us (3511us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130888.791094:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789130888.791113:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789130888.791118:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff8e30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508768384:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789130888.791134:0:6506:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789130888.791160:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff8e30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508768384:12345-0@lo:41:osp-pre-0-1.0 Request processed in 42us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130888.791166:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789130888.791223:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7ad0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508768384:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789130888.791273:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff8e2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1876039508768256:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1789130889.107927:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130890.130198:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789130890.834151:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7ad0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3626:1876039508768512:0@lo:400:kworker.0 00000100:00100000:0.0:1789130890.834259:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130890.834331:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7ad21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508769024:0@lo:400:kworker.0 00000100:00100000:0.0:1789130890.834367:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130890.834389:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7ad1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1876039508769536:0@lo:400:kworker.0 00000100:00100000:0.0:1789130890.834414:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130890.834435:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc5febc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1876039508770048:0@lo:400:kworker.0 00000100:00100000:0.0:1789130890.834456:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130890.834525:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1789130890.834532:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7ad0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3626:1876039508768896:0@lo:400:kworker.0 00000100:00100000:0.0:1789130890.834588:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130890.834614:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7fffc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508769408:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789130890.834639:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130890.834658:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7ad2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3626:1876039508769920:0@lo:400:kworker.0 00000100:00100000:0.0:1789130890.834680:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130890.834714:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7ad3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3627:1876039508768640:0@lo:400:kworker.0 00000100:00100000:0.0:1789130890.834750:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130890.834770:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7ad0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3627:1876039508769152:0@lo:400:kworker.0 00000100:00100000:0.0:1789130890.834790:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130890.834809:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7ad0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1876039508769664:0@lo:400:kworker.0 00000100:00100000:0.0:1789130890.834831:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130890.834865:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc5fe83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1876039508770176:0@lo:400:kworker.0 00000100:00100000:0.0:1789130890.834886:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130890.834907:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1789130890.834976:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508768512 00000100:00100000:2.0:1789130890.834987:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508768512 00000100:00100000:2.0:1789130890.835041:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:2.0:1789130890.835063:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8602450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+24:3626:x1876039508768512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130890.835182:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8602450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+24:3626:x1876039508768512:12345-0@lo:400:kworker.0 Request processed in 131us (922us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130890.835192:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1789130890.835285:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc843d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1876039508770304:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789130890.835317:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130890.835434:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508769408 00000100:00100000:2.0:1789130890.835439:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508769408 00000100:00100000:2.0:1789130890.835500:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508770304 00000100:00100000:2.0:1789130890.835504:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508770304 00000100:00100000:2.0:1789130890.835523:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789130890.835531:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7c69680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508769408:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789130890.835557:0:8419:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789130890.835597:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7c69680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508769408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (957us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130890.835603:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789130890.835624:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789130890.835630:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc5fe8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1876039508770304:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789130890.835639:0:8419:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789130890.835671:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc5fe8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1876039508770304:12345-0@lo:13:osp-pre-1-1.0 Request processed in 41us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130890.835676:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:2.0:1789130890.835711:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc843d680 x1876039508770304/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789130906 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789130890.835743:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc843d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1876039508770304:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789130890.835839:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7ad03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508768768:0@lo:400:kworker.0 00000100:00100000:0.0:1789130890.835870:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130890.835901:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7ad2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3627:1876039508769280:0@lo:400:kworker.0 00000100:00100000:2.0:1789130890.835910:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508769024 00000100:00100000:2.0:1789130890.835916:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508769024 00000100:00100000:2.0:1789130890.835948:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508768768 00000100:00100000:2.0:1789130890.835950:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508768768 00000100:00100000:2.0:1789130890.835964:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789130890.835971:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff8e2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508769024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130890.835999:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130890.836014:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff8e2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508769024:12345-0@lo:400:kworker.0 Request processed in 43us (1646us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130890.836020:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789130890.836031:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789130890.836037:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7c683c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508768768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130890.836168:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7ad12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3627:1876039508769792:0@lo:400:kworker.0 00000100:00100000:0.0:1789130890.836193:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130890.836224:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508769536 00000100:00100000:0.0:1789130890.836228:0:9827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508769536 00000100:00100000:0.0:1789130890.836259:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508770048 00000100:00100000:0.0:1789130890.836262:0:9827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508770048 00000100:00100000:2.0:1789130890.836267:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7c683c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508768768:12345-0@lo:400:kworker.0 Request processed in 227us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130890.836276:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789130890.836279:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508769664 00000100:00100000:0.0:1789130890.836286:0:9827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508769664 00000100:00100000:0.0:1789130890.836305:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508770176 00000100:00100000:0.0:1789130890.836308:0:9827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508770176 00000100:00100000:0.0:1789130890.836320:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789130890.836326:0:9827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff8e03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3626:x1876039508769536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130890.836363:0:9827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff8e03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3626:x1876039508769536:12345-0@lo:400:kworker.0 Request processed in 36us (1947us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130890.836369:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789130890.836385:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789130890.836391:0:9827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff8e0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3626:x1876039508770048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130890.836422:0:9827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff8e0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3626:x1876039508770048:12345-0@lo:400:kworker.0 Request processed in 31us (1965us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130890.836427:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789130890.836449:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789130890.836455:0:9827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7c6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3627:x1876039508769664:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1789130890.836544:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789130890.836549:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789130890.836755:0:9827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7c6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3627:x1876039508769664:12345-0@lo:400:kworker.0 Request processed in 299us (1923us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130890.836762:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789130890.836775:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789130890.836781:0:9827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7c692c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3627:x1876039508770176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130890.836810:0:9827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7c692c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3627:x1876039508770176:12345-0@lo:400:kworker.0 Request processed in 30us (1924us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130890.836816:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789130890.836844:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508768896 00000100:00100000:0.0:1789130890.836848:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508768896 00000100:00100000:0.0:1789130890.836870:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508769920 00000100:00100000:0.0:1789130890.836873:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508769920 00000100:00100000:0.0:1789130890.836900:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508768640 00000100:00100000:0.0:1789130890.836904:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508768640 00000100:00100000:0.0:1789130890.836926:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508769152 00000100:00100000:0.0:1789130890.836928:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508769152 00000100:00100000:0.0:1789130890.837759:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508769280 00000100:00100000:0.0:1789130890.837772:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508769280 00000100:00100000:0.0:1789130890.837799:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508769792 00000100:00100000:0.0:1789130890.837802:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508769792 00000100:00100000:0.0:1789130890.837820:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789130890.837828:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7c68f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1876039508768896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130890.837896:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7c68f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1876039508768896:12345-0@lo:400:kworker.0 Request processed in 69us (3307us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130890.837903:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789130890.838361:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789130890.838371:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7c68b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1876039508769920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130890.838437:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7c68b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1876039508769920:12345-0@lo:400:kworker.0 Request processed in 69us (3755us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130890.838444:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789130890.838484:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789130890.838493:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7c6b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1876039508768640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130890.838525:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7c6b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1876039508768640:12345-0@lo:400:kworker.0 Request processed in 33us (3774us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130890.838531:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789130890.838543:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789130890.838550:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7c69e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1876039508769152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130890.838579:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7c69e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1876039508769152:12345-0@lo:400:kworker.0 Request processed in 31us (3788us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130890.838585:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789130890.838596:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789130890.838601:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7c6a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1876039508769280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130890.838632:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7c6a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1876039508769280:12345-0@lo:400:kworker.0 Request processed in 31us (2635us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130890.838637:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789130890.838659:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789130890.838666:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7c69a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3627:x1876039508769792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130890.838694:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7c69a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3627:x1876039508769792:12345-0@lo:400:kworker.0 Request processed in 29us (2500us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130890.838700:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789130890.838823:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7ad03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508768768:0@lo:400:kworker.0 00010000:00080000:0.0:1789130890.838854:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc7ad2580 x1876039508769280/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130906 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789130890.838866:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7ad2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3627:1876039508769280:0@lo:400:kworker.0 00000100:00100000:0.0:1789130890.838878:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7ad12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3627:1876039508769792:0@lo:400:kworker.0 00000100:00100000:0.0:1789130890.838890:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7ad3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3627:1876039508768640:0@lo:400:kworker.0 00000100:00100000:0.0:1789130890.838901:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7ad0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3627:1876039508769152:0@lo:400:kworker.0 00000100:00080000:1.0:1789130890.839140:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789130890.839146:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789130890.839554:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7ad0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3626:1876039508768896:0@lo:400:kworker.0 00010000:00080000:1.0:1789130890.839572:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc7fffc00 x1876039508769408/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789130906 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789130890.839591:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7fffc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508769408:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1789130890.839604:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc7ad2940 x1876039508769920/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130906 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789130890.839613:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7ad2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3626:1876039508769920:0@lo:400:kworker.0 00000100:00100000:1.0:1789130890.839625:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7ad0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3626:1876039508768512:0@lo:400:kworker.0 00000100:00100000:1.0:1789130890.839637:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7ad21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508769024:0@lo:400:kworker.0 00010000:00080000:1.0:1789130890.839661:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc7ad1680 x1876039508769536/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789130906 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789130890.839669:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7ad1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1876039508769536:0@lo:400:kworker.0 00010000:00080000:1.0:1789130890.839682:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc5febc00 x1876039508770048/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789130906 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789130890.839690:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc5febc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1876039508770048:0@lo:400:kworker.0 00010000:00080000:0.0:1789130890.839889:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc7ad0780 x1876039508769664/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789130906 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789130890.839901:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7ad0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1876039508769664:0@lo:400:kworker.0 00010000:00080000:0.0:1789130890.840104:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc5fe83c0 x1876039508770176/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789130906 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789130890.840114:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc5fe83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1876039508770176:0@lo:400:kworker.0 00000001:02000400:2.0:1789130891.139862:0:11302:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.132 00010000:00010000:0.0:1789130891.154495:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789130891.347224:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789130891.347254:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7c6a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508770432:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789130891.347348:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130891.347431:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508770432 00000100:00100000:0.0:1789130891.347440:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508770432 00000100:00100000:0.0:1789130891.347552:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789130891.347563:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7c68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508770432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789130891.347599:0:8419:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789130891.347652:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7c68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508770432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130891.347674:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:0.0:1789130891.347736:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc7c6a940 x1876039508770432/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789130907 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789130891.347759:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7c6a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508770432:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789130891.857866:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789130891.857897:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7ffe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508770560:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789130891.858021:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130891.858129:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508770560 00000100:00100000:2.0:1789130891.858137:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508770560 00000100:00100000:2.0:1789130891.858194:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789130891.858203:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7ffc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508770560:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789130891.858234:0:8419:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789130891.858606:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7ffc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508770560:12345-0@lo:13:osp-pre-0-1.0 Request processed in 403us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130891.858616:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:2.0:1789130891.858671:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc7ffe940 x1876039508770560/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789130907 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789130891.858695:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7ffe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508770560:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1789130892.177594:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789130892.658406:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789130892.658505:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789130892.658549:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789130892.658584:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498213376 00000100:00100000:2.0:1789130892.658597:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498213376 00000100:00100000:2.0:1789130892.658673:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498213248 00000100:00100000:2.0:1789130892.658676:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498213248 00000100:00100000:2.0:1789130892.658705:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 111 00000100:00100000:2.0:1789130892.658729:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7ffe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+5:2388:x1876039498213376:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1789130892.658836:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7ffe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+5:2388:x1876039498213376:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 121us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130892.658845:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 111 00000100:00100000:2.0:1789130892.658864:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 112 00000100:00100000:2.0:1789130892.658870:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7ffde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+6:2388:x1876039498213248:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1789130892.658911:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7ffde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+6:2388:x1876039498213248:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 40us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130892.658918:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 112 00000100:00080000:2.0:1789130892.660079:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789130892.660088:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789130892.661942:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498213120 00000100:00100000:0.0:1789130892.661959:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498213120 00000100:00100000:0.0:1789130892.662025:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 285 00000100:00100000:0.0:1789130892.662037:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8603050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+10:2388:x1876039498213120:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1789130892.662142:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8603050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+10:2388:x1876039498213120:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 106us (3750us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130892.662151:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 285 00000001:02000400:3.0:1789130893.149898:0:11350:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Fri Sep 11 08:48:10 EDT 2026 00010000:00010000:1.0:1789130893.201728:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789130893.905823:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7c6a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1876039508770688:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789130893.905924:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130893.906106:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508770688 00000100:00100000:0.0:1789130893.906116:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508770688 00000100:00100000:0.0:1789130893.906186:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789130893.906199:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7ffc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3627:x1876039508770688:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789130893.906246:0:6506:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789130893.906313:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7ffc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3627:x1876039508770688:12345-0@lo:41:osp-pre-1-0.0 Request processed in 116us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130893.906334:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789130893.906388:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7c6a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1876039508770688:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789130893.906886:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc5fea1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1876039508770816:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789130893.906928:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130893.907016:0:11069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508770816 00000100:00100000:0.0:1789130893.907021:0:11069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508770816 00000100:00100000:0.0:1789130893.907053:0:11069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789130893.907063:0:11069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7ffda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3628:x1876039508770816:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789130893.907108:0:11069:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789130893.912286:0:11069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7ffda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3628:x1876039508770816:12345-0@lo:41:osp-pre-0-1.0 Request processed in 5208us (5340us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130893.912306:0:11069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789130893.918858:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc5fea1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1876039508770816:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789130894.225644:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130895.249711:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789130895.953867:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789130895.953910:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc843e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1876039508770944:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789130895.954002:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130895.954078:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508770944 00000100:00100000:3.0:1789130895.954087:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508770944 00000100:00100000:3.0:1789130895.954154:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789130895.954165:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc843d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1876039508770944:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789130895.954200:0:8419:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789130895.954248:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc843d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1876039508770944:12345-0@lo:13:osp-pre-1-1.0 Request processed in 85us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130895.954256:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:3.0:1789130895.954281:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789130895.954315:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc843e580 x1876039508770944/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789130911 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130895.954337:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc843e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1876039508770944:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789130895.960063:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc843f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1876039508771328:0@lo:400:kworker.0 00000100:00100000:3.0:1789130895.960164:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130895.960219:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8414780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3628:1876039508771840:0@lo:400:kworker.0 00000100:00100000:3.0:1789130895.960249:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130895.960274:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8416940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3628:1876039508772352:0@lo:400:kworker.0 00000100:00100000:3.0:1789130895.960298:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130895.960330:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1789130895.960335:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc843e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3628:1876039508771200:0@lo:400:kworker.0 00000100:00100000:3.0:1789130895.960385:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130895.960407:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8414000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3628:1876039508771712:0@lo:400:kworker.0 00000100:00100000:3.0:1789130895.960443:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130895.960492:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8417840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3628:1876039508772224:0@lo:400:kworker.0 00000100:00100000:3.0:1789130895.960514:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130895.960546:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508771328 00000100:00100000:3.0:1789130895.960555:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508771328 00000100:00100000:3.0:1789130895.960612:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1789130895.960622:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff7c0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3628:x1876039508771328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130895.960686:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff7c0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3628:x1876039508771328:12345-0@lo:400:kworker.0 Request processed in 64us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130895.960705:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1789130895.960734:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508771840 00000100:00100000:3.0:1789130895.960738:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508771840 00000100:00100000:3.0:1789130895.960771:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508772352 00000100:00100000:3.0:1789130895.960774:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508772352 00000100:00100000:3.0:1789130895.960788:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508771200 00000100:00100000:3.0:1789130895.960790:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508771200 00000100:00100000:3.0:1789130895.960801:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508771712 00000100:00100000:3.0:1789130895.960803:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508771712 00000100:00100000:3.0:1789130895.960814:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508772224 00000100:00100000:3.0:1789130895.960817:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508772224 00000100:00100000:3.0:1789130895.960831:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789130895.960838:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff7c30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3628:x1876039508771840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130895.960871:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff7c30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3628:x1876039508771840:12345-0@lo:400:kworker.0 Request processed in 33us (621us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130895.960877:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789130895.960888:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1789130895.960894:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff7c21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3628:x1876039508772352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130895.960921:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff7c21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3628:x1876039508772352:12345-0@lo:400:kworker.0 Request processed in 27us (622us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130895.960935:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1789130895.960950:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1789130895.960955:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8497480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1876039508771200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130895.960987:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8497480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1876039508771200:12345-0@lo:400:kworker.0 Request processed in 31us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130895.960993:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1789130895.961005:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1789130895.961011:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc84952c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3628:x1876039508771712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130895.961037:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc84952c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3628:x1876039508771712:12345-0@lo:400:kworker.0 Request processed in 27us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130895.961043:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1789130895.961054:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1789130895.961061:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc84943c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3628:x1876039508772224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130895.961087:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc84943c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3628:x1876039508772224:12345-0@lo:400:kworker.0 Request processed in 27us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130895.961093:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00080000:3.0:1789130895.961128:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789130895.961133:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789130895.961166:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc843e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3628:1876039508771200:0@lo:400:kworker.0 00000100:00100000:3.0:1789130895.961176:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8414000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3628:1876039508771712:0@lo:400:kworker.0 00000100:00100000:3.0:1789130895.961184:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8417840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3628:1876039508772224:0@lo:400:kworker.0 00000100:00100000:3.0:1789130895.961193:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc843f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1876039508771328:0@lo:400:kworker.0 00010000:00080000:3.0:1789130895.961225:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc8414780 x1876039508771840/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130911 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130895.961242:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8414780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3628:1876039508771840:0@lo:400:kworker.0 00010000:00080000:3.0:1789130895.961254:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc8416940 x1876039508772352/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130911 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130895.961262:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8416940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3628:1876039508772352:0@lo:400:kworker.0 00000100:00100000:0.0:1789130895.961490:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc843cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3625:1876039508771456:0@lo:400:kworker.0 00000100:00100000:0.0:1789130895.961529:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130895.961564:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8414b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508771968:0@lo:400:kworker.0 00000100:00100000:0.0:1789130895.961592:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130895.961621:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff7c0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508772480:0@lo:400:kworker.0 00000100:00100000:0.0:1789130895.961644:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130895.961665:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1789130895.961672:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc843e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3625:1876039508771072:0@lo:400:kworker.0 00000100:00100000:0.0:1789130895.961710:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130895.961737:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc843de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508771584:0@lo:400:kworker.0 00000100:00100000:0.0:1789130895.961761:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130895.961779:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc84161c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508772096:0@lo:400:kworker.0 00000100:00100000:0.0:1789130895.961804:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130895.961834:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508771968 00000100:00100000:0.0:1789130895.961839:0:9827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508771968 00000100:00100000:0.0:1789130895.961878:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508772480 00000100:00100000:0.0:1789130895.961881:0:9827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508772480 00000100:00100000:0.0:1789130895.961894:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508772096 00000100:00100000:0.0:1789130895.961896:0:9827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508772096 00000100:00100000:0.0:1789130895.961909:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789130895.961915:0:9827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7c6ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508771968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130895.961965:0:9827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7c6ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508771968:12345-0@lo:400:kworker.0 Request processed in 49us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130895.961974:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789130895.961989:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789130895.961995:0:9827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7c6bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3625:x1876039508772480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130895.962022:0:9827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7c6bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3625:x1876039508772480:12345-0@lo:400:kworker.0 Request processed in 28us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130895.962028:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789130895.962040:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789130895.962045:0:9827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7c6b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3625:x1876039508772096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130895.962072:0:9827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7c6b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3625:x1876039508772096:12345-0@lo:400:kworker.0 Request processed in 27us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130895.962078:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789130895.962101:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508771072 00000100:00100000:0.0:1789130895.962104:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508771072 00000100:00100000:0.0:1789130895.962131:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1789130895.962136:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8601c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+24:3625:x1876039508771072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130895.962167:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8601c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+24:3625:x1876039508771072:12345-0@lo:400:kworker.0 Request processed in 30us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130895.962173:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1789130895.962200:0:11069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508771584 00000100:00100000:0.0:1789130895.962203:0:11069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508771584 00000100:00100000:0.0:1789130895.962222:0:11069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789130895.962228:0:11069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7c6a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1876039508771584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130895.962258:0:11069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7c6a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1876039508771584:12345-0@lo:400:kworker.0 Request processed in 30us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130895.962273:0:11069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789130895.962321:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc843e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3625:1876039508771072:0@lo:400:kworker.0 00000100:00100000:0.0:1789130895.962332:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc843de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508771584:0@lo:400:kworker.0 00010000:00080000:0.0:1789130895.962342:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc84161c0 x1876039508772096/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789130911 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789130895.962353:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc84161c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508772096:0@lo:400:kworker.0 00010000:00080000:0.0:1789130895.962364:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc8414b40 x1876039508771968/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789130911 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789130895.962371:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8414b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508771968:0@lo:400:kworker.0 00010000:00080000:0.0:1789130895.962381:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91ddff7c0b40 x1876039508772480/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789130911 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789130895.962389:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff7c0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508772480:0@lo:400:kworker.0 00000100:00080000:3.0:1789130895.965778:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789130895.965793:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789130895.965830:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508771456 00000100:00100000:3.0:1789130895.965842:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508771456 00000100:00100000:3.0:1789130895.965921:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1789130895.965934:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7c68780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1876039508771456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130895.966058:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7c68780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1876039508771456:12345-0@lo:400:kworker.0 Request processed in 125us (4527us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130895.966067:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1789130895.966131:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc843cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3625:1876039508771456:0@lo:400:kworker.0 00000100:00100000:2.0:1789130895.966443:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7ffed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508772608:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789130895.966520:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130895.966821:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508772608 00000100:00100000:3.0:1789130895.966827:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508772608 00000100:00100000:3.0:1789130895.966857:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789130895.966863:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7ffe580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508772608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789130895.966883:0:8419:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789130895.966935:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7ffe580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508772608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130895.966942:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:1.0:1789130895.967053:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc7ffed00 x1876039508772608/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789130911 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789130895.967073:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7ffed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508772608:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789130896.284019:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789130896.465916:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff7c0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1876039508772736:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789130896.466014:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130896.466191:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508772736 00000100:00100000:2.0:1789130896.466202:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508772736 00000100:00100000:2.0:1789130896.466259:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789130896.466269:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc5fe9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1876039508772736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789130896.466306:0:8419:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789130896.466363:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc5fe9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1876039508772736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130896.466372:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:1.0:1789130896.466556:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91ddff7c0b40 x1876039508772736/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789130912 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789130896.466578:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff7c0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1876039508772736:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789130896.980160:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff7c0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1876039508772864:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789130896.980262:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130896.980540:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508772864 00000100:00100000:0.0:1789130896.980552:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508772864 00000100:00100000:0.0:1789130896.980613:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789130896.980624:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc5fe9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1876039508772864:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789130896.980653:0:8419:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789130896.980728:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc5fe9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1876039508772864:12345-0@lo:13:osp-pre-0-1.0 Request processed in 105us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130896.980736:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:3.0:1789130896.984247:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91ddff7c0b40 x1876039508772864/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789130912 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130896.984303:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff7c0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1876039508772864:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1789130897.297885:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789130897.757735:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789130897.757802:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789130897.757933:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498213504 00000100:00100000:1.0:1789130897.757948:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498213504 00000100:00100000:3.0:1789130897.758008:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498213632 00000100:00100000:3.0:1789130897.758014:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498213632 00000100:00100000:1.0:1789130897.758024:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 287 00000100:00100000:1.0:1789130897.758034:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8602050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+10:2388:x1876039498213504:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1789130897.758063:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 119 00000100:00100000:3.0:1789130897.758071:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7fff0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+6:2388:x1876039498213632:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1789130897.758129:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8602050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+10:2388:x1876039498213504:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 95us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130897.758137:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 287 00000100:00080000:2.0:1789130897.758154:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789130897.764368:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7fff0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+6:2388:x1876039498213632:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 6278us (6630us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130897.764388:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 119 00000100:00100000:2.0:1789130897.764630:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789130897.766027:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498213760 00000100:00100000:2.0:1789130897.766058:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498213760 00000100:00080000:1.0:1789130897.766154:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789130897.772438:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 120 00000100:00100000:2.0:1789130897.772486:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7fffc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+5:2388:x1876039498213760:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1789130897.772620:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7fffc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+5:2388:x1876039498213760:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 167us (7990us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130897.772629:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 120 00010000:00010000:3.0:1789130898.322708:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789130899.025800:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff7c0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508773120:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789130899.025842:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc5fe92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508772992:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789130899.025895:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130899.025956:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130899.026016:0:11069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508772992 00000100:00100000:1.0:1789130899.026024:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508773120 00000100:00100000:0.0:1789130899.026025:0:11069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508772992 00000100:00100000:1.0:1789130899.026027:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508773120 00000100:00100000:0.0:1789130899.026084:0:11069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789130899.026094:0:11069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7c6a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508773120:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789130899.026138:0:11069:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789130899.026189:0:11069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7c6a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508773120:12345-0@lo:41:osp-pre-1-0.0 Request processed in 96us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130899.027456:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789130899.027488:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7fff840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508772992:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789130899.027528:0:6506:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789130899.027604:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7fff840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508772992:12345-0@lo:41:osp-pre-0-1.0 Request processed in 126us (1709us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130899.027622:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789130899.027706:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc5fe92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508772992:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789130899.028564:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff7c0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508773120:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789130899.039326:0:11069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00010000:00010000:2.0:1789130899.346958:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130900.371110:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789130901.077088:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8495a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3627:1876039508773248:0@lo:400:kworker.0 00000100:00100000:3.0:1789130901.077191:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130901.077260:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8494780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1876039508773760:0@lo:400:kworker.0 00000100:00100000:3.0:1789130901.077292:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130901.077315:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8494f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1876039508774272:0@lo:400:kworker.0 00000100:00100000:3.0:1789130901.077342:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130901.077362:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8495e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1876039508774784:0@lo:400:kworker.0 00000100:00100000:3.0:1789130901.077384:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130901.077413:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:3.0:1789130901.077420:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc84970c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3627:1876039508773376:0@lo:400:kworker.0 00000100:00100000:3.0:1789130901.077447:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130901.077489:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8496d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3627:1876039508773888:0@lo:400:kworker.0 00000100:00100000:3.0:1789130901.077589:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130901.077609:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8495680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3627:1876039508774400:0@lo:400:kworker.0 00000100:00100000:3.0:1789130901.077648:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130901.077673:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8496580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508774912:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789130901.077700:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130901.077739:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8496940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508773504:0@lo:400:kworker.0 00000100:00100000:3.0:1789130901.077768:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130901.077784:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8497c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3625:1876039508774016:0@lo:400:kworker.0 00000100:00100000:3.0:1789130901.077805:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130901.077823:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8494b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3625:1876039508774528:0@lo:400:kworker.0 00000100:00100000:3.0:1789130901.077843:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130901.077856:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1789130901.077861:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3625:1876039508773632:0@lo:400:kworker.0 00000100:00100000:3.0:1789130901.077883:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130901.077894:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc84961c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508774144:0@lo:400:kworker.0 00000100:00100000:3.0:1789130901.077933:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130901.077960:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8497840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508774656:0@lo:400:kworker.0 00000100:00100000:3.0:1789130901.077981:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130901.078021:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508773248 00000100:00100000:3.0:1789130901.078030:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508773248 00000100:00100000:3.0:1789130901.078086:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:3.0:1789130901.078096:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8600c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+24:3627:x1876039508773248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130901.078156:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8600c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+24:3627:x1876039508773248:12345-0@lo:400:kworker.0 Request processed in 60us (966us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130901.078165:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:3.0:1789130901.078207:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508773760 00000100:00100000:3.0:1789130901.078212:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508773760 00000100:00100000:3.0:1789130901.078242:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508773504 00000100:00100000:3.0:1789130901.078246:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508773504 00000100:00100000:3.0:1789130901.078262:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789130901.078269:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8414b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3627:x1876039508773760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130901.078306:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8414b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3627:x1876039508773760:12345-0@lo:400:kworker.0 Request processed in 38us (1013us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130901.078313:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789130901.078327:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789130901.078333:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc843de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508773504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130901.078366:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc843de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508773504:12345-0@lo:400:kworker.0 Request processed in 33us (597us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130901.078372:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789130901.078392:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508774272 00000100:00100000:3.0:1789130901.078395:0:9827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508774272 00000100:00100000:3.0:1789130901.078428:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508774784 00000100:00100000:3.0:1789130901.078431:0:9827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508774784 00000100:00100000:3.0:1789130901.078444:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508774144 00000100:00100000:3.0:1789130901.078447:0:9827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508774144 00000100:00100000:3.0:1789130901.078486:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508774656 00000100:00100000:3.0:1789130901.078489:0:9827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508774656 00000100:00100000:2.0:1789130901.080142:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508773376 00000100:00100000:2.0:1789130901.080154:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508773376 00000100:00100000:2.0:1789130901.080206:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508773888 00000100:00100000:2.0:1789130901.080209:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508773888 00000100:00100000:2.0:1789130901.080227:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508774400 00000100:00100000:2.0:1789130901.080229:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508774400 00000100:00100000:2.0:1789130901.080243:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508774016 00000100:00100000:2.0:1789130901.080246:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508774016 00000100:00100000:2.0:1789130901.080259:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508774528 00000100:00100000:2.0:1789130901.080262:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508774528 00000100:00100000:2.0:1789130901.080273:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508773632 00000100:00100000:2.0:1789130901.080276:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508773632 00000100:00100000:2.0:1789130901.080294:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1789130901.080303:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8414780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1876039508773376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130901.080402:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8414780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1876039508773376:12345-0@lo:400:kworker.0 Request processed in 99us (2952us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130901.080409:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1789130901.080427:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1789130901.080434:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8417840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1876039508773888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130901.080520:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8417840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1876039508773888:12345-0@lo:400:kworker.0 Request processed in 86us (2930us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130901.080526:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1789130901.080538:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1789130901.080544:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8414000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3627:x1876039508774400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130901.080569:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8414000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3627:x1876039508774400:12345-0@lo:400:kworker.0 Request processed in 25us (2921us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130901.080573:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1789130901.080583:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1789130901.080588:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc843e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1876039508774016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130901.080612:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc843e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1876039508774016:12345-0@lo:400:kworker.0 Request processed in 24us (2806us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130901.080617:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1789130901.080626:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1789130901.080631:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc843f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1876039508774528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130901.080666:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc843f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1876039508774528:12345-0@lo:400:kworker.0 Request processed in 35us (2822us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130901.080672:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1789130901.080683:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1789130901.080689:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc843e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1876039508773632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130901.080716:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc843e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1876039508773632:12345-0@lo:400:kworker.0 Request processed in 28us (2833us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130901.080722:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1789130901.081063:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789130901.081083:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01a5da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508775040:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789130901.081136:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130901.081358:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789130901.081368:0:9827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc84161c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3627:x1876039508774272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130901.081412:0:9827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc84161c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3627:x1876039508774272:12345-0@lo:400:kworker.0 Request processed in 46us (4069us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130901.081418:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789130901.081433:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789130901.081440:0:9827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8416940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3627:x1876039508774784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130901.081487:0:9827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8416940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3627:x1876039508774784:12345-0@lo:400:kworker.0 Request processed in 48us (4102us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130901.081609:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789130901.081623:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789130901.081629:0:9827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7c7bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508774144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130901.081672:0:9827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7c7bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508774144:12345-0@lo:400:kworker.0 Request processed in 43us (3738us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130901.081678:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789130901.081690:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789130901.081696:0:9827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7c7a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508774656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130901.081724:0:9827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7c7a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508774656:12345-0@lo:400:kworker.0 Request processed in 28us (3741us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130901.081730:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789130901.081763:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508774912 00000100:00100000:3.0:1789130901.081769:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508774912 00000100:00100000:3.0:1789130901.081790:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508775040 00000100:00100000:3.0:1789130901.081793:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508775040 00000100:00100000:3.0:1789130901.081804:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789130901.081810:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc843cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508774912:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789130901.081835:0:8419:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789130901.081866:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc843cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508774912:12345-0@lo:13:osp-pre-1-1.0 Request processed in 56us (4166us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130901.081873:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789130901.081884:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789130901.081890:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc845fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508775040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789130901.081899:0:8419:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789130901.082038:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc845fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508775040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 148us (902us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130901.082052:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:3.0:1789130901.082084:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789130901.082089:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789130901.082091:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789130901.082093:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789130901.082130:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3625:1876039508773632:0@lo:400:kworker.0 00010000:00080000:3.0:1789130901.082146:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc84961c0 x1876039508774144/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789130917 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130901.082158:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc84961c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508774144:0@lo:400:kworker.0 00010000:00080000:3.0:1789130901.082247:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc8497840 x1876039508774656/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789130917 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130901.082259:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8497840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508774656:0@lo:400:kworker.0 00000100:00100000:3.0:1789130901.082276:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8496940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508773504:0@lo:400:kworker.0 00010000:00080000:3.0:1789130901.082288:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc8497c00 x1876039508774016/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130917 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130901.082297:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8497c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3625:1876039508774016:0@lo:400:kworker.0 00010000:00080000:3.0:1789130901.082308:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc8494b40 x1876039508774528/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130917 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130901.082315:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8494b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3625:1876039508774528:0@lo:400:kworker.0 00000100:00100000:3.0:1789130901.082364:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc84970c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3627:1876039508773376:0@lo:400:kworker.0 00000100:00100000:3.0:1789130901.082377:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8496d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3627:1876039508773888:0@lo:400:kworker.0 00000100:00100000:3.0:1789130901.082389:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8495680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3627:1876039508774400:0@lo:400:kworker.0 00010000:00080000:3.0:1789130901.082408:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc8496580 x1876039508774912/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789130917 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130901.082423:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8496580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508774912:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789130901.082765:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8495a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3627:1876039508773248:0@lo:400:kworker.0 00000100:00100000:3.0:1789130901.082779:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8494780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1876039508773760:0@lo:400:kworker.0 00010000:00080000:3.0:1789130901.082791:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc8494f00 x1876039508774272/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789130917 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130901.082799:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8494f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1876039508774272:0@lo:400:kworker.0 00010000:00080000:3.0:1789130901.082809:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc8495e00 x1876039508774784/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789130917 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130901.082817:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8495e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1876039508774784:0@lo:400:kworker.0 00010000:00080000:0.0:1789130901.089493:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91de01a5da40 x1876039508775040/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789130917 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789130901.089538:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01a5da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508775040:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789130901.394637:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789130901.587782:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc5fea1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508775168:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789130901.587894:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130901.588790:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508775168 00000100:00100000:3.0:1789130901.588803:0:8418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508775168 00000100:00100000:3.0:1789130901.588865:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789130901.588877:0:8418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc5febc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508775168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789130901.588916:0:8418:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789130901.589001:0:8418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc5febc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508775168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 125us (1107us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130901.589010:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:1.0:1789130901.589071:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc5fea1c0 x1876039508775168/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789130917 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789130901.589096:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc5fea1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508775168:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789130902.097915:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789130902.097941:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7c78f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1876039508775296:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789130902.098016:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130902.098060:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508775296 00000100:00100000:3.0:1789130902.098068:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508775296 00000100:00100000:3.0:1789130902.098115:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789130902.098124:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01a5da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1876039508775296:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789130902.098152:0:8419:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789130902.098196:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01a5da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1876039508775296:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130902.098203:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:3.0:1789130902.098239:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc7c78f00 x1876039508775296/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789130918 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130902.098257:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7c78f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1876039508775296:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1789130902.419583:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789130902.876873:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789130902.876921:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789130902.876994:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498214144 00000100:00100000:3.0:1789130902.877005:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498214144 00000100:00100000:3.0:1789130902.877073:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 127 00000100:00100000:3.0:1789130902.877084:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7891e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+5:2388:x1876039498214144:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1789130902.877154:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7891e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+5:2388:x1876039498214144:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 71us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130902.877162:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 127 00000100:00080000:2.0:1789130902.877272:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789130902.877326:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498213888 00000100:00100000:1.0:1789130902.877330:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498213888 00000100:00100000:1.0:1789130902.877377:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 289 00000100:00100000:1.0:1789130902.877385:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8601050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+10:2388:x1876039498213888:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1789130902.877411:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8601050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+10:2388:x1876039498213888:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 28us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130902.877418:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 289 00000100:00100000:2.0:1789130902.877968:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789130902.878029:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498214016 00000100:00100000:3.0:1789130902.878034:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498214016 00000100:00100000:3.0:1789130902.878082:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 128 00000100:00100000:3.0:1789130902.878089:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7893480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+6:2388:x1876039498214016:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1789130902.878129:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7893480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+6:2388:x1876039498214016:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 41us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130902.878136:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 128 00000100:00080000:2.0:1789130902.878324:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789130903.441634:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789130904.146016:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789130904.146038:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc5fe83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1876039508775424:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789130904.146105:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130904.146169:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508775424 00000100:00100000:1.0:1789130904.146176:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508775424 00000100:00100000:1.0:1789130904.146222:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1789130904.146231:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc5fea1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3627:x1876039508775424:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789130904.146268:0:6506:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789130904.146337:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc5fea1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3627:x1876039508775424:12345-0@lo:41:osp-pre-1-0.0 Request processed in 107us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130904.146345:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1789130904.146393:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc5fe83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1876039508775424:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789130904.149756:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc78930c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508775552:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789130904.149839:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130904.150813:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508775552 00000100:00100000:3.0:1789130904.150824:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508775552 00000100:00100000:3.0:1789130904.150886:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789130904.150896:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddf5c3d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508775552:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789130904.150939:0:6505:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789130904.151003:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddf5c3d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508775552:12345-0@lo:41:osp-pre-0-1.0 Request processed in 109us (1163us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130904.151010:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1789130904.151982:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc78930c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508775552:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1789130904.465973:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130905.489703:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789130906.195889:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7c78f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1876039508775680:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789130906.195960:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130906.196029:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508775680 00000100:00100000:3.0:1789130906.196038:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508775680 00000100:00100000:3.0:1789130906.196086:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789130906.196095:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7c79680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1876039508775680:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789130906.196121:0:8419:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789130906.196163:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7c79680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1876039508775680:12345-0@lo:13:osp-pre-1-1.0 Request processed in 69us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130906.196171:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:3.0:1789130906.196191:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789130906.196216:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc7c78f00 x1876039508775680/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789130922 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130906.196232:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7c78f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1876039508775680:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789130906.200071:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7890f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3628:1876039508775936:0@lo:400:kworker.0 00000100:00100000:2.0:1789130906.200140:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130906.200183:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7893840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3628:1876039508776448:0@lo:400:kworker.0 00000100:00100000:2.0:1789130906.200206:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130906.200227:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7816d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3628:1876039508776960:0@lo:400:kworker.0 00000100:00100000:2.0:1789130906.200248:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130906.200275:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1789130906.200281:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7892d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3628:1876039508775808:0@lo:400:kworker.0 00000100:00100000:2.0:1789130906.200309:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130906.200329:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc78930c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1876039508776320:0@lo:400:kworker.0 00000100:00100000:2.0:1789130906.200674:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130906.200736:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7817480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1876039508776832:0@lo:400:kworker.0 00000100:00100000:2.0:1789130906.200794:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130906.200846:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7891a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508776064:0@lo:400:kworker.0 00000100:00100000:2.0:1789130906.200873:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130906.200896:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc78921c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3625:1876039508776576:0@lo:400:kworker.0 00000100:00100000:3.0:1789130906.201153:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508776832 00000100:00100000:3.0:1789130906.201163:0:9827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508776832 00000100:00100000:2.0:1789130906.202112:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130906.202183:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc78143c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3625:1876039508777088:0@lo:400:kworker.0 00000100:00100000:2.0:1789130906.202221:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130906.202249:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1789130906.202257:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7890b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3625:1876039508776192:0@lo:400:kworker.0 00000100:00100000:2.0:1789130906.202281:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130906.202293:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7893c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508776704:0@lo:400:kworker.0 00000100:00100000:2.0:1789130906.202319:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130906.202343:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7814f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508777216:0@lo:400:kworker.0 00000100:00100000:2.0:1789130906.202370:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130906.202432:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508775936 00000100:00100000:2.0:1789130906.202440:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508775936 00000100:00100000:0.0:1789130906.202543:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc845cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1876039508777344:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789130906.202602:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130906.202665:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508777344 00000100:00100000:0.0:1789130906.202671:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508777344 00000100:00100000:3.0:1789130906.202993:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508776704 00000100:00100000:3.0:1789130906.202998:0:9827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508776704 00000100:00100000:3.0:1789130906.203023:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508777216 00000100:00100000:3.0:1789130906.203026:0:9827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508777216 00000100:00100000:3.0:1789130906.203042:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789130906.203050:0:9827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7815a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3628:x1876039508776832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130906.204323:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508776448 00000100:00100000:2.0:1789130906.204343:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508776448 00000100:00100000:2.0:1789130906.204370:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508776960 00000100:00100000:2.0:1789130906.204373:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508776960 00000100:00100000:2.0:1789130906.204387:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508776576 00000100:00100000:2.0:1789130906.204390:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508776576 00000100:00100000:2.0:1789130906.204403:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508777088 00000100:00100000:2.0:1789130906.204406:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508777088 00000100:00100000:2.0:1789130906.204416:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508776192 00000100:00100000:2.0:1789130906.204419:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508776192 00000100:00100000:2.0:1789130906.204438:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1789130906.204450:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc78152c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1876039508775936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130906.204563:0:9827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7815a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3628:x1876039508776832:12345-0@lo:400:kworker.0 Request processed in 1509us (3764us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130906.204574:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789130906.204608:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789130906.204630:0:9827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7d98780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508776704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130906.204651:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc78152c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1876039508775936:12345-0@lo:400:kworker.0 Request processed in 201us (4509us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130906.204662:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1789130906.204683:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1789130906.204691:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7817c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3628:x1876039508776448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130906.204754:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7817c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3628:x1876039508776448:12345-0@lo:400:kworker.0 Request processed in 65us (4547us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130906.204760:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1789130906.204773:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1789130906.204779:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7815e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3628:x1876039508776960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130906.204806:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7815e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3628:x1876039508776960:12345-0@lo:400:kworker.0 Request processed in 27us (4557us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130906.204811:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1789130906.204822:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1789130906.204828:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7d9bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1876039508776576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130906.205110:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789130906.205118:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc845d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3627:x1876039508777344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789130906.205136:0:8419:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789130906.205189:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc845d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3627:x1876039508777344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (2587us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130906.205196:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:0.0:1789130906.205255:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc845cf00 x1876039508777344/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789130922 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789130906.205274:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc845cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1876039508777344:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1789130906.205326:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc7817480 x1876039508776832/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789130922 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789130906.205336:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7817480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1876039508776832:0@lo:400:kworker.0 00000100:00100000:0.0:1789130906.205350:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7890f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3628:1876039508775936:0@lo:400:kworker.0 00000100:00100000:0.0:1789130906.205362:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7893840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3628:1876039508776448:0@lo:400:kworker.0 00000100:00100000:0.0:1789130906.205374:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7816d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3628:1876039508776960:0@lo:400:kworker.0 00000100:00100000:3.0:1789130906.206017:0:9827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7d98780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508776704:12345-0@lo:400:kworker.0 Request processed in 1398us (3693us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130906.206026:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789130906.206051:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789130906.206059:0:9827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7d992c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3625:x1876039508777216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130906.208571:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7d9bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1876039508776576:12345-0@lo:400:kworker.0 Request processed in 3730us (6456us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130906.208588:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1789130906.208644:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1789130906.208662:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7d98b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1876039508777088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130906.208747:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7d98b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1876039508777088:12345-0@lo:400:kworker.0 Request processed in 95us (6526us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130906.208753:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1789130906.208764:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1789130906.208771:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7d98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1876039508776192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130906.208797:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7d98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1876039508776192:12345-0@lo:400:kworker.0 Request processed in 28us (6516us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130906.208802:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1789130906.208851:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508775808 00000100:00100000:2.0:1789130906.208860:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508775808 00000100:00100000:2.0:1789130906.208934:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:2.0:1789130906.208941:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8603450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+24:3628:x1876039508775808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130906.208981:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8603450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+24:3628:x1876039508775808:12345-0@lo:400:kworker.0 Request processed in 41us (8671us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130906.208987:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:2.0:1789130906.209024:0:11069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508776320 00000100:00100000:2.0:1789130906.209028:0:11069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508776320 00000100:00100000:2.0:1789130906.209056:0:11069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508776064 00000100:00100000:2.0:1789130906.209059:0:11069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508776064 00000100:00100000:2.0:1789130906.209072:0:11069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789130906.209081:0:11069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7816580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3628:x1876039508776320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130906.209116:0:11069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7816580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3628:x1876039508776320:12345-0@lo:400:kworker.0 Request processed in 38us (8451us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130906.209122:0:11069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789130906.209134:0:11069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789130906.209141:0:11069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7815680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508776064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130906.209180:0:11069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7815680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508776064:12345-0@lo:400:kworker.0 Request processed in 40us (8305us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130906.209186:0:11069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1789130906.212539:0:9827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7d992c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3625:x1876039508777216:12345-0@lo:400:kworker.0 Request processed in 6472us (10158us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130906.212552:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:3.0:1789130906.212594:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789130906.212599:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789130906.212602:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789130906.212607:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789130906.212749:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7890b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3625:1876039508776192:0@lo:400:kworker.0 00010000:00080000:2.0:1789130906.212772:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc7893c00 x1876039508776704/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789130922 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789130906.212784:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7893c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508776704:0@lo:400:kworker.0 00010000:00080000:2.0:1789130906.212796:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc7814f00 x1876039508777216/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789130922 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789130906.212837:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7814f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508777216:0@lo:400:kworker.0 00000100:00100000:2.0:1789130906.212853:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7891a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508776064:0@lo:400:kworker.0 00010000:00080000:2.0:1789130906.212865:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc78921c0 x1876039508776576/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130922 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789130906.212874:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc78921c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3625:1876039508776576:0@lo:400:kworker.0 00010000:00080000:2.0:1789130906.212886:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc78143c0 x1876039508777088/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130922 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789130906.212893:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc78143c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3625:1876039508777088:0@lo:400:kworker.0 00000100:00100000:0.0:1789130906.214159:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7892d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3628:1876039508775808:0@lo:400:kworker.0 00000100:00100000:0.0:1789130906.214189:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc78930c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1876039508776320:0@lo:400:kworker.0 00010000:00010000:0.0:1789130906.513628:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789130906.705881:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789130906.705912:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc5fe92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1876039508777472:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789130906.706010:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130906.706096:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508777472 00000100:00100000:1.0:1789130906.706106:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508777472 00000100:00100000:1.0:1789130906.706168:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789130906.706178:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc5fe83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1876039508777472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789130906.706220:0:8419:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789130906.706283:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc5fe83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1876039508777472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130906.706292:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00080000:1.0:1789130906.706340:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc5fe92c0 x1876039508777472/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789130922 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789130906.706362:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc5fe92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1876039508777472:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789130907.224731:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7c78b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508777600:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789130907.224831:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130907.225293:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508777600 00000100:00100000:3.0:1789130907.225304:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508777600 00000100:00100000:3.0:1789130907.225379:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789130907.225392:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc845cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508777600:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789130907.225423:0:8419:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789130907.225513:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc845cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508777600:12345-0@lo:13:osp-pre-0-1.0 Request processed in 123us (682us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130907.225521:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:3.0:1789130907.225571:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc7c78b40 x1876039508777600/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789130923 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130907.225623:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7c78b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508777600:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1789130907.537846:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789130907.997748:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789130907.997800:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789130907.997853:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789130907.998122:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498214528 00000100:00100000:2.0:1789130907.998136:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498214528 00000100:00100000:2.0:1789130907.998228:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498214400 00000100:00100000:2.0:1789130907.998232:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498214400 00000100:00100000:2.0:1789130907.998263:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 135 00000100:00100000:2.0:1789130907.998277:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc5fe92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+5:2385:x1876039498214528:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1789130907.998383:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc5fe92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+5:2385:x1876039498214528:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 109us (582us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130907.998393:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 135 00000100:00100000:2.0:1789130907.998415:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 136 00000100:00100000:2.0:1789130907.998423:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc5feb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+6:2385:x1876039498214400:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1789130907.998452:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc5feb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+6:2385:x1876039498214400:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 30us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130907.998500:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 136 00000100:00100000:3.0:1789130907.999296:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498214272 00000100:00100000:3.0:1789130907.999307:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498214272 00000100:00100000:3.0:1789130907.999365:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 291 00000100:00100000:3.0:1789130907.999374:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddf5cc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+10:2385:x1876039498214272:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1789130907.999444:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddf5cc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+10:2385:x1876039498214272:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 72us (1712us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130907.999452:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 291 00000100:00080000:1.0:1789130907.999776:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789130907.999796:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1789130908.564322:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789130909.266369:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc5fea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508777728:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789130909.266507:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130909.266716:0:11069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508777728 00000100:00100000:2.0:1789130909.266726:0:11069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508777728 00000100:00100000:2.0:1789130909.266784:0:11069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789130909.266807:0:11069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc5feb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508777728:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789130909.266857:0:11069:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789130909.266919:0:11069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc5feb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508777728:12345-0@lo:41:osp-pre-1-0.0 Request processed in 115us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130909.266928:0:11069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789130909.266952:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789130909.266962:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7d9b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1876039508777856:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789130909.266991:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130909.267024:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508777856 00000100:00100000:2.0:1789130909.267028:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508777856 00000100:00100000:2.0:1789130909.267053:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1789130909.267060:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7d9a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3628:x1876039508777856:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789130909.267081:0:6505:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789130909.267254:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7d9a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3628:x1876039508777856:12345-0@lo:41:osp-pre-0-1.0 Request processed in 193us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130909.267261:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1789130909.267311:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7d9b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1876039508777856:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789130909.267346:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc5fea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508777728:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789130909.585675:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789130909.659796:0:11979:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 08:48:27 (1789130907) === 00000100:00100000:1.0:1789130910.106726:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789130910.109885:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498214656 00000100:00100000:2.0:1789130910.109908:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498214656 00000100:00100000:2.0:1789130910.110013:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 292 00000100:00100000:2.0:1789130910.110026:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddf5cc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+10:8716:x1876039498214656:12345-192.168.203.11@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789130910.110066:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130910.110091:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91dcc7e36400/0xf3fe2838e1fc2282 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269876 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130910.110127:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91dcc7e36400/0xf3fe2838e1fc2282 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269876 expref: 11 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130910.110140:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91dcc7e36400/0xf3fe2838e1fc2282 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269876 expref: 11 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130910.110151:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dcc7e36400, rc 0) 00000100:00100000:2.0:1789130910.110241:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddf5cc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+11:8716:x1876039498214656:12345-192.168.203.11@tcp:101:mount.lustre.0 Request processed in 217us (3530us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130910.110249:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 292 00000100:00100000:0.0:1789130910.118905:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789130910.118992:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498214784 00000100:00100000:2.0:1789130910.119006:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498214784 00000100:00100000:2.0:1789130910.119081:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 293 00000100:00100000:2.0:1789130910.119094:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddf5cc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+11:8716:x1876039498214784:12345-192.168.203.11@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789130910.119324:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddf5cc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+11:8716:x1876039498214784:12345-192.168.203.11@tcp:501:mount.lustre.0 Request processed in 232us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130910.119334:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 293 00000100:00100000:0.0:1789130910.131893:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789130910.132181:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498214912 00000100:00100000:3.0:1789130910.132195:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498214912 00000100:00100000:2.0:1789130910.132557:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 294 00000100:00100000:2.0:1789130910.132574:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddf5cc6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+11:8716:x1876039498214912:12345-192.168.203.11@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789130910.132793:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddf5cc6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+11:8716:x1876039498214912:12345-192.168.203.11@tcp:503:mount.lustre.0 Request processed in 223us (912us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130910.133145:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 294 00000100:00100000:3.0:1789130910.139975:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789130910.140160:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498215040 00000100:00100000:1.0:1789130910.140173:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498215040 00000100:00100000:1.0:1789130910.140247:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 295 00000100:00100000:1.0:1789130910.140260:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddf5cc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+11:8720:x1876039498215040:12345-192.168.203.11@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789130910.140508:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddf5cc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+11:8720:x1876039498215040:12345-192.168.203.11@tcp:502:llog_process_th.0 Request processed in 248us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130910.140516:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 295 00000100:00100000:0.0:1789130910.174104:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789130910.174446:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498215168 00000100:00100000:3.0:1789130910.174487:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498215168 00000100:00100000:3.0:1789130910.174565:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 296 00000100:00100000:3.0:1789130910.174595:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddf5cc4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+11:8720:x1876039498215168:12345-192.168.203.11@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789130910.174804:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddf5cc4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+11:8720:x1876039498215168:12345-192.168.203.11@tcp:502:llog_process_th.0 Request processed in 227us (714us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130910.174813:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 296 00000100:00100000:0.0:1789130910.181879:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789130910.182318:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498215296 00000100:00100000:2.0:1789130910.182331:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498215296 00000100:00100000:2.0:1789130910.182402:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 297 00000100:00100000:2.0:1789130910.182415:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddf5cc5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+11:8720:x1876039498215296:12345-192.168.203.11@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789130910.183318:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddf5cc5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+11:8720:x1876039498215296:12345-192.168.203.11@tcp:502:llog_process_th.0 Request processed in 897us (1445us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130910.183332:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 297 00000100:00100000:0.0:1789130910.204224:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789130910.204410:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498215424 00000100:00100000:1.0:1789130910.204424:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498215424 00000100:00100000:1.0:1789130910.204728:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 298 00000100:00100000:1.0:1789130910.204742:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddf5cc7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+11:8716:x1876039498215424:12345-192.168.203.11@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789130910.204764:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130910.204789:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91dde19ab400/0xf3fe2838e1fc2289 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf8eae2996d2698a7 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130910.204899:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91dde19ab400/0xf3fe2838e1fc2289 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d2698a7 expref: 12 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130910.204914:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91dde19ab400/0xf3fe2838e1fc2289 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d2698a7 expref: 12 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130910.204927:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dde19ab400, rc 0) 00000100:00100000:1.0:1789130910.205064:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddf5cc7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+12:8716:x1876039498215424:12345-192.168.203.11@tcp:101:mount.lustre.0 Request processed in 323us (969us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130910.205091:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 298 00000100:00100000:1.0:1789130910.209983:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789130910.210096:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498215552 00000100:00100000:3.0:1789130910.210120:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498215552 00000100:00100000:3.0:1789130910.210194:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 299 00000100:00100000:3.0:1789130910.210207:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddf5cc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+12:8716:x1876039498215552:12345-192.168.203.11@tcp:256:mount.lustre.0 20000000:01000000:3.0:1789130910.210244:0:6492:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1789130910.210290:0:6492:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1789130910.210301:0:6492:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1789130910.210305:0:6492:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1789130910.210308:0:6492:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1789130910.210312:0:6492:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:3.0:1789130910.215311:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddf5cc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+12:8716:x1876039498215552:12345-192.168.203.11@tcp:256:mount.lustre.0 Request processed in 5089us (5342us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130910.215331:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 299 00000100:00100000:0.0:1789130910.234373:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789130910.234524:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498215680 00000100:00100000:2.0:1789130910.234538:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498215680 00000100:00100000:2.0:1789130910.234621:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 300 00000100:00100000:2.0:1789130910.234634:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddf5cc6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+12:8716:x1876039498215680:12345-192.168.203.11@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789130910.234657:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130910.234683:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91dcc7e36600/0xf3fe2838e1fc2290 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xf8eae2996d2698ae expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130910.234719:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91dcc7e36600/0xf3fe2838e1fc2290 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d2698ae expref: 13 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130910.234731:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91dcc7e36600/0xf3fe2838e1fc2290 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d2698ae expref: 13 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130910.234742:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dcc7e36600, rc 0) 00000100:00100000:2.0:1789130910.235027:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddf5cc6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+13:8716:x1876039498215680:12345-192.168.203.11@tcp:101:mount.lustre.0 Request processed in 394us (668us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130910.235036:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 300 00000100:00100000:1.0:1789130910.237760:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789130910.237938:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498215808 00000100:00100000:3.0:1789130910.237952:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498215808 00000100:00100000:3.0:1789130910.238025:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 301 00000100:00100000:3.0:1789130910.238036:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddf5cc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+13:8716:x1876039498215808:12345-192.168.203.11@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789130910.238247:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddf5cc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+13:8716:x1876039498215808:12345-192.168.203.11@tcp:501:mount.lustre.0 Request processed in 211us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130910.238257:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 301 00000100:00100000:0.0:1789130910.241820:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789130910.242000:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498215936 00000100:00100000:2.0:1789130910.242013:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498215936 00000100:00100000:2.0:1789130910.242109:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 302 00000100:00100000:2.0:1789130910.242121:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddf5cc4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+13:8716:x1876039498215936:12345-192.168.203.11@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789130910.242316:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddf5cc4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+13:8716:x1876039498215936:12345-192.168.203.11@tcp:503:mount.lustre.0 Request processed in 197us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130910.242324:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 302 00000100:00100000:0.0:1789130910.247102:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789130910.247898:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498216064 00000100:00100000:1.0:1789130910.247913:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498216064 00000100:00100000:1.0:1789130910.248232:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 303 00000100:00100000:1.0:1789130910.248245:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddf5cc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+13:8723:x1876039498216064:12345-192.168.203.11@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789130910.248444:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddf5cc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+13:8723:x1876039498216064:12345-192.168.203.11@tcp:502:llog_process_th.0 Request processed in 202us (1358us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130910.248453:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 303 00000100:00100000:3.0:1789130910.251689:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789130910.259599:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498216192 00000100:00100000:2.0:1789130910.259624:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498216192 00000100:00100000:2.0:1789130910.259726:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 304 00000100:00100000:2.0:1789130910.259740:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddf5cc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+13:8723:x1876039498216192:12345-192.168.203.11@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789130910.260100:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddf5cc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+13:8723:x1876039498216192:12345-192.168.203.11@tcp:502:llog_process_th.0 Request processed in 360us (8424us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130910.260179:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 304 00000100:00100000:0.0:1789130910.270182:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789130910.270231:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789130910.270269:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789130910.270309:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789130910.270345:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498216960 00000100:00100000:0.0:1789130910.270357:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498216960 00000100:00100000:0.0:1789130910.270430:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498216320 00000100:00100000:0.0:1789130910.270434:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498216320 00000100:00100000:0.0:1789130910.270444:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498216576 00000100:00100000:0.0:1789130910.270446:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498216576 00000100:00100000:0.0:1789130910.270453:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498217088 00000100:00100000:0.0:1789130910.270455:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498217088 00000100:00100000:0.0:1789130910.270519:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 137 00000100:00100000:0.0:1789130910.270532:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc845de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+6:2387:x1876039498216960:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1789130910.270644:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc845de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+6:2387:x1876039498216960:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 114us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130910.270653:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 137 00000100:00100000:0.0:1789130910.270675:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 138 00000100:00100000:0.0:1789130910.270682:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc845c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+5:2388:x1876039498217088:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1789130910.270709:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc845c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+5:2388:x1876039498217088:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 27us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130910.270716:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 138 00000100:00100000:0.0:1789130910.270728:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 16 00000100:00100000:0.0:1789130910.270733:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc845f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2384:x1876039498216320:12345-192.168.203.11@tcp:38:mount.lustre.0 00010000:00080000:0.0:1789130910.270759:0:6501:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from fde8d4a8-44db-4e6b-8249-c1c295e4901d@192.168.203.11@tcp t0 exp 0000000000000000 cur 266 last 0 00000020:00000080:0.0:1789130910.270820:0:6501:0:(genops.c:1385:class_connect()) connect: client fde8d4a8-44db-4e6b-8249-c1c295e4901d, cookie 0xf3fe2838e1fc2297 00000004:00100000:0.0:1789130910.270873:0:6501:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return 37 00000100:00080000:0.0:1789130910.271031:0:6501:0:(import.c:65:import_set_state_nolock()) ffff91dcc78a2000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789130910.271068:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc845f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fde8d4a8-44db-4e6b-8249-c1c295e4901d+6:2384:x1876039498216320:12345-192.168.203.11@tcp:38:mount.lustre.0 Request processed in 333us (836us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130910.271076:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 16 00000100:00100000:0.0:1789130910.271093:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 17 00000100:00100000:0.0:1789130910.271098:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc845d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2384:x1876039498216576:12345-192.168.203.11@tcp:38:mount.lustre.0 00010000:00080000:0.0:1789130910.271114:0:6501:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0001: connection from fde8d4a8-44db-4e6b-8249-c1c295e4901d@192.168.203.11@tcp t0 exp 0000000000000000 cur 266 last 0 00000020:00000080:0.0:1789130910.271138:0:6501:0:(genops.c:1385:class_connect()) connect: client fde8d4a8-44db-4e6b-8249-c1c295e4901d, cookie 0xf3fe2838e1fc229e 00000004:00100000:0.0:1789130910.271153:0:6501:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return 37 00000100:00080000:0.0:1789130910.271217:0:6501:0:(import.c:65:import_set_state_nolock()) ffff91dcc78a5000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789130910.271243:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc845d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fde8d4a8-44db-4e6b-8249-c1c295e4901d+6:2384:x1876039498216576:12345-192.168.203.11@tcp:38:mount.lustre.0 Request processed in 143us (973us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130910.271251:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 17 00000100:00080000:1.0:1789130910.271437:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789130910.271443:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789130910.277860:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789130910.277904:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789130910.278003:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498216704 00000100:00100000:1.0:1789130910.278015:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498216704 00000100:00100000:1.0:1789130910.278093:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498216448 00000100:00100000:1.0:1789130910.278096:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498216448 00000100:00100000:1.0:1789130910.278136:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 18 00000100:00100000:1.0:1789130910.278148:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7c78b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fde8d4a8-44db-4e6b-8249-c1c295e4901d+6:0:x1876039498216704:12345-192.168.203.11@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789130910.278199:0:9769:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789130910.278317:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7c78b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fde8d4a8-44db-4e6b-8249-c1c295e4901d+6:0:x1876039498216704:12345-192.168.203.11@tcp:41:mount.lustre.0 Request processed in 171us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130910.278325:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 18 00000100:00100000:1.0:1789130910.278343:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 19 00000100:00100000:1.0:1789130910.278349:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7c7b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fde8d4a8-44db-4e6b-8249-c1c295e4901d+6:0:x1876039498216448:12345-192.168.203.11@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789130910.278366:0:9769:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789130910.278419:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7c7b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fde8d4a8-44db-4e6b-8249-c1c295e4901d+6:0:x1876039498216448:12345-192.168.203.11@tcp:41:mount.lustre.0 Request processed in 70us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130910.278426:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 19 00000100:00080000:2.0:1789130910.278834:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789130910.278840:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789130910.280289:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789130910.280452:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498216832 00000100:00100000:1.0:1789130910.280494:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498216832 00000100:00100000:1.0:1789130910.280571:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 20 00000100:00100000:1.0:1789130910.280583:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7c79e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fde8d4a8-44db-4e6b-8249-c1c295e4901d+6:8716:x1876039498216832:12345-192.168.203.11@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789130910.280632:0:9769:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789130910.280715:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7c79e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fde8d4a8-44db-4e6b-8249-c1c295e4901d+6:8716:x1876039498216832:12345-192.168.203.11@tcp:41:mount.lustre.0 Request processed in 134us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130910.280724:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 20 00000100:00100000:1.0:1789130910.284655:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789130910.284809:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498217216 00000100:00100000:3.0:1789130910.284822:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498217216 00000100:00100000:3.0:1789130910.284899:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 21 00000100:00100000:3.0:1789130910.284912:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc5fea1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fde8d4a8-44db-4e6b-8249-c1c295e4901d+6:8716:x1876039498217216:12345-192.168.203.11@tcp:40:mount.lustre.0 00000100:00100000:3.0:1789130910.285035:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc5fea1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fde8d4a8-44db-4e6b-8249-c1c295e4901d+6:8716:x1876039498217216:12345-192.168.203.11@tcp:40:mount.lustre.0 Request processed in 126us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130910.285044:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 21 00000100:00100000:3.0:1789130910.288649:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789130910.288702:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789130910.288846:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498217600 00000100:00100000:2.0:1789130910.288864:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498217600 00000100:00100000:2.0:1789130910.288945:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 5 00000100:00100000:2.0:1789130910.288957:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7c7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:fde8d4a8-44db-4e6b-8249-c1c295e4901d+6:8716:x1876039498217600:12345-192.168.203.11@tcp:900:mount.lustre.0 00000100:00100000:2.0:1789130910.289070:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7c7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:fde8d4a8-44db-4e6b-8249-c1c295e4901d+6:8716:x1876039498217600:12345-192.168.203.11@tcp:900:mount.lustre.0 Request processed in 115us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130910.289080:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 5 00000100:00100000:2.0:1789130910.290417:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789130910.295336:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789130910.295525:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498217728 00000100:00100000:1.0:1789130910.295538:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498217728 00000100:00100000:1.0:1789130910.295617:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1 00000100:00100000:1.0:1789130910.295632:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddca0fb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fde8d4a8-44db-4e6b-8249-c1c295e4901d+6:8716:x1876039498217728:12345-192.168.203.11@tcp:33:mount.lustre.0 00000004:00200000:1.0:1789130910.295756:0:6503:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1789130910.295875:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddca0fb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fde8d4a8-44db-4e6b-8249-c1c295e4901d+6:8716:x1876039498217728:12345-192.168.203.11@tcp:33:mount.lustre.0 Request processed in 246us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130910.295885:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1 00000100:00100000:0.0:1789130910.299272:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498217344 00000100:00100000:0.0:1789130910.299295:0:9827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498217344 00000100:00100000:0.0:1789130910.299432:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498217472 00000100:00100000:0.0:1789130910.299437:0:9827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498217472 00000100:00100000:1.0:1789130910.299500:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 20 00000100:00100000:1.0:1789130910.299512:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7c792c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2384:x1876039498217344:12345-192.168.203.11@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789130910.299558:0:8416:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from fde8d4a8-44db-4e6b-8249-c1c295e4901d@192.168.203.11@tcp t0 exp 0000000000000000 cur 266 last 0 00000020:00000080:1.0:1789130910.299617:0:8416:0:(genops.c:1385:class_connect()) connect: client fde8d4a8-44db-4e6b-8249-c1c295e4901d, cookie 0xf3fe2838e1fc22a5 00002000:00100000:1.0:1789130910.299633:0:8416:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli fde8d4a8-44db-4e6b-8249-c1c295e4901d/ffff91de01a7a000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113984 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789130910.299674:0:8416:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return 37 00002000:00080000:1.0:1789130910.299791:0:8416:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789130910.299838:0:8416:0:(import.c:65:import_set_state_nolock()) ffff91de01a7e000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789130910.299934:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7c792c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fde8d4a8-44db-4e6b-8249-c1c295e4901d+6:2384:x1876039498217344:12345-192.168.203.11@tcp:8:mount.lustre.0 Request processed in 422us (11230us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130910.299942:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 20 00000100:00100000:1.0:1789130910.299966:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 21 00000100:00100000:1.0:1789130910.299971:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7d9b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2384:x1876039498217472:12345-192.168.203.11@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789130910.299991:0:8416:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from fde8d4a8-44db-4e6b-8249-c1c295e4901d@192.168.203.11@tcp t0 exp 0000000000000000 cur 266 last 0 00000020:00000080:1.0:1789130910.300015:0:8416:0:(genops.c:1385:class_connect()) connect: client fde8d4a8-44db-4e6b-8249-c1c295e4901d, cookie 0xf3fe2838e1fc22ac 00002000:00100000:1.0:1789130910.300022:0:8416:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli fde8d4a8-44db-4e6b-8249-c1c295e4901d/ffff91de01a7c000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113984 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789130910.300034:0:8416:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return 37 00002000:00080000:1.0:1789130910.300075:0:8416:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789130910.300091:0:8416:0:(import.c:65:import_set_state_nolock()) ffff91de01a7f800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789130910.300117:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7d9b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fde8d4a8-44db-4e6b-8249-c1c295e4901d+6:2384:x1876039498217472:12345-192.168.203.11@tcp:8:mount.lustre.0 Request processed in 144us (9708us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130910.300124:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 21 00010000:00010000:1.0:1789130910.610166:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789130911.313702:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789130911.313728:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7c783c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508777984:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789130911.313813:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130911.313979:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508777984 00000100:00100000:3.0:1789130911.313988:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508777984 00000100:00100000:3.0:1789130911.314061:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789130911.314071:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc5fe8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508777984:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789130911.314098:0:8419:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789130911.314142:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc5fe8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508777984:12345-0@lo:13:osp-pre-1-1.0 Request processed in 73us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130911.314149:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:1.0:1789130911.314904:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789130911.314923:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7c7b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508778368:0@lo:400:kworker.0 00000100:00100000:1.0:1789130911.314974:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130911.314996:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7c7ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3627:1876039508778880:0@lo:400:kworker.0 00000100:00100000:1.0:1789130911.315036:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130911.315056:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddca1830c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3627:1876039508779392:0@lo:400:kworker.0 00000100:00100000:1.0:1789130911.315077:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1789130911.315116:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc7c783c0 x1876039508777984/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789130927 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789130911.315137:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7c783c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508777984:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789130911.315155:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1789130911.315160:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7c7a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3627:1876039508778496:0@lo:400:kworker.0 00000100:00100000:1.0:1789130911.315192:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130911.315214:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7c78f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508779008:0@lo:400:kworker.0 00000100:00100000:1.0:1789130911.315243:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130911.315267:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddca1812c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1876039508779520:0@lo:400:kworker.0 00000100:00100000:1.0:1789130911.315289:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130911.315319:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508778880 00000100:00100000:1.0:1789130911.315324:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508778880 00000100:00100000:1.0:1789130911.315379:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508779392 00000100:00100000:1.0:1789130911.315383:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508779392 00000100:00100000:1.0:1789130911.315398:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508778496 00000100:00100000:1.0:1789130911.315400:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508778496 00000100:00100000:1.0:1789130911.315413:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1789130911.315420:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7ffc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1876039508778880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130911.315486:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7ffc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1876039508778880:12345-0@lo:400:kworker.0 Request processed in 66us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130911.315494:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1789130911.315510:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1789130911.315517:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7ffda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3627:x1876039508779392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130911.315565:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7ffda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3627:x1876039508779392:12345-0@lo:400:kworker.0 Request processed in 49us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130911.315571:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1789130911.315599:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1789130911.315605:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7fff840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1876039508778496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130911.315629:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7fff840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1876039508778496:12345-0@lo:400:kworker.0 Request processed in 25us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130911.315635:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1789130911.315660:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508779008 00000100:00100000:1.0:1789130911.315663:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508779008 00000100:00100000:1.0:1789130911.315692:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508779520 00000100:00100000:1.0:1789130911.315696:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508779520 00000100:00100000:1.0:1789130911.315717:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789130911.315724:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7ffed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508779008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130911.315754:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7ffed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508779008:12345-0@lo:400:kworker.0 Request processed in 30us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130911.315760:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789130911.315772:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789130911.315778:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7c783c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3627:x1876039508779520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130911.315803:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7c783c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3627:x1876039508779520:12345-0@lo:400:kworker.0 Request processed in 26us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130911.315809:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:1.0:1789130911.315835:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789130911.315838:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789130911.315985:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508778368 00000100:00100000:3.0:1789130911.315990:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508778368 00000100:00100000:3.0:1789130911.316018:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789130911.316025:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc5fea940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508778368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130911.316060:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc5fea940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508778368:12345-0@lo:400:kworker.0 Request processed in 36us (1092us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130911.316067:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00080000:1.0:1789130911.316111:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789130911.316138:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7c7a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3627:1876039508778496:0@lo:400:kworker.0 00010000:00080000:1.0:1789130911.316161:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc7c78f00 x1876039508779008/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789130927 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789130911.316170:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7c78f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508779008:0@lo:400:kworker.0 00010000:00080000:1.0:1789130911.316181:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91ddca1812c0 x1876039508779520/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789130927 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789130911.316188:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddca1812c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1876039508779520:0@lo:400:kworker.0 00000100:00100000:1.0:1789130911.316197:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7c7b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508778368:0@lo:400:kworker.0 00010000:00080000:1.0:1789130911.316206:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc7c7ad00 x1876039508778880/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130927 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789130911.316212:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7c7ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3627:1876039508778880:0@lo:400:kworker.0 00010000:00080000:1.0:1789130911.316221:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91ddca1830c0 x1876039508779392/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130927 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789130911.316227:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddca1830c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3627:1876039508779392:0@lo:400:kworker.0 00000100:00100000:2.0:1789130911.316331:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7c7a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3625:1876039508778112:0@lo:400:kworker.0 00000100:00100000:2.0:1789130911.316370:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130911.316411:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7c78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508778624:0@lo:400:kworker.0 00000100:00100000:2.0:1789130911.316437:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130911.316455:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddca0c6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508779136:0@lo:400:kworker.0 00000100:00100000:2.0:1789130911.316498:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130911.316518:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1789130911.316524:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7c79a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3625:1876039508778240:0@lo:400:kworker.0 00000100:00100000:2.0:1789130911.316547:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130911.316565:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7c78780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3625:1876039508778752:0@lo:400:kworker.0 00000100:00100000:2.0:1789130911.316597:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130911.316615:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddca0c4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3625:1876039508779264:0@lo:400:kworker.0 00000100:00100000:2.0:1789130911.316635:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130911.316666:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508778624 00000100:00100000:2.0:1789130911.316670:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508778624 00000100:00100000:2.0:1789130911.316693:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1789130911.316699:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddca0fa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1876039508778624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130911.316735:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddca0fa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1876039508778624:12345-0@lo:400:kworker.0 Request processed in 36us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130911.316742:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1789130911.316763:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508778240 00000100:00100000:2.0:1789130911.316766:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508778240 00000100:00100000:2.0:1789130911.316784:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508778752 00000100:00100000:2.0:1789130911.316787:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508778752 00000100:00100000:2.0:1789130911.316803:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508779264 00000100:00100000:2.0:1789130911.316806:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508779264 00000100:00100000:2.0:1789130911.316818:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1789130911.316823:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddca0f83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1876039508778240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130911.316853:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddca0f83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1876039508778240:12345-0@lo:400:kworker.0 Request processed in 29us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130911.316866:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1789130911.316879:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1789130911.316884:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddca0fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1876039508778752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130911.316914:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddca0fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1876039508778752:12345-0@lo:400:kworker.0 Request processed in 30us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130911.316920:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1789130911.316931:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1789130911.316937:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddca0f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1876039508779264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130911.316963:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddca0f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1876039508779264:12345-0@lo:400:kworker.0 Request processed in 27us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130911.316969:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1789130911.316995:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508779136 00000100:00100000:2.0:1789130911.316999:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508779136 00000100:00100000:2.0:1789130911.317021:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789130911.317027:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddca0f8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1876039508779136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130911.317056:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddca0f8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1876039508779136:12345-0@lo:400:kworker.0 Request processed in 29us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130911.317062:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789130911.317089:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7c79a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3625:1876039508778240:0@lo:400:kworker.0 00000100:00100000:2.0:1789130911.317100:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7c78780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3625:1876039508778752:0@lo:400:kworker.0 00000100:00100000:2.0:1789130911.317109:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddca0c4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3625:1876039508779264:0@lo:400:kworker.0 00000100:00100000:2.0:1789130911.317117:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7c78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508778624:0@lo:400:kworker.0 00010000:00080000:2.0:1789130911.317126:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91ddca0c6580 x1876039508779136/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789130927 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789130911.317143:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddca0c6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508779136:0@lo:400:kworker.0 00000100:00100000:3.0:1789130911.317231:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508778112 00000100:00100000:3.0:1789130911.317235:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508778112 00000100:00100000:3.0:1789130911.317271:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:3.0:1789130911.317278:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddf5cc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+24:3625:x1876039508778112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130911.317317:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddf5cc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+24:3625:x1876039508778112:12345-0@lo:400:kworker.0 Request processed in 40us (947us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130911.317323:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:3.0:1789130911.317359:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7c7a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3625:1876039508778112:0@lo:400:kworker.0 00000100:00080000:1.0:1789130911.317538:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789130911.317543:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789130911.323509:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddca0fb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508779648:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789130911.323598:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130911.324391:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508779648 00000100:00100000:3.0:1789130911.324400:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508779648 00000100:00100000:3.0:1789130911.324494:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789130911.324504:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc845da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1876039508779648:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789130911.324557:0:8419:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789130911.324627:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc845da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1876039508779648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 125us (1028us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130911.324642:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:3.0:1789130911.324684:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91ddca0fb0c0 x1876039508779648/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789130927 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130911.324708:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddca0fb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508779648:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789130911.633693:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789130911.827637:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddca0fbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508779776:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789130911.827710:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130911.827786:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508779776 00000100:00100000:2.0:1789130911.828324:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508779776 00000100:00100000:2.0:1789130911.828380:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789130911.828390:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddca0fb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508779776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789130911.828419:0:8419:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789130911.828498:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddca0fb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508779776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (787us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130911.828506:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00010000:00080000:2.0:1789130911.828548:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91ddca0fbc00 x1876039508779776/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789130927 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789130911.828568:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddca0fbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508779776:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789130912.342901:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddca0fbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508779904:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789130912.342971:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130912.343286:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508779904 00000100:00100000:2.0:1789130912.343294:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508779904 00000100:00100000:2.0:1789130912.343346:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789130912.343356:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7c7ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508779904:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789130912.343383:0:8419:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789130912.343497:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7c7ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508779904:12345-0@lo:13:osp-pre-0-1.0 Request processed in 142us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130912.343505:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:1.0:1789130912.345317:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91ddca0fbc00 x1876039508779904/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789130928 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789130912.345343:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddca0fbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508779904:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1789130912.658608:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130913.684368:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789130914.387574:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddca0fbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1876039508780032:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789130914.387681:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130914.387739:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789130914.387768:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7c78f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508780160:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789130914.387777:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508780032 00000100:00100000:3.0:1789130914.387783:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508780032 00000100:00100000:0.0:1789130914.387796:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130914.387835:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508780160 00000100:00100000:3.0:1789130914.387838:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508780160 00000100:00100000:0.0:1789130914.387840:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789130914.387850:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddca1821c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3628:x1876039508780032:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789130914.387853:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789130914.387858:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc845c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508780160:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789130914.387888:0:6506:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000004:00000024:0.0:1789130914.387888:0:6505:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789130914.387931:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddca1821c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3628:x1876039508780032:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130914.387932:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc845c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508780160:12345-0@lo:41:osp-pre-1-0.0 Request processed in 74us (135us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130914.387938:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789130914.388166:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddca0fbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1876039508780032:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789130914.388210:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7c78f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508780160:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789130914.390509:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00010000:00010000:2.0:1789130914.705739:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789130915.678332:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789130915.678418:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789130915.678453:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789130915.678516:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789130915.678535:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789130915.678561:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789130915.678587:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789130915.678828:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498218112 00000100:00100000:2.0:1789130915.678837:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498218112 00000100:00100000:2.0:1789130915.678896:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498218368 00000100:00100000:2.0:1789130915.678899:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498218368 00000100:00100000:2.0:1789130915.678917:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498217984 00000100:00100000:2.0:1789130915.678919:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498217984 00000100:00100000:2.0:1789130915.678933:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498218240 00000100:00100000:2.0:1789130915.678935:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498218240 00000100:00100000:2.0:1789130915.678955:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 145 00000100:00100000:2.0:1789130915.678968:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc845e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+5:2387:x1876039498218112:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1789130915.679049:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc845e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+5:2387:x1876039498218112:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 84us (630us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130915.679057:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 145 00000100:00100000:2.0:1789130915.679074:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 146 00000100:00100000:2.0:1789130915.679080:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc845c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fde8d4a8-44db-4e6b-8249-c1c295e4901d+6:2387:x1876039498218368:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1789130915.679119:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc845c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fde8d4a8-44db-4e6b-8249-c1c295e4901d+6:2387:x1876039498218368:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 38us (665us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130915.679126:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 146 00000100:00100000:2.0:1789130915.679140:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 147 00000100:00100000:2.0:1789130915.679146:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc845e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+6:2387:x1876039498217984:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1789130915.679185:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc845e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+6:2387:x1876039498217984:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 39us (649us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130915.679192:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 147 00000100:00100000:2.0:1789130915.679204:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 148 00000100:00100000:2.0:1789130915.679213:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc845f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fde8d4a8-44db-4e6b-8249-c1c295e4901d+6:2387:x1876039498218240:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1789130915.679238:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc845f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fde8d4a8-44db-4e6b-8249-c1c295e4901d+6:2387:x1876039498218240:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 27us (686us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130915.679254:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 148 00000100:00100000:1.0:1789130915.680941:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498218624 00000100:00100000:1.0:1789130915.680953:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498218624 00000100:00100000:1.0:1789130915.681009:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498218496 00000100:00100000:1.0:1789130915.681012:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498218496 00000100:00100000:1.0:1789130915.681043:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 58 00000100:00100000:1.0:1789130915.681053:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc845f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fde8d4a8-44db-4e6b-8249-c1c295e4901d+6:2387:x1876039498218624:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1789130915.681075:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 59 00000100:00100000:2.0:1789130915.681087:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc845cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fde8d4a8-44db-4e6b-8249-c1c295e4901d+6:2387:x1876039498218496:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1789130915.681106:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc845f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fde8d4a8-44db-4e6b-8249-c1c295e4901d+6:2387:x1876039498218624:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 54us (2589us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130915.681114:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 58 00000100:00100000:2.0:1789130915.681125:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc845cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fde8d4a8-44db-4e6b-8249-c1c295e4901d+6:2387:x1876039498218496:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 39us (2535us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130915.681133:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 59 00000100:00080000:1.0:1789130915.681146:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789130915.681152:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789130915.681155:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789130915.681158:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789130915.682360:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498217856 00000100:00100000:3.0:1789130915.682369:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498217856 00000100:00100000:3.0:1789130915.682418:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 306 00000100:00100000:3.0:1789130915.682426:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddf5cc4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+13:2387:x1876039498217856:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1789130915.682506:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddf5cc4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+13:2387:x1876039498217856:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 80us (4184us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130915.682528:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 306 00010000:00010000:0.0:1789130915.730311:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789130915.938068:0:9493:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of fde8d4a8-44db-4e6b-8249-c1c295e4901d 00000001:00100000:0.0:1789130915.939065:0:8410:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of fde8d4a8-44db-4e6b-8249-c1c295e4901d 00000001:00100000:1.0:1789130915.939100:0:6479:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of fde8d4a8-44db-4e6b-8249-c1c295e4901d 00000001:00100000:2.0:1789130915.940808:0:7432:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of fde8d4a8-44db-4e6b-8249-c1c295e4901d 00000001:02000400:1.0:1789130916.210933:0:12172:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg311-client.virtnet: executing check_config_client /mnt/lustre 00000100:00100000:1.0:1789130916.434748:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7c7a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1876039508780288:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789130916.434815:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130916.435416:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508780288 00000100:00100000:2.0:1789130916.435424:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508780288 00000100:00100000:2.0:1789130916.435487:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789130916.435497:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7c7b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1876039508780288:12345-0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1789130916.435594:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:2.0:1789130916.435649:0:8419:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789130916.435709:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7c7b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1876039508780288:12345-0@lo:13:osp-pre-1-1.0 Request processed in 214us (895us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130916.435717:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00080000:1.0:1789130916.435813:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc7c7a940 x1876039508780288/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789130932 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789130916.435830:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7c7a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1876039508780288:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789130916.436188:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7c7a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3628:1876039508780544:0@lo:400:kworker.0 00000100:00100000:1.0:1789130916.436221:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130916.436290:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7c78f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3628:1876039508781056:0@lo:400:kworker.0 00000100:00100000:1.0:1789130916.436316:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130916.436333:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff7c0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3628:1876039508781568:0@lo:400:kworker.0 00000100:00100000:1.0:1789130916.436355:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130916.436383:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1789130916.436390:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7c7a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3628:1876039508780416:0@lo:400:kworker.0 00000100:00100000:1.0:1789130916.436414:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130916.436436:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7c79a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1876039508780928:0@lo:400:kworker.0 00000100:00100000:1.0:1789130916.436479:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130916.436497:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff7c0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1876039508781440:0@lo:400:kworker.0 00000100:00100000:1.0:1789130916.436531:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130916.436567:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508780544 00000100:00100000:1.0:1789130916.436572:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508780544 00000100:00100000:1.0:1789130916.436598:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508781056 00000100:00100000:1.0:1789130916.436600:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508781056 00000100:00100000:1.0:1789130916.436617:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508781568 00000100:00100000:1.0:1789130916.436619:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508781568 00000100:00100000:1.0:1789130916.436633:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1789130916.436639:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7ad0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1876039508780544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130916.436675:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7ad0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1876039508780544:12345-0@lo:400:kworker.0 Request processed in 36us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130916.436682:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1789130916.436695:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1789130916.436702:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7ad0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3628:x1876039508781056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130916.436725:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7ad0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3628:x1876039508781056:12345-0@lo:400:kworker.0 Request processed in 25us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130916.436740:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1789130916.436752:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1789130916.436758:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7ad3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3628:x1876039508781568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130916.436781:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7ad3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3628:x1876039508781568:12345-0@lo:400:kworker.0 Request processed in 24us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130916.436787:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1789130916.436807:0:11069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508780928 00000100:00100000:1.0:1789130916.436810:0:11069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508780928 00000100:00100000:1.0:1789130916.436830:0:11069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789130916.436836:0:11069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7ad12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3628:x1876039508780928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130916.436863:0:11069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7ad12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3628:x1876039508780928:12345-0@lo:400:kworker.0 Request processed in 27us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130916.436868:0:11069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789130916.436884:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508781440 00000100:00100000:1.0:1789130916.436887:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508781440 00000100:00100000:1.0:1789130916.436909:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789130916.436914:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7ad2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3628:x1876039508781440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130916.436940:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7ad2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3628:x1876039508781440:12345-0@lo:400:kworker.0 Request processed in 26us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130916.436946:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:1.0:1789130916.436964:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789130916.436968:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789130916.436977:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7c78780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3626:1876039508780800:0@lo:400:kworker.0 00000100:00100000:1.0:1789130916.436998:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130916.437013:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff7c1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1876039508781312:0@lo:400:kworker.0 00000100:00100000:1.0:1789130916.437031:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130916.437056:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7ad2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508781824:0@lo:400:kworker.0 00000100:00100000:1.0:1789130916.437078:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130916.437096:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1789130916.437101:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7c78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1876039508780672:0@lo:400:kworker.0 00000100:00100000:1.0:1789130916.437121:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130916.437134:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff7c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3626:1876039508781184:0@lo:400:kworker.0 00000100:00100000:1.0:1789130916.437152:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130916.437164:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7ad30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3626:1876039508781696:0@lo:400:kworker.0 00000100:00100000:1.0:1789130916.437183:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130916.437202:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508781312 00000100:00100000:1.0:1789130916.437205:0:9827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508781312 00000100:00100000:1.0:1789130916.437227:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508781824 00000100:00100000:1.0:1789130916.437230:0:9827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508781824 00000100:00100000:1.0:1789130916.437247:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789130916.437252:0:9827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7ad1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3626:x1876039508781312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130916.437285:0:9827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7ad1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3626:x1876039508781312:12345-0@lo:400:kworker.0 Request processed in 33us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130916.437291:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789130916.437304:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789130916.437309:0:9827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7ad21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508781824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130916.437334:0:9827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7ad21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508781824:12345-0@lo:400:kworker.0 Request processed in 25us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130916.437339:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789130916.437356:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508780800 00000100:00100000:1.0:1789130916.437359:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508780800 00000100:00100000:1.0:1789130916.437373:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508781184 00000100:00100000:1.0:1789130916.437375:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508781184 00000100:00100000:1.0:1789130916.437394:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508781696 00000100:00100000:1.0:1789130916.437396:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508781696 00000100:00100000:1.0:1789130916.437408:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1789130916.437413:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7ad03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1876039508780800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130916.437441:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7ad03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1876039508780800:12345-0@lo:400:kworker.0 Request processed in 27us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130916.437447:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1789130916.437477:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1789130916.437484:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7ad2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1876039508781184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130916.437508:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7ad2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1876039508781184:12345-0@lo:400:kworker.0 Request processed in 26us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130916.437514:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1789130916.437524:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1789130916.437529:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7ad0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1876039508781696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130916.437564:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7ad0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1876039508781696:12345-0@lo:400:kworker.0 Request processed in 34us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130916.437570:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00080000:1.0:1789130916.437585:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789130916.437589:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789130916.437591:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789130916.437616:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7c79a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1876039508780928:0@lo:400:kworker.0 00010000:00080000:1.0:1789130916.437627:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91ddff7c0f00 x1876039508781440/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789130932 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789130916.437637:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff7c0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1876039508781440:0@lo:400:kworker.0 00000100:00100000:1.0:1789130916.437647:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7c7a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3628:1876039508780544:0@lo:400:kworker.0 00000100:00100000:1.0:1789130916.437667:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7c78f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3628:1876039508781056:0@lo:400:kworker.0 00000100:00100000:1.0:1789130916.437677:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff7c0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3628:1876039508781568:0@lo:400:kworker.0 00010000:00080000:1.0:1789130916.437710:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91ddff7c3480 x1876039508781184/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130932 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789130916.437720:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff7c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3626:1876039508781184:0@lo:400:kworker.0 00010000:00080000:1.0:1789130916.437729:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc7ad30c0 x1876039508781696/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130932 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789130916.437737:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7ad30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3626:1876039508781696:0@lo:400:kworker.0 00000100:00100000:1.0:1789130916.437746:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7c78780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3626:1876039508780800:0@lo:400:kworker.0 00010000:00080000:1.0:1789130916.437754:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91ddff7c1a40 x1876039508781312/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789130932 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789130916.437763:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff7c1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1876039508781312:0@lo:400:kworker.0 00010000:00080000:1.0:1789130916.437771:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc7ad2d00 x1876039508781824/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789130932 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789130916.437779:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7ad2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508781824:0@lo:400:kworker.0 00000100:00100000:0.0:1789130916.437989:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc845e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1876039508781952:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789130916.438022:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130916.438056:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508780672 00000100:00100000:0.0:1789130916.438059:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508780672 00000100:00100000:0.0:1789130916.438087:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789130916.438094:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7ad0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1876039508780672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130916.438132:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7ad0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1876039508780672:12345-0@lo:400:kworker.0 Request processed in 39us (1010us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130916.438139:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789130916.438155:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508781952 00000100:00100000:0.0:1789130916.438158:0:8418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508781952 00000100:00100000:0.0:1789130916.438178:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789130916.438184:0:8418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc845ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1876039508781952:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789130916.438207:0:8418:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789130916.438240:0:8418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc845ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1876039508781952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 56us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130916.438247:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00080000:0.0:1789130916.438274:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc845e1c0 x1876039508781952/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789130932 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789130916.438287:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc845e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1876039508781952:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789130916.438316:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7c78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1876039508780672:0@lo:400:kworker.0 00000100:00100000:0.0:1789130916.438638:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508780416 00000100:00100000:0.0:1789130916.438643:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508780416 00000100:00100000:0.0:1789130916.438673:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:0.0:1789130916.438681:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddcf4fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+24:3628:x1876039508780416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130916.438724:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddcf4fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+24:3628:x1876039508780416:12345-0@lo:400:kworker.0 Request processed in 44us (2309us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130916.438732:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:1.0:1789130916.438957:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7c7a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3628:1876039508780416:0@lo:400:kworker.0 00010000:00010000:1.0:1789130916.753759:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789130916.951550:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7ad30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1876039508782080:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789130916.951675:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130916.951768:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508782080 00000100:00100000:1.0:1789130916.951776:0:8418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508782080 00000100:00100000:1.0:1789130916.951830:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789130916.951839:0:8418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddffe0f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1876039508782080:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789130916.951870:0:8418:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789130916.951913:0:8418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddffe0f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1876039508782080:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130916.951920:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00010000:00080000:1.0:1789130916.952130:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc7ad30c0 x1876039508782080/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789130932 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789130916.952148:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7ad30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1876039508782080:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789130917.458700:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789130917.458725:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7ad30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1876039508782208:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789130917.458795:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130917.458905:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508782208 00000100:00100000:1.0:1789130917.458913:0:8418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508782208 00000100:00100000:1.0:1789130917.458966:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789130917.458985:0:8418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddca181a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1876039508782208:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789130917.459006:0:8418:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789130917.459050:0:8418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddca181a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1876039508782208:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130917.459057:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00010000:00080000:3.0:1789130917.459192:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc7ad30c0 x1876039508782208/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789130933 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130917.459211:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7ad30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1876039508782208:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1789130917.781009:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130918.801672:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789130919.505864:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7ad2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1876039508782336:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789130919.505974:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130919.506544:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508782336 00000100:00100000:0.0:1789130919.506556:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508782336 00000100:00100000:0.0:1789130919.506615:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789130919.506625:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddca0fb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1876039508782336:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789130919.506671:0:6505:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789130919.506746:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789130919.506760:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc845cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1876039508782464:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789130919.506803:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130919.506941:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508782464 00000100:00100000:0.0:1789130919.506946:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddca0fb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1876039508782336:12345-0@lo:41:osp-pre-0-1.0 Request processed in 312us (962us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130919.506950:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508782464 00000100:00100000:0.0:1789130919.506963:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789130919.507237:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789130919.507247:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddca0fbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3628:x1876039508782464:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789130919.507271:0:6506:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789130919.507350:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7ad2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1876039508782336:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789130919.507432:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddca0fbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3628:x1876039508782464:12345-0@lo:41:osp-pre-1-0.0 Request processed in 117us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130919.507441:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789130919.507600:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc845cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1876039508782464:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1789130919.829368:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789130920.799769:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789130920.799816:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789130920.799838:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789130920.799856:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789130920.799874:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789130920.799891:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789130920.799914:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789130920.799994:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498219008 00000100:00100000:0.0:1789130920.800015:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498219008 00000100:00100000:0.0:1789130920.800086:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498219264 00000100:00100000:0.0:1789130920.800090:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498219264 00000100:00100000:0.0:1789130920.800105:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498218880 00000100:00100000:0.0:1789130920.800108:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498218880 00000100:00100000:0.0:1789130920.800142:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498219136 00000100:00100000:0.0:1789130920.800145:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498219136 00000100:00100000:0.0:1789130920.800167:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 155 00000100:00100000:0.0:1789130920.800177:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddca1812c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+5:2386:x1876039498219008:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1789130920.800261:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddca1812c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+5:2386:x1876039498219008:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 84us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130920.800269:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 155 00000100:00100000:0.0:1789130920.800285:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 156 00000100:00100000:0.0:1789130920.800291:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddca180b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fde8d4a8-44db-4e6b-8249-c1c295e4901d+5:2386:x1876039498219264:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1789130920.800315:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddca180b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fde8d4a8-44db-4e6b-8249-c1c295e4901d+5:2386:x1876039498219264:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 24us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130920.800321:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 156 00000100:00100000:0.0:1789130920.800331:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 157 00000100:00100000:0.0:1789130920.800338:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddca22b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+6:2386:x1876039498218880:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1789130920.800361:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddca22b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+6:2386:x1876039498218880:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 23us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130920.800367:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 157 00000100:00100000:0.0:1789130920.800377:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 158 00000100:00100000:0.0:1789130920.800384:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddca22b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fde8d4a8-44db-4e6b-8249-c1c295e4901d+5:2386:x1876039498219136:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1789130920.800406:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddca22b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fde8d4a8-44db-4e6b-8249-c1c295e4901d+5:2386:x1876039498219136:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 23us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130920.800419:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 158 00000100:00080000:3.0:1789130920.800686:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789130920.800690:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789130920.800783:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498218752 00000100:00100000:1.0:1789130920.800788:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498218752 00000100:00100000:1.0:1789130920.800826:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 308 00000100:00100000:1.0:1789130920.800833:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddcf4fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+13:2386:x1876039498218752:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1789130920.800860:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddcf4fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+13:2386:x1876039498218752:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 28us (1109us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130920.800875:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 308 00000100:00100000:1.0:1789130920.800913:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498219520 00000100:00100000:1.0:1789130920.800917:0:9827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498219520 00000100:00100000:1.0:1789130920.800953:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498219392 00000100:00100000:1.0:1789130920.800957:0:9827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498219392 00000100:00100000:1.0:1789130920.800979:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 63 00000100:00100000:1.0:1789130920.800985:0:9827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddca22ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fde8d4a8-44db-4e6b-8249-c1c295e4901d+5:2386:x1876039498219520:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1789130920.801011:0:9827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddca22ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fde8d4a8-44db-4e6b-8249-c1c295e4901d+5:2386:x1876039498219520:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 26us (1153us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130920.801018:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 63 00000100:00100000:1.0:1789130920.801030:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 64 00000100:00100000:1.0:1789130920.801038:0:9827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddca228000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fde8d4a8-44db-4e6b-8249-c1c295e4901d+5:2386:x1876039498219392:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1789130920.801060:0:9827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddca228000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fde8d4a8-44db-4e6b-8249-c1c295e4901d+5:2386:x1876039498219392:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 22us (1145us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130920.801065:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 64 00000100:00080000:3.0:1789130920.801312:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789130920.801322:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1789130920.850135:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789130921.553964:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7ad30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1876039508782592:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789130921.554027:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130921.554105:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508782592 00000100:00100000:1.0:1789130921.554111:0:8418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508782592 00000100:00100000:1.0:1789130921.554165:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789130921.554295:0:8418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7ad2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1876039508782592:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789130921.554325:0:8418:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789130921.554369:0:8418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7ad2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1876039508782592:12345-0@lo:13:osp-pre-1-1.0 Request processed in 196us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130921.554376:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:1.0:1789130921.554406:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789130921.554435:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc7ad30c0 x1876039508782592/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789130937 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789130921.554453:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7ad30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1876039508782592:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789130921.555058:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddca229680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3626:1876039508782848:0@lo:400:kworker.0 00000100:00100000:3.0:1789130921.555166:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130921.555257:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddca229a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3626:1876039508783360:0@lo:400:kworker.0 00000100:00100000:3.0:1789130921.555280:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130921.555293:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc6bef0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3626:1876039508783872:0@lo:400:kworker.0 00000100:00100000:3.0:1789130921.555311:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130921.555325:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1789130921.555330:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddca228b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3626:1876039508782720:0@lo:400:kworker.0 00000100:00100000:3.0:1789130921.555353:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130921.555375:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddca22a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508783232:0@lo:400:kworker.0 00000100:00100000:3.0:1789130921.555398:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130921.555414:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc6becf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508783744:0@lo:400:kworker.0 00000100:00100000:3.0:1789130921.555437:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130921.555482:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508782720 00000100:00100000:3.0:1789130921.555487:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508782720 00000100:00100000:3.0:1789130921.555529:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:3.0:1789130921.555536:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddcf4fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+24:3626:x1876039508782720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130921.555574:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddcf4fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+24:3626:x1876039508782720:12345-0@lo:400:kworker.0 Request processed in 38us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130921.555581:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:3.0:1789130921.555616:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddca228b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3626:1876039508782720:0@lo:400:kworker.0 00000100:00100000:3.0:1789130921.555648:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508782848 00000100:00100000:3.0:1789130921.555651:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508782848 00000100:00100000:3.0:1789130921.555671:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508783360 00000100:00100000:3.0:1789130921.555673:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508783360 00000100:00100000:0.0:1789130921.555861:0:11069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508783232 00000100:00100000:0.0:1789130921.555866:0:11069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508783232 00000100:00100000:0.0:1789130921.555891:0:11069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789130921.555897:0:11069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc6bee940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508783232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130921.555944:0:11069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc6bee940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508783232:12345-0@lo:400:kworker.0 Request processed in 47us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130921.555951:0:11069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789130921.556211:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc845da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508784256:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789130921.556242:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130921.556271:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508783872 00000100:00100000:1.0:1789130921.556275:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508783872 00000100:00100000:1.0:1789130921.556294:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1789130921.556300:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc6bed2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1876039508782848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130921.556330:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc6bed2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1876039508782848:12345-0@lo:400:kworker.0 Request processed in 30us (1165us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130921.556337:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1789130921.556349:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1789130921.556355:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc6bef840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1876039508783872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130921.556380:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc6bef840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1876039508783872:12345-0@lo:400:kworker.0 Request processed in 26us (1069us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130921.556385:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1789130921.556407:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508783744 00000100:00100000:1.0:1789130921.556410:0:9827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508783744 00000100:00100000:1.0:1789130921.556434:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789130921.556441:0:9827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7b24b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508783744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130921.556484:0:9827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7b24b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508783744:12345-0@lo:400:kworker.0 Request processed in 44us (1047us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130921.556491:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789130921.556528:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddca228f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508782976:0@lo:400:kworker.0 00000100:00100000:1.0:1789130921.556561:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130921.556579:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc6bee1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3627:1876039508783488:0@lo:400:kworker.0 00000100:00100000:1.0:1789130921.556598:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130921.556612:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc6bed680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3627:1876039508784000:0@lo:400:kworker.0 00000100:00100000:1.0:1789130921.556630:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130921.556645:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1789130921.556650:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddca22a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3627:1876039508783104:0@lo:400:kworker.0 00000100:00100000:1.0:1789130921.556670:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130921.556683:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc6befc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508783616:0@lo:400:kworker.0 00000100:00100000:1.0:1789130921.556714:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130921.557040:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508783488 00000100:00100000:3.0:1789130921.557044:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508783488 00000100:00100000:3.0:1789130921.557058:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508784000 00000100:00100000:3.0:1789130921.557061:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508784000 00000100:00100000:3.0:1789130921.557071:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508783104 00000100:00100000:3.0:1789130921.557074:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508783104 00000100:00100000:1.0:1789130921.557860:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc6bec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1876039508784128:0@lo:400:kworker.0 00000100:00100000:1.0:1789130921.557894:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130921.557927:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508782976 00000100:00100000:1.0:1789130921.557932:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508782976 00000100:00100000:1.0:1789130921.557962:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789130921.557969:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7d99e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508782976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130921.558009:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7d99e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508782976:12345-0@lo:400:kworker.0 Request processed in 41us (1448us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130921.558016:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789130921.558033:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508783616 00000100:00100000:1.0:1789130921.558037:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508783616 00000100:00100000:1.0:1789130921.558056:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508784128 00000100:00100000:1.0:1789130921.558059:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508784128 00000100:00100000:1.0:1789130921.558075:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789130921.558081:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7ffcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508783616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130921.558172:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1789130921.558305:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc6bee580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1876039508783360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130921.558339:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc6bee580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1876039508783360:12345-0@lo:400:kworker.0 Request processed in 39us (3059us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130921.558346:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1789130921.558361:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1789130921.558368:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7d99a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1876039508783488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130921.558395:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7d99a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1876039508783488:12345-0@lo:400:kworker.0 Request processed in 29us (1796us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130921.558400:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1789130921.558411:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1789130921.558417:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7fff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3627:x1876039508784000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130921.558443:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7fff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3627:x1876039508784000:12345-0@lo:400:kworker.0 Request processed in 26us (1812us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130921.558449:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1789130921.558474:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1789130921.558481:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7ffd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1876039508783104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130921.558506:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7ffd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1876039508783104:12345-0@lo:400:kworker.0 Request processed in 26us (1835us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130921.558523:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00080000:3.0:1789130921.558574:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789130921.558585:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789130921.558588:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789130921.558590:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789130921.558607:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508784256 00000100:00100000:3.0:1789130921.558611:0:8418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508784256 00000100:00100000:3.0:1789130921.558635:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789130921.558641:0:8418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7ad30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3625:x1876039508784256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789130921.558657:0:8418:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789130921.558845:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789130921.558855:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7ffc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3627:x1876039508784128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130921.558940:0:8418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7ad30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3625:x1876039508784256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 299us (2697us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130921.558948:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789130921.559009:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddca22a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3627:1876039508783104:0@lo:400:kworker.0 00000100:00100000:3.0:1789130921.559022:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddca228f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508782976:0@lo:400:kworker.0 00010000:00080000:3.0:1789130921.559033:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc6bee1c0 x1876039508783488/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130937 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130921.559044:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc6bee1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3627:1876039508783488:0@lo:400:kworker.0 00010000:00080000:3.0:1789130921.559054:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc6bed680 x1876039508784000/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130937 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130921.559063:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc6bed680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3627:1876039508784000:0@lo:400:kworker.0 00010000:00080000:3.0:1789130921.559122:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc845da40 x1876039508784256/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789130937 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130921.559136:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc845da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508784256:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789130921.559170:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddca22a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508783232:0@lo:400:kworker.0 00010000:00080000:3.0:1789130921.559195:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc6becf00 x1876039508783744/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789130937 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130921.559211:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc6becf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508783744:0@lo:400:kworker.0 00000100:00100000:3.0:1789130921.559225:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddca229680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3626:1876039508782848:0@lo:400:kworker.0 00000100:00100000:3.0:1789130921.559234:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddca229a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3626:1876039508783360:0@lo:400:kworker.0 00000100:00100000:3.0:1789130921.559244:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc6bef0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3626:1876039508783872:0@lo:400:kworker.0 00000100:00100000:2.0:1789130921.559684:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7ffc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3627:x1876039508784128:12345-0@lo:400:kworker.0 Request processed in 829us (1787us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130921.559708:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00080000:3.0:1789130921.559777:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc6bec000 x1876039508784128/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789130937 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130921.559788:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc6bec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1876039508784128:0@lo:400:kworker.0 00000100:00100000:1.0:1789130921.559980:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7ffcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508783616:12345-0@lo:400:kworker.0 Request processed in 1898us (3265us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130921.559993:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00080000:3.0:1789130921.560259:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc6befc00 x1876039508783616/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789130937 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130921.560270:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc6befc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508783616:0@lo:400:kworker.0 00010000:00010000:0.0:1789130921.873572:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789130922.065923:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789130922.065955:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7ffe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508784384:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789130922.066018:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130922.066103:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508784384 00000100:00100000:2.0:1789130922.066112:0:8418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508784384 00000100:00100000:2.0:1789130922.066172:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789130922.066184:0:8418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc5fe8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1876039508784384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789130922.066218:0:8418:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789130922.066292:0:8418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc5fe8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1876039508784384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130922.066300:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00010000:00080000:3.0:1789130922.066835:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc7ffe580 x1876039508784384/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789130938 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130922.066855:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7ffe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508784384:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789130922.581091:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc5fe9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508784512:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789130922.581161:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130922.581297:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508784512 00000100:00100000:2.0:1789130922.581305:0:8418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508784512 00000100:00100000:2.0:1789130922.581351:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789130922.581361:0:8418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7b24f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508784512:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789130922.581384:0:8418:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789130922.581437:0:8418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7b24f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508784512:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130922.581445:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00010000:00080000:3.0:1789130922.581560:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc5fe9a40 x1876039508784512/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789130938 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130922.581840:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc5fe9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508784512:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1789130922.898923:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789130923.658736:0:12487:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789130923.658982:0:12487:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789130923.922685:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789130924.626538:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc5febc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1876039508784640:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789130924.626610:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130924.626669:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508784640 00000100:00100000:1.0:1789130924.626677:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508784640 00000100:00100000:1.0:1789130924.626734:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1789130924.626745:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc845ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3628:x1876039508784640:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789130924.626779:0:6505:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789130924.626846:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc845ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3628:x1876039508784640:12345-0@lo:41:osp-pre-0-1.0 Request processed in 103us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130924.626854:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789130924.627005:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc5febc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1876039508784640:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789130924.627008:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc5fe83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508784768:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789130924.627067:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130924.627635:0:11069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508784768 00000100:00100000:1.0:1789130924.627640:0:11069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508784768 00000100:00100000:1.0:1789130924.627671:0:11069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789130924.627678:0:11069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7b261c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1876039508784768:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789130924.627715:0:11069:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789130924.627764:0:11069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7b261c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1876039508784768:12345-0@lo:41:osp-pre-1-0.0 Request processed in 86us (698us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130924.627772:0:11069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1789130924.627858:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc5fe83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508784768:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789130924.951103:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789130925.775799:0:12584:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789130925.776311:0:12584:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1789130925.926182:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789130925.926221:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789130925.926248:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789130925.926275:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789130925.926296:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789130925.926331:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789130925.926735:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498219776 00000100:00100000:0.0:1789130925.926745:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498219776 00000100:00100000:0.0:1789130925.926797:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498220032 00000100:00100000:0.0:1789130925.926800:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498220032 00000100:00100000:0.0:1789130925.926815:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498219904 00000100:00100000:0.0:1789130925.926817:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498219904 00000100:00100000:0.0:1789130925.926827:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498220160 00000100:00100000:0.0:1789130925.926829:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498220160 00000100:00100000:0.0:1789130925.926844:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 165 00000100:00100000:0.0:1789130925.926852:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc5fe8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+6:2387:x1876039498219776:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1789130925.926922:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc5fe8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+6:2387:x1876039498219776:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 70us (749us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130925.926939:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 165 00000100:00100000:0.0:1789130925.926955:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 166 00000100:00100000:0.0:1789130925.926960:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc5fe9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fde8d4a8-44db-4e6b-8249-c1c295e4901d+5:2387:x1876039498220032:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1789130925.926984:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc5fe9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fde8d4a8-44db-4e6b-8249-c1c295e4901d+5:2387:x1876039498220032:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 24us (763us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130925.926990:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 166 00000100:00100000:1.0:1789130925.927781:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789130925.928079:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 167 00000100:00100000:0.0:1789130925.928095:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc5febc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+5:2387:x1876039498219904:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1789130925.928133:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc5febc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+5:2387:x1876039498219904:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 44us (1835us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130925.928140:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 167 00000100:00100000:0.0:1789130925.928158:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 168 00000100:00100000:0.0:1789130925.928163:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc5fe9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fde8d4a8-44db-4e6b-8249-c1c295e4901d+5:2387:x1876039498220160:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1789130925.928184:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc5fe9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fde8d4a8-44db-4e6b-8249-c1c295e4901d+5:2387:x1876039498220160:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 20us (1853us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130925.928189:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 168 00000100:00080000:0.0:1789130925.928278:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789130925.928282:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789130925.928846:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498220288 00000100:00100000:1.0:1789130925.928853:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498220288 00000100:00100000:1.0:1789130925.928904:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498220416 00000100:00100000:1.0:1789130925.928907:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498220416 00000100:00100000:1.0:1789130925.928931:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 68 00000100:00100000:1.0:1789130925.928938:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc5fe83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fde8d4a8-44db-4e6b-8249-c1c295e4901d+5:2387:x1876039498220288:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1789130925.928976:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc5fe83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fde8d4a8-44db-4e6b-8249-c1c295e4901d+5:2387:x1876039498220288:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 39us (2727us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130925.928982:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 68 00000100:00100000:1.0:1789130925.928994:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 69 00000100:00080000:0.0:1789130925.929657:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789130925.929661:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789130925.930101:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff7c2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fde8d4a8-44db-4e6b-8249-c1c295e4901d+5:2387:x1876039498220416:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1789130925.930150:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff7c2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fde8d4a8-44db-4e6b-8249-c1c295e4901d+5:2387:x1876039498220416:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 1144us (2366us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130925.930157:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 69 00000100:00100000:1.0:1789130925.930188:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498219648 00000100:00100000:1.0:1789130925.930193:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498219648 00000100:00100000:1.0:1789130925.931692:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 310 00000100:00100000:1.0:1789130925.931710:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddcf4f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+13:2387:x1876039498219648:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1789130925.931765:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddcf4f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+13:2387:x1876039498219648:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 61us (5488us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130925.931773:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 310 00010000:00010000:3.0:1789130925.971890:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789130926.676869:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff7c03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1876039508784896:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789130926.676934:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130926.677007:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508784896 00000100:00100000:1.0:1789130926.677013:0:8418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508784896 00000100:00100000:1.0:1789130926.677060:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789130926.677069:0:8418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff7c1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1876039508784896:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789130926.677095:0:8418:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789130926.677139:0:8418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff7c1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1876039508784896:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130926.677146:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:1.0:1789130926.677166:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789130926.677291:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91ddff7c03c0 x1876039508784896/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789130942 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789130926.677308:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff7c03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1876039508784896:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789130926.680897:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7b26940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3627:1876039508785024:0@lo:400:kworker.0 00000100:00100000:3.0:1789130926.680962:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130926.681016:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508785024 00000100:00100000:3.0:1789130926.681021:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508785024 00000100:00100000:3.0:1789130926.681059:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:3.0:1789130926.681066:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddcf4fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+24:3627:x1876039508785024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130926.681107:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddcf4fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+24:3627:x1876039508785024:12345-0@lo:400:kworker.0 Request processed in 41us (145us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130926.681113:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:3.0:1789130926.681155:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7b26940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3627:1876039508785024:0@lo:400:kworker.0 00000100:00100000:3.0:1789130926.681191:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7b26940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3628:1876039508785152:0@lo:400:kworker.0 00000100:00100000:3.0:1789130926.681216:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130926.681245:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508785152 00000100:00100000:3.0:1789130926.681249:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508785152 00000100:00100000:3.0:1789130926.681275:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1789130926.681281:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7b25a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1876039508785152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130926.681328:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7b25a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1876039508785152:12345-0@lo:400:kworker.0 Request processed in 45us (108us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130926.681336:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1789130926.681378:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7ffe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508785280:0@lo:400:kworker.0 00000100:00100000:3.0:1789130926.681406:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130926.681437:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508785280 00000100:00100000:3.0:1789130926.681447:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508785280 00000100:00100000:3.0:1789130926.681714:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1789130926.681722:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc6befc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508785280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130926.681764:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc6befc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508785280:12345-0@lo:400:kworker.0 Request processed in 44us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130926.681770:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1789130926.681801:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7ffe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508785280:0@lo:400:kworker.0 00000100:00100000:3.0:1789130926.681837:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789130926.681844:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc6bec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3625:1876039508785408:0@lo:400:kworker.0 00000100:00100000:3.0:1789130926.681866:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130926.681891:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508785408 00000100:00100000:3.0:1789130926.681895:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508785408 00000100:00100000:2.0:1789130926.681912:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7b26940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3628:1876039508785152:0@lo:400:kworker.0 00000100:00100000:3.0:1789130926.681919:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1789130926.681925:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc6bef0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1876039508785408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130926.681965:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc6bef0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1876039508785408:12345-0@lo:400:kworker.0 Request processed in 40us (99us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130926.681972:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1789130926.682006:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc6becf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1876039508785536:0@lo:400:kworker.0 00000100:00100000:3.0:1789130926.682029:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130926.682055:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508785536 00000100:00100000:3.0:1789130926.682059:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508785536 00000100:00100000:3.0:1789130926.682080:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789130926.682086:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc6bed680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3627:x1876039508785536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130926.682119:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc6bed680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3627:x1876039508785536:12345-0@lo:400:kworker.0 Request processed in 33us (89us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130926.682126:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789130926.682161:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc6becf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1876039508785536:0@lo:400:kworker.0 00000100:00100000:2.0:1789130926.682184:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc6bec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3625:1876039508785408:0@lo:400:kworker.0 00000100:00100000:3.0:1789130926.682188:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789130926.682194:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc6becf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3627:1876039508785664:0@lo:400:kworker.0 00000100:00100000:3.0:1789130926.682217:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130926.682277:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddca229a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1876039508786048:0@lo:400:kworker.0 00000100:00100000:2.0:1789130926.682279:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508785664 00000100:00100000:2.0:1789130926.682283:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508785664 00000100:00100000:3.0:1789130926.682303:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130926.682314:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1789130926.682321:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc6bee1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1876039508785664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130926.682329:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508786048 00000100:00100000:3.0:1789130926.682332:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508786048 00000100:00100000:3.0:1789130926.682358:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789130926.682359:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc6bee1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1876039508785664:12345-0@lo:400:kworker.0 Request processed in 39us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130926.682364:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddca229680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1876039508786048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130926.682371:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1789130926.682397:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddca229680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1876039508786048:12345-0@lo:400:kworker.0 Request processed in 33us (93us total) trans 0 rc 0/0 00010000:00080000:2.0:1789130926.682401:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91ddca229a40 x1876039508786048/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789130942 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130926.682403:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789130926.682411:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddca229a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1876039508786048:0@lo:400:kworker.0 00000100:00100000:2.0:1789130926.682420:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc6becf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3627:1876039508785664:0@lo:400:kworker.0 00000100:00100000:2.0:1789130926.682431:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789130926.682436:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddca22a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3627:1876039508786176:0@lo:400:kworker.0 00000100:00100000:2.0:1789130926.682489:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130926.682518:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508786176 00000100:00100000:2.0:1789130926.682521:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508786176 00000100:00100000:2.0:1789130926.682546:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1789130926.682552:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddca0c6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3627:x1876039508786176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130926.682587:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddca0c6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3627:x1876039508786176:12345-0@lo:400:kworker.0 Request processed in 35us (128us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130926.682593:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1789130926.682618:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddca22a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3627:1876039508786176:0@lo:400:kworker.0 00000100:00100000:0.0:1789130926.682744:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789130926.682753:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc845da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1876039508786560:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789130926.682785:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130926.682813:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508786560 00000100:00100000:0.0:1789130926.682822:0:8418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508786560 00000100:00100000:0.0:1789130926.682853:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789130926.682860:0:8418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc845d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1876039508786560:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789130926.682876:0:8418:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789130926.682909:0:8418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc845d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1876039508786560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 50us (124us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130926.682916:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00080000:0.0:1789130926.682942:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc845da40 x1876039508786560/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789130942 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789130926.682956:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc845da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1876039508786560:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1789130926.683133:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789130926.683138:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789130926.683141:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789130926.683151:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc6bec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3625:1876039508785792:0@lo:400:kworker.0 00000100:00100000:3.0:1789130926.683178:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130926.683202:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddca228f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3625:1876039508786304:0@lo:400:kworker.0 00000100:00100000:3.0:1789130926.683222:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130926.683281:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789130926.683287:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7ffe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508785920:0@lo:400:kworker.0 00000100:00100000:3.0:1789130926.683310:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130926.683327:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddca22a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508786432:0@lo:400:kworker.0 00000100:00100000:3.0:1789130926.683346:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130926.683374:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508785920 00000100:00100000:3.0:1789130926.683385:0:9827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508785920 00000100:00100000:3.0:1789130926.683412:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508786432 00000100:00100000:3.0:1789130926.683415:0:9827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508786432 00000100:00100000:3.0:1789130926.683430:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789130926.683436:0:9827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddca229a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508785920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130926.683560:0:9827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddca229a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508785920:12345-0@lo:400:kworker.0 Request processed in 124us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130926.683567:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789130926.683580:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789130926.683587:0:9827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc6d64f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3625:x1876039508786432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130926.683615:0:9827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc6d64f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3625:x1876039508786432:12345-0@lo:400:kworker.0 Request processed in 29us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130926.683620:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00010000:00080000:3.0:1789130926.683645:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc7ffe580 x1876039508785920/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789130942 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130926.683654:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7ffe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508785920:0@lo:400:kworker.0 00010000:00080000:3.0:1789130926.683662:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91ddca22a1c0 x1876039508786432/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789130942 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130926.683669:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddca22a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508786432:0@lo:400:kworker.0 00000100:00080000:3.0:1789130926.683747:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789130926.690271:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508785792 00000100:00100000:2.0:1789130926.690285:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508785792 00000100:00100000:2.0:1789130926.690343:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508786304 00000100:00100000:2.0:1789130926.690347:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508786304 00000100:00100000:2.0:1789130926.690371:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1789130926.690380:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddca228b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1876039508785792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130926.690452:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1789130926.690608:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddca22a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1876039508786304:12345-0@lo:400:kworker.0 00010000:00080000:0.0:1789130926.692655:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc6bec000 x1876039508785792/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130942 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789130926.692671:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc6bec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3625:1876039508785792:0@lo:400:kworker.0 00000100:00100000:2.0:1789130926.694999:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddca228b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1876039508785792:12345-0@lo:400:kworker.0 Request processed in 4612us (11812us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130926.695012:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00080000:0.0:1789130926.695823:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789130926.696066:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddca22a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1876039508786304:12345-0@lo:400:kworker.0 Request processed in 5603us (12839us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130926.696077:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00010000:00080000:0.0:1789130926.696187:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91ddca228f00 x1876039508786304/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130942 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789130926.696202:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddca228f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3625:1876039508786304:0@lo:400:kworker.0 00010000:00010000:0.0:1789130926.994581:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789130927.185677:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc6d65e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1876039508786688:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789130927.185748:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130927.185878:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508786688 00000100:00100000:3.0:1789130927.185886:0:8418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508786688 00000100:00100000:3.0:1789130927.185938:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789130927.185947:0:8418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc845da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1876039508786688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789130927.185975:0:8418:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789130927.186031:0:8418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc845da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1876039508786688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130927.186039:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00010000:00080000:0.0:1789130927.186234:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc6d65e00 x1876039508786688/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789130943 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789130927.186251:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc6d65e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1876039508786688:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789130927.700675:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc845cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508786816:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789130927.700747:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130927.700918:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508786816 00000100:00100000:0.0:1789130927.700939:0:8418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508786816 00000100:00100000:0.0:1789130927.700992:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789130927.701002:0:8418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddca0c4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508786816:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789130927.701023:0:8418:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789130927.701071:0:8418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddca0c4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508786816:12345-0@lo:13:osp-pre-0-1.0 Request processed in 71us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130927.701078:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00010000:00080000:2.0:1789130927.701233:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc845cb40 x1876039508786816/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789130943 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789130927.701251:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc845cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508786816:0@lo:13:osp-pre-0-1.0 00000020:00000004:3.0:1789130927.871904:0:12683:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789130927.872181:0:12683:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789130928.018566:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130929.049088:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789130929.746813:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789130929.746838:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff7c0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508786944:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789130929.746906:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130929.747021:0:11069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508786944 00000100:00100000:1.0:1789130929.747029:0:11069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508786944 00000100:00100000:1.0:1789130929.747088:0:11069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1789130929.747098:0:11069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc845fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508786944:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789130929.747132:0:11069:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789130929.747183:0:11069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc845fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508786944:12345-0@lo:41:osp-pre-0-1.0 Request processed in 87us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130929.747191:0:11069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1789130929.747234:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff7c0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508786944:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789130929.747487:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789130929.747497:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff7c0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1876039508787072:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789130929.747528:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130929.747663:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508787072 00000100:00100000:3.0:1789130929.747668:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508787072 00000100:00100000:3.0:1789130929.747695:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1789130929.747703:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff7c0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3628:x1876039508787072:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789130929.747720:0:6505:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789130929.747758:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff7c0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3628:x1876039508787072:12345-0@lo:41:osp-pre-1-0.0 Request processed in 56us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130929.747764:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1789130929.747793:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff7c0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1876039508787072:0@lo:41:osp-pre-1-0.0 00000020:00000004:0.0:1789130929.923964:0:12780:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789130929.924173:0:12780:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789130930.065565:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789130931.040251:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789130931.040294:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789130931.040321:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789130931.040343:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789130931.040414:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789130931.040452:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498220800 00000100:00100000:0.0:1789130931.040487:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498220800 00000100:00100000:0.0:1789130931.040538:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498221056 00000100:00100000:0.0:1789130931.040541:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498221056 00000100:00100000:0.0:1789130931.040554:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498220672 00000100:00100000:0.0:1789130931.040557:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498220672 00000100:00100000:0.0:1789130931.040569:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498220928 00000100:00100000:0.0:1789130931.040571:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498220928 00000100:00100000:0.0:1789130931.040586:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 175 00000100:00100000:0.0:1789130931.040594:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc845e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+5:2387:x1876039498220800:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1789130931.040680:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc845e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+5:2387:x1876039498220800:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 87us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130931.040688:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 175 00000100:00100000:0.0:1789130931.040706:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 176 00000100:00100000:0.0:1789130931.040711:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc845cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fde8d4a8-44db-4e6b-8249-c1c295e4901d+5:2387:x1876039498221056:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1789130931.040734:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc845cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fde8d4a8-44db-4e6b-8249-c1c295e4901d+5:2387:x1876039498221056:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 23us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130931.040741:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 176 00000100:00100000:0.0:1789130931.040752:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 177 00000100:00100000:0.0:1789130931.040757:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddca1830c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+6:2387:x1876039498220672:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1789130931.040778:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddca1830c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+6:2387:x1876039498220672:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 21us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130931.040784:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 177 00000100:00100000:0.0:1789130931.040794:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 178 00000100:00100000:0.0:1789130931.040799:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc78903c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fde8d4a8-44db-4e6b-8249-c1c295e4901d+5:2387:x1876039498220928:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1789130931.040820:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc78903c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fde8d4a8-44db-4e6b-8249-c1c295e4901d+5:2387:x1876039498220928:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 20us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130931.040825:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 178 00000100:00080000:0.0:1789130931.040847:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789130931.040851:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789130931.041200:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498220544 00000100:00100000:2.0:1789130931.041206:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498220544 00000100:00100000:2.0:1789130931.041235:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 312 00000100:00100000:2.0:1789130931.041242:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddcf4f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+13:2387:x1876039498220544:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1789130931.041280:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddcf4f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+13:2387:x1876039498220544:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 38us (1036us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130931.041286:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 312 00000100:00100000:0.0:1789130931.047662:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789130931.047695:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789130931.049738:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498221184 00000100:00100000:2.0:1789130931.049752:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498221184 00000100:00100000:2.0:1789130931.049813:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498221312 00000100:00100000:2.0:1789130931.049816:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498221312 00000100:00100000:2.0:1789130931.049843:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 22 00000100:00100000:2.0:1789130931.049853:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7890000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fde8d4a8-44db-4e6b-8249-c1c295e4901d+5:2384:x1876039498221184:12345-192.168.203.11@tcp:9:kworker.0 00000020:00000080:2.0:1789130931.049883:0:8414:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf3fe2838e1fc22a5 00000100:00080000:2.0:1789130931.049892:0:8414:0:(import.c:65:import_set_state_nolock()) ffff91de01a7e000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789130931.049938:0:8414:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:2.0:1789130931.050100:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7890000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fde8d4a8-44db-4e6b-8249-c1c295e4901d+2:2384:x1876039498221184:12345-192.168.203.11@tcp:9:kworker.0 Request processed in 248us (2447us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130931.050108:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 22 00000100:00100000:2.0:1789130931.050124:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 23 00000100:00100000:2.0:1789130931.050131:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc78930c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fde8d4a8-44db-4e6b-8249-c1c295e4901d+5:2384:x1876039498221312:12345-192.168.203.11@tcp:9:kworker.0 00000100:00080000:1.0:1789130931.051757:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789130931.051766:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:2.0:1789130931.051866:0:8414:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf3fe2838e1fc22ac 00000100:00080000:2.0:1789130931.051877:0:8414:0:(import.c:65:import_set_state_nolock()) ffff91de01a7f800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789130931.054281:0:8414:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:2.0:1789130931.054473:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc78930c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fde8d4a8-44db-4e6b-8249-c1c295e4901d+2:2384:x1876039498221312:12345-192.168.203.11@tcp:9:kworker.0 Request processed in 4323us (6757us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130931.054484:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 23 00010000:00010000:1.0:1789130931.062251:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130931.062653:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130931.090022:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789130931.793672:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff7c0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1876039508787200:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789130931.793743:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130931.793852:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508787200 00000100:00100000:1.0:1789130931.793859:0:8418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508787200 00000100:00100000:1.0:1789130931.793912:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789130931.793921:0:8418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddca0c6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1876039508787200:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789130931.793948:0:8418:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789130931.793991:0:8418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddca0c6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1876039508787200:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130931.793998:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:2.0:1789130931.794050:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1789130931.794089:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91ddff7c0b40 x1876039508787200/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789130947 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789130931.794107:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff7c0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1876039508787200:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789130931.794287:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789130931.794296:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff7c03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508787328:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789130931.794324:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130931.794346:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508787328 00000100:00100000:1.0:1789130931.794350:0:8418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508787328 00000100:00100000:1.0:1789130931.794370:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789130931.794376:0:8418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff7c2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508787328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789130931.794386:0:8418:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789130931.794414:0:8418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff7c2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508787328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 38us (89us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130931.794421:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00010000:00080000:1.0:1789130931.794453:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91ddff7c03c0 x1876039508787328/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789130947 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789130931.794485:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff7c03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508787328:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1789130931.794570:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000004:3.0:1789130931.795795:0:12877:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789130931.795984:0:12877:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1789130931.797997:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc78921c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3627:1876039508787584:0@lo:400:kworker.0 00000100:00100000:0.0:1789130931.798069:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130931.798111:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7893840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3627:1876039508788096:0@lo:400:kworker.0 00000100:00100000:0.0:1789130931.798133:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130931.798155:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc78170c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3627:1876039508788608:0@lo:400:kworker.0 00000100:00100000:0.0:1789130931.798177:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130931.798205:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789130931.798211:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7891a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508787712:0@lo:400:kworker.0 00000100:00100000:0.0:1789130931.798238:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130931.798258:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7890f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3627:1876039508788224:0@lo:400:kworker.0 00000100:00100000:0.0:1789130931.798278:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130931.798294:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc78143c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3627:1876039508788736:0@lo:400:kworker.0 00000100:00100000:0.0:1789130931.798312:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130931.798341:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508787584 00000100:00100000:0.0:1789130931.798346:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508787584 00000100:00100000:0.0:1789130931.798378:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508788096 00000100:00100000:0.0:1789130931.798381:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508788096 00000100:00100000:0.0:1789130931.798405:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508788608 00000100:00100000:0.0:1789130931.798407:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508788608 00000100:00100000:0.0:1789130931.798418:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508788224 00000100:00100000:0.0:1789130931.798420:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508788224 00000100:00100000:0.0:1789130931.798429:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508788736 00000100:00100000:0.0:1789130931.798431:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508788736 00000100:00100000:2.0:1789130931.798562:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7892d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3626:1876039508787456:0@lo:400:kworker.0 00000100:00100000:2.0:1789130931.798595:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130931.798621:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7890b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508787968:0@lo:400:kworker.0 00000100:00100000:2.0:1789130931.798643:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130931.798675:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7817840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508788480:0@lo:400:kworker.0 00000100:00100000:2.0:1789130931.798699:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130931.798719:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1789130931.798725:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7893c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3626:1876039508787840:0@lo:400:kworker.0 00000100:00100000:2.0:1789130931.798745:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130931.798754:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7814b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1876039508788352:0@lo:400:kworker.0 00000100:00100000:2.0:1789130931.798786:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130931.798812:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508787456 00000100:00100000:2.0:1789130931.798815:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508787456 00000100:00100000:2.0:1789130931.798842:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:2.0:1789130931.798849:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddcf4f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+24:3626:x1876039508787456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130931.798892:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddcf4f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+24:3626:x1876039508787456:12345-0@lo:400:kworker.0 Request processed in 43us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130931.798899:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:2.0:1789130931.798929:0:11069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508787712 00000100:00100000:2.0:1789130931.798932:0:11069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508787712 00000100:00100000:2.0:1789130931.798954:0:11069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508787968 00000100:00100000:2.0:1789130931.798956:0:11069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508787968 00000100:00100000:2.0:1789130931.798970:0:11069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1789130931.798976:0:11069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddffa80f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508787712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130931.799013:0:11069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddffa80f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508787712:12345-0@lo:400:kworker.0 Request processed in 38us (774us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130931.799020:0:11069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1789130931.799031:0:11069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1789130931.799038:0:11069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddca0c7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508787968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130931.799065:0:11069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddca0c7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508787968:12345-0@lo:400:kworker.0 Request processed in 28us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130931.799072:0:11069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1789130931.799087:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508788480 00000100:00100000:2.0:1789130931.799090:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508788480 00000100:00100000:2.0:1789130931.799113:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508788352 00000100:00100000:2.0:1789130931.799117:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508788352 00000100:00100000:2.0:1789130931.799137:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789130931.799143:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc6bec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508788480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130931.799186:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc6bec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508788480:12345-0@lo:400:kworker.0 Request processed in 44us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130931.799193:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789130931.799205:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789130931.799211:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7b27c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1876039508788352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130931.799235:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7b27c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1876039508788352:12345-0@lo:400:kworker.0 Request processed in 25us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130931.799242:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00080000:2.0:1789130931.799285:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc7814b40 x1876039508788352/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789130947 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789130931.799299:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7814b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1876039508788352:0@lo:400:kworker.0 00000100:00100000:2.0:1789130931.799308:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7892d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3626:1876039508787456:0@lo:400:kworker.0 00000100:00100000:2.0:1789130931.799318:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7890b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508787968:0@lo:400:kworker.0 00010000:00080000:2.0:1789130931.799326:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc7817840 x1876039508788480/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789130947 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789130931.799335:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7817840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508788480:0@lo:400:kworker.0 00000100:00100000:0.0:1789130931.799505:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508787840 00000100:00100000:0.0:1789130931.799510:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508787840 00000100:00100000:0.0:1789130931.799525:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1789130931.799531:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7814f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1876039508787584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130931.799565:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7814f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1876039508787584:12345-0@lo:400:kworker.0 Request processed in 34us (1497us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130931.799581:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1789130931.799595:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1789130931.799600:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7816d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1876039508788096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130931.799630:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7816d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1876039508788096:12345-0@lo:400:kworker.0 Request processed in 30us (1496us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130931.799636:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1789130931.799878:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1789130931.799887:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7817480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3627:x1876039508788608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130931.799921:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7817480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3627:x1876039508788608:12345-0@lo:400:kworker.0 Request processed in 36us (1743us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130931.799927:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1789130931.799938:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1789130931.799944:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddffa83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1876039508788224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130931.799970:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddffa83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1876039508788224:12345-0@lo:400:kworker.0 Request processed in 27us (1691us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130931.799976:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1789130931.799986:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1789130931.799991:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddffa81a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3627:x1876039508788736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130931.800015:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddffa81a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3627:x1876039508788736:12345-0@lo:400:kworker.0 Request processed in 24us (1702us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130931.800020:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1789130931.800030:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1789130931.800035:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc6becf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1876039508787840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130931.800060:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc6becf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1876039508787840:12345-0@lo:400:kworker.0 Request processed in 25us (1314us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130931.800072:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00080000:0.0:1789130931.800104:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789130931.800109:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789130931.800111:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789130931.800136:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7891a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508787712:0@lo:400:kworker.0 00010000:00080000:0.0:1789130931.800147:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc7890f00 x1876039508788224/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130947 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789130931.800157:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7890f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3627:1876039508788224:0@lo:400:kworker.0 00010000:00080000:0.0:1789130931.800168:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc78143c0 x1876039508788736/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130947 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789130931.800175:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc78143c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3627:1876039508788736:0@lo:400:kworker.0 00000100:00100000:0.0:1789130931.800186:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc78921c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3627:1876039508787584:0@lo:400:kworker.0 00000100:00100000:0.0:1789130931.800195:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7893840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3627:1876039508788096:0@lo:400:kworker.0 00000100:00100000:0.0:1789130931.800204:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc78170c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3627:1876039508788608:0@lo:400:kworker.0 00000100:00100000:2.0:1789130931.800286:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7893c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3626:1876039508787840:0@lo:400:kworker.0 00010000:00010000:1.0:1789130932.122520:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789130932.305774:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789130932.305798:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc6d643c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508788864:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789130932.305877:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130932.306034:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508788864 00000100:00100000:1.0:1789130932.306043:0:8418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508788864 00000100:00100000:1.0:1789130932.306096:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789130932.306123:0:8418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7b26940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508788864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789130932.306154:0:8418:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789130932.306882:0:8418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7b26940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508788864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 758us (1002us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130932.306900:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00010000:00080000:3.0:1789130932.310984:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc6d643c0 x1876039508788864/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789130948 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130932.311014:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc6d643c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508788864:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789130932.820794:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789130932.820815:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddffa821c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508788992:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789130932.820882:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130932.820990:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508788992 00000100:00100000:1.0:1789130932.820997:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508788992 00000100:00100000:1.0:1789130932.821050:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789130932.821060:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddffa82580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508788992:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789130932.821080:0:8419:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789130932.821133:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddffa82580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508788992:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130932.821140:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00010000:00080000:2.0:1789130932.821268:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91ddffa821c0 x1876039508788992/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789130948 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789130932.821284:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddffa821c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508788992:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1789130933.139084:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130934.161721:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789130934.865864:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789130934.870249:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddffa830c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1876039508789248:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789130934.870348:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130934.870439:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc6d643c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1876039508789120:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789130934.870487:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130934.870595:0:11069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508789248 00000100:00100000:3.0:1789130934.870606:0:11069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508789248 00000100:00100000:3.0:1789130934.870680:0:11069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508789120 00000100:00100000:3.0:1789130934.870704:0:11069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508789120 00000100:00100000:3.0:1789130934.870726:0:11069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1789130934.870737:0:11069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc78921c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3628:x1876039508789248:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789130934.870784:0:11069:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789130934.870849:0:11069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc78921c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3628:x1876039508789248:12345-0@lo:41:osp-pre-0-1.0 Request processed in 113us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130934.870857:0:11069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1789130934.870877:0:11069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1789130934.870884:0:11069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7890f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3628:x1876039508789120:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789130934.870901:0:11069:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789130934.870929:0:11069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7890f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3628:x1876039508789120:12345-0@lo:41:osp-pre-1-0.0 Request processed in 45us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130934.870935:0:11069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1789130934.870980:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddffa830c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1876039508789248:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789130934.870998:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc6d643c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1876039508789120:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789130935.186165:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789130935.382783:0:13022:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:0.0:1789130936.157945:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789130936.157998:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789130936.158041:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789130936.158073:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789130936.158107:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789130936.158165:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498221696 00000100:00100000:0.0:1789130936.158177:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498221696 00000100:00100000:0.0:1789130936.158245:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498221952 00000100:00100000:0.0:1789130936.158260:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498221952 00000100:00100000:0.0:1789130936.158279:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498221568 00000100:00100000:0.0:1789130936.158283:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498221568 00000100:00100000:0.0:1789130936.158298:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498221824 00000100:00100000:0.0:1789130936.158301:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498221824 00000100:00100000:0.0:1789130936.158321:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 185 00000100:00100000:0.0:1789130936.158332:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddffa80b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+5:2388:x1876039498221696:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1789130936.158441:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddffa80b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+5:2388:x1876039498221696:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 110us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130936.158449:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 185 00000100:00100000:0.0:1789130936.158507:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 186 00000100:00100000:0.0:1789130936.158515:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddffa830c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fde8d4a8-44db-4e6b-8249-c1c295e4901d+5:2388:x1876039498221952:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1789130936.158545:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddffa830c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fde8d4a8-44db-4e6b-8249-c1c295e4901d+5:2388:x1876039498221952:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 32us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130936.158552:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 186 00000100:00100000:0.0:1789130936.158564:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 187 00000100:00100000:0.0:1789130936.158571:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddffa81e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+6:2388:x1876039498221568:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1789130936.158597:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddffa81e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+6:2388:x1876039498221568:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 26us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130936.158603:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 187 00000100:00100000:0.0:1789130936.158614:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 188 00000100:00100000:3.0:1789130936.158799:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498221440 00000100:00100000:3.0:1789130936.158804:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498221440 00000100:00100000:3.0:1789130936.158841:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 314 00000100:00100000:3.0:1789130936.158849:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddcf4fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+13:2388:x1876039498221440:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1789130936.158879:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddcf4fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+13:2388:x1876039498221440:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 31us (954us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130936.158886:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 314 00000100:00100000:0.0:1789130936.158990:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddffa821c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fde8d4a8-44db-4e6b-8249-c1c295e4901d+5:2388:x1876039498221824:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1789130936.159019:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddffa821c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fde8d4a8-44db-4e6b-8249-c1c295e4901d+5:2388:x1876039498221824:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 32us (912us total) trans 0 rc 0/0 00000100:00080000:2.0:1789130936.159319:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789130936.159325:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789130936.159449:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 188 00010000:00010000:2.0:1789130936.210855:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789130936.920864:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01a5cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1876039508789760:0@lo:400:kworker.0 00000100:00100000:3.0:1789130936.920978:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130936.921043:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff7c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508789376:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789130936.921050:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01a5f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3628:1876039508790272:0@lo:400:kworker.0 00000100:00100000:3.0:1789130936.921079:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130936.921090:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130936.921108:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01a5ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3628:1876039508790784:0@lo:400:kworker.0 00000100:00100000:3.0:1789130936.921132:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130936.921169:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1789130936.921177:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01a5c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3628:1876039508789632:0@lo:400:kworker.0 00000100:00100000:3.0:1789130936.921204:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130936.921223:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01a5e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3625:1876039508789888:0@lo:400:kworker.0 00000100:00100000:3.0:1789130936.921227:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01a5f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3628:1876039508790144:0@lo:400:kworker.0 00000100:00100000:3.0:1789130936.921247:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130936.921257:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01a5e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3626:1876039508789504:0@lo:400:kworker.0 00000100:00100000:3.0:1789130936.921266:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01a5d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3628:1876039508790656:0@lo:400:kworker.0 00000100:00100000:2.0:1789130936.921288:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130936.921289:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130936.921312:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01a5d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508790016:0@lo:400:kworker.0 00000100:00100000:2.0:1789130936.921334:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130936.921351:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01a5da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508790528:0@lo:400:kworker.0 00000100:00100000:2.0:1789130936.921372:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130936.921387:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01a5cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508791040:0@lo:400:kworker.0 00000100:00100000:2.0:1789130936.921421:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130936.921539:0:11069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508789760 00000100:00100000:3.0:1789130936.921549:0:11069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508789760 00000100:00100000:3.0:1789130936.921600:0:11069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508790016 00000100:00100000:3.0:1789130936.921603:0:11069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508790016 00000100:00100000:3.0:1789130936.922765:0:11069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1789130936.922787:0:11069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc6d65680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3628:x1876039508789760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130936.922899:0:11069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc6d65680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3628:x1876039508789760:12345-0@lo:400:kworker.0 Request processed in 120us (1921us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130936.922908:0:11069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1789130936.922933:0:11069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1789130936.922940:0:11069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7891a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508790016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130936.922989:0:11069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7891a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508790016:12345-0@lo:400:kworker.0 Request processed in 50us (1654us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130936.922995:0:11069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1789130936.923033:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508790272 00000100:00100000:3.0:1789130936.923052:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508790272 00000100:00100000:3.0:1789130936.923102:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508790784 00000100:00100000:3.0:1789130936.923106:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508790784 00000100:00100000:3.0:1789130936.923121:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508789632 00000100:00100000:3.0:1789130936.923124:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508789632 00000100:00100000:3.0:1789130936.923135:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508790144 00000100:00100000:3.0:1789130936.923138:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508790144 00000100:00100000:3.0:1789130936.923151:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508790656 00000100:00100000:3.0:1789130936.923154:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508790656 00000100:00100000:3.0:1789130936.923169:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1789130936.923175:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc6d643c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3628:x1876039508790272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130936.923214:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc6d643c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3628:x1876039508790272:12345-0@lo:400:kworker.0 Request processed in 39us (2134us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130936.923220:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1789130936.923233:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1789130936.923239:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc6d65e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3628:x1876039508790784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130936.923270:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc6d65e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3628:x1876039508790784:12345-0@lo:400:kworker.0 Request processed in 31us (2137us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130936.923276:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1789130936.923287:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1789130936.923293:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddca228f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1876039508789632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130936.923324:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddca228f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1876039508789632:12345-0@lo:400:kworker.0 Request processed in 31us (2120us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130936.923330:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1789130936.923340:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1789130936.923346:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddca22a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3628:x1876039508790144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130936.923379:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddca22a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3628:x1876039508790144:12345-0@lo:400:kworker.0 Request processed in 34us (2131us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130936.923393:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1789130936.923418:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1789130936.923425:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7ffe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3628:x1876039508790656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130936.923481:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7ffe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3628:x1876039508790656:12345-0@lo:400:kworker.0 Request processed in 33us (2167us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130936.923488:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1789130936.923525:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130936.923567:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01a5fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508790400:0@lo:400:kworker.0 00000100:00100000:3.0:1789130936.923607:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130936.924750:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01a5de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508790912:0@lo:400:kworker.0 00000100:00100000:3.0:1789130936.924797:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130936.924899:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01a5c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3628:1876039508789632:0@lo:400:kworker.0 00000100:00100000:3.0:1789130936.924915:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01a5f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3628:1876039508790144:0@lo:400:kworker.0 00000100:00100000:2.0:1789130936.925245:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508789376 00000100:00100000:3.0:1789130936.925305:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01a5d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3628:1876039508790656:0@lo:400:kworker.0 00000100:00100000:3.0:1789130936.925324:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01a5cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1876039508789760:0@lo:400:kworker.0 00000100:00100000:2.0:1789130936.925339:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508789376 00010000:00080000:3.0:1789130936.925341:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91de01a5f0c0 x1876039508790272/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130952 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130936.925356:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01a5f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3628:1876039508790272:0@lo:400:kworker.0 00010000:00080000:3.0:1789130936.925369:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91de01a5ed00 x1876039508790784/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130952 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130936.925380:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01a5ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3628:1876039508790784:0@lo:400:kworker.0 00000100:00100000:2.0:1789130936.925440:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789130936.925448:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789130936.925489:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7893840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1876039508789376:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789130936.925505:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7893c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1876039508791168:0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789130936.925527:0:8419:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789130936.925547:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130936.925598:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01a5d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508790016:0@lo:400:kworker.0 00000100:00100000:2.0:1789130936.925636:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7893840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1876039508789376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 182us (4541us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130936.925645:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789130936.925664:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508791168 00000100:00100000:2.0:1789130936.925669:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508791168 00000100:00080000:3.0:1789130936.925698:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789130936.925707:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00080000:3.0:1789130936.925711:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789130936.925716:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789130936.925733:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508789888 00000100:00100000:3.0:1789130936.925740:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508789888 00000100:00100000:3.0:1789130936.925784:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1789130936.925793:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff8a5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1876039508789888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130936.925845:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff8a43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1876039508791168:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789130936.925853:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff8a5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1876039508789888:12345-0@lo:400:kworker.0 Request processed in 56us (2323us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130936.925866:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00002000:00000024:2.0:1789130936.925867:0:8419:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789130936.925901:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508790528 00000100:00100000:3.0:1789130936.925907:0:9827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508790528 00000100:00100000:2.0:1789130936.925925:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff8a43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1876039508791168:12345-0@lo:13:osp-pre-1-1.0 Request processed in 208us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130936.925937:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789130936.925951:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508791040 00000100:00100000:3.0:1789130936.925957:0:9827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508791040 00000100:00100000:3.0:1789130936.925974:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508790400 00000100:00100000:3.0:1789130936.925977:0:9827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508790400 00000100:00100000:3.0:1789130936.925991:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508790912 00000100:00100000:3.0:1789130936.925994:0:9827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508790912 00000100:00100000:3.0:1789130936.926006:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789130936.926013:0:9827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7890b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508790528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130936.926044:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508789504 00000100:00100000:2.0:1789130936.926051:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508789504 00000100:00100000:3.0:1789130936.926074:0:9827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7890b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508790528:12345-0@lo:400:kworker.0 Request processed in 57us (4696us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130936.926083:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789130936.926101:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:3.0:1789130936.926108:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789130936.926115:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddcf4fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+24:3626:x1876039508789504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130936.926124:0:9827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7892d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508791040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130936.926179:0:9827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7892d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508791040:12345-0@lo:400:kworker.0 Request processed in 63us (4757us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130936.926186:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789130936.926202:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789130936.926210:0:9827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff8a52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508790400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130936.926233:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddcf4fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+24:3626:x1876039508789504:12345-0@lo:400:kworker.0 Request processed in 120us (4939us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130936.926245:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:3.0:1789130936.926258:0:9827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff8a52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508790400:12345-0@lo:400:kworker.0 Request processed in 46us (2647us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130936.926266:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789130936.926280:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789130936.926285:0:9827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff8a7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508790912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130936.928780:0:9827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff8a7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508790912:12345-0@lo:400:kworker.0 Request processed in 2481us (3968us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130936.928798:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:3.0:1789130936.928846:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789130936.928890:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01a5e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3626:1876039508789504:0@lo:400:kworker.0 00010000:00080000:3.0:1789130936.928912:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91de01a5da40 x1876039508790528/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789130952 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130936.928926:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01a5da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508790528:0@lo:400:kworker.0 00010000:00080000:3.0:1789130936.928941:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91de01a5cb40 x1876039508791040/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789130952 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130936.928950:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01a5cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508791040:0@lo:400:kworker.0 00010000:00080000:3.0:1789130936.929563:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91ddff7c3480 x1876039508789376/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789130952 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130936.929590:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff7c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508789376:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789130936.929631:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01a5e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3625:1876039508789888:0@lo:400:kworker.0 00010000:00080000:3.0:1789130936.929646:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91de01a5fc00 x1876039508790400/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789130952 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130936.929654:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01a5fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508790400:0@lo:400:kworker.0 00010000:00080000:3.0:1789130936.929667:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91de01a5de00 x1876039508790912/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789130952 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130936.929675:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01a5de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508790912:0@lo:400:kworker.0 00010000:00080000:2.0:1789130936.934240:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc7893c00 x1876039508791168/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789130952 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789130936.934278:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7893c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1876039508791168:0@lo:13:osp-pre-1-1.0 00000001:00100000:2.0:1789130936.937140:0:9493:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of fde8d4a8-44db-4e6b-8249-c1c295e4901d 00000020:00000080:2.0:1789130936.937154:0:9493:0:(genops.c:885:class_export_put()) final put ffff91de01a7c000/fde8d4a8-44db-4e6b-8249-c1c295e4901d 00000001:00100000:2.0:1789130936.937212:0:8410:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of fde8d4a8-44db-4e6b-8249-c1c295e4901d 00000020:00000080:2.0:1789130936.937217:0:8410:0:(genops.c:885:class_export_put()) final put ffff91de01a7a000/fde8d4a8-44db-4e6b-8249-c1c295e4901d 00000020:00000080:2.0:1789130936.937232:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff91de01a7c000/fde8d4a8-44db-4e6b-8249-c1c295e4901d for lustre-OST0001 00000020:00000080:2.0:1789130936.937297:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff91de01a7a000/fde8d4a8-44db-4e6b-8249-c1c295e4901d for lustre-OST0000 00000020:00000080:2.0:1789130936.937319:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff91de01a7f800 for lustre-OST0001 00000020:00000080:2.0:1789130936.937325:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff91de01a7e000 for lustre-OST0000 00010000:00010000:1.0:1789130937.234620:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789130937.425799:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789130937.425834:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff8a7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1876039508791296:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789130937.425933:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130937.428449:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508791296 00000100:00100000:1.0:1789130937.428567:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508791296 00000100:00100000:2.0:1789130937.432206:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789130937.432304:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01a5de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1876039508791296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789130937.432355:0:8419:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789130937.432517:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01a5de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1876039508791296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 220us (6584us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130937.432526:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00010000:00080000:0.0:1789130937.432862:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91ddff8a7c00 x1876039508791296/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789130953 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789130937.432889:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff8a7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1876039508791296:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789130937.937937:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789130937.943499:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7893c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1876039508791424:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789130937.943738:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130937.945816:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508791424 00000100:00100000:2.0:1789130937.945836:0:8418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508791424 00000100:00100000:3.0:1789130937.947949:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789130937.947968:0:8418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff7c0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1876039508791424:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789130937.948005:0:8418:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789130937.948125:0:8418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff7c0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1876039508791424:12345-0@lo:13:osp-pre-0-1.0 Request processed in 163us (4387us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130937.948133:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00010000:00080000:0.0:1789130937.948215:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc7893c00 x1876039508791424/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789130953 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789130937.948242:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7893c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1876039508791424:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1789130938.260671:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789130938.804537:0:13169:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc520e45a0 20000000:00000080:2.0:1789130938.804555:0:13169:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff91de01a73800 uarg=0000000000000000 20000000:01000000:2.0:1789130938.804597:0:13169:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789130938.804602:0:13169:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789130938.804607:0:13169:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1789130938.806438:0:13170:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:0.0:1789130938.807084:0:13169:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1789130938.820294:0:13169:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789130938.820430:0:13169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91dcc7f7e400/0xf3fe2838e1fc22b3 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130938.820481:0:13169:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91ddfd0b4400/0xf3fe2838e1fc2243 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d26986f expref: 12 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130938.820492:0:13169:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91dcc7e37e00/0xf3fe2838e1fc2251 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc224a expref: 23 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130938.820499:0:13169:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91dcc7e37000/0xf3fe2838e1fc225f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc2258 expref: 23 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130938.820506:0:13169:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91ddc0031400/0xf3fe2838e1fc226d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc2266 expref: 23 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130938.820527:0:13169:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91ddfd0b5e00/0xf3fe2838e1fc227b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc2274 expref: 23 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130938.820534:0:13169:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91dcc7e36600/0xf3fe2838e1fc2290 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d2698ae expref: 12 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130938.820542:0:13169:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91dcc7f7e400/0xf3fe2838e1fc22b3 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130938.820588:0:13169:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91dcc7e36600/0xf3fe2838e1fc2290 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d2698ae expref: 12 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130938.820604:0:13169:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91dcc7e36600/0xf3fe2838e1fc2290 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d2698ae expref: 12 pid: 6494 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130938.820619:0:13169:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc78170c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13169:1876039508791552:192.168.203.11@tcp:104: 00010000:00010000:2.0:1789130938.820748:0:13169:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91ddfd0b5e00/0xf3fe2838e1fc227b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf3fe2838e1fc2274 expref: 23 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130938.820757:0:13169:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91ddfd0b5e00/0xf3fe2838e1fc227b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf3fe2838e1fc2274 expref: 23 pid: 6494 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130938.820767:0:13169:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc78143c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13169:1876039508791680:0@lo:104: 00000100:00100000:2.0:1789130938.820809:0:13169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130938.820855:0:9504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508791680 00000100:00100000:2.0:1789130938.820861:0:9504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508791680 00000100:00100000:2.0:1789130938.820911:0:9504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789130938.820921:0:9504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7817840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+3:13169:x1876039508791680:12345-0@lo:104: 00010000:00010000:2.0:1789130938.820942:0:9504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff91dde19aa600/0xf3fe2838e1fc2274 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3fe2838e1fc227b expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130938.820992:0:9504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789130938.820999:0:9504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7817840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+3:13169:x1876039508791680:12345-0@lo:104: Request processed in 80us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130938.821006:0:9504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00010000:2.0:1789130938.821033:0:6489:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789130938.821045:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff91dde19aa600/0xf3fe2838e1fc2274 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3fe2838e1fc227b expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130938.821054:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dde19aa600 already unused, calling callback (ffffffffc124bc20) 10000000:00010000:2.0:1789130938.821058:0:6489:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff91dde19aa600/0xf3fe2838e1fc2274 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xf3fe2838e1fc227b expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130938.821067:0:6489:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff91dde19aa600/0xf3fe2838e1fc2274 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xf3fe2838e1fc227b expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789130938.821075:0:6489:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff91dde19aa600/0xf3fe2838e1fc2274 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xf3fe2838e1fc227b expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789130938.821081:0:6489:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789130938.821110:0:6489:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff91dde19aa600/0xf3fe2838e1fc2274 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc227b expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130938.821116:0:6489:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789130938.824881:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7814b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3626:1876039508791808:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789130938.824985:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130938.825673:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508791808 00000100:00100000:1.0:1789130938.825685:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508791808 00010000:00010000:1.0:1789130938.825733:0:8431:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91ddfd0b5e00/0xf3fe2838e1fc227b lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3fe2838e1fc2274 expref: 24 pid: 6494 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130938.825810:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789130938.825821:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff7c03c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+24:3626:x1876039508791808:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789130938.825842:0:8431:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789130938.825848:0:8431:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91ddfd0b5e00/0xf3fe2838e1fc227b lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3fe2838e1fc2274 expref: 24 pid: 6494 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130938.825861:0:8431:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91ddfd0b5e00/0xf3fe2838e1fc227b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf3fe2838e1fc2274 expref: 24 pid: 6494 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130938.825889:0:8431:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789130938.825940:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff7c03c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+24:3626:x1876039508791808:12345-0@lo:103:ldlm_bl.0 Request processed in 121us (955us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130938.825948:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789130938.825996:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7814b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3626:1876039508791808:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789130938.830644:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff91dde19aa600/0xf3fe2838e1fc2274 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc227b expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130938.830662:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff91dde19aa600/0xf3fe2838e1fc2274 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc227b expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130938.830736:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130938.830739:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130938.830743:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130938.830801:0:13169:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91ddc0031400/0xf3fe2838e1fc226d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf3fe2838e1fc2266 expref: 23 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130938.830814:0:13169:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91ddc0031400/0xf3fe2838e1fc226d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf3fe2838e1fc2266 expref: 23 pid: 6494 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130938.830828:0:13169:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7814b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13169:1876039508791936:0@lo:104: 00000100:00100000:2.0:1789130938.830893:0:13169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789130938.830936:0:13169:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91dcc7e37000/0xf3fe2838e1fc225f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf3fe2838e1fc2258 expref: 23 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130938.830945:0:13169:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91dcc7e37000/0xf3fe2838e1fc225f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf3fe2838e1fc2258 expref: 23 pid: 6494 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130938.830953:0:13169:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff8e3480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13169:1876039508792064:0@lo:104: 00000100:00100000:2.0:1789130938.830976:0:13169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789130938.831010:0:13169:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91dcc7e37e00/0xf3fe2838e1fc2251 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf3fe2838e1fc224a expref: 23 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130938.831019:0:13169:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91dcc7e37e00/0xf3fe2838e1fc2251 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf3fe2838e1fc224a expref: 23 pid: 6493 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130938.831027:0:13169:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff8e3c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13169:1876039508792192:0@lo:104: 00000100:00100000:0.0:1789130938.831295:0:9503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508791936 00000100:00100000:0.0:1789130938.831310:0:9503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508791936 00000100:00100000:0.0:1789130938.831394:0:9503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508792064 00000100:00100000:0.0:1789130938.831398:0:9503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508792064 00000100:00100000:0.0:1789130938.831426:0:9503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789130938.831438:0:9503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff8e1e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+4:13169:x1876039508791936:12345-0@lo:104: 00010000:00010000:0.0:1789130938.831476:0:9503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff91ddc0031a00/0xf3fe2838e1fc2266 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3fe2838e1fc226d expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130938.831613:0:9503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789130938.831620:0:9503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff8e1e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+4:13169:x1876039508791936:12345-0@lo:104: Request processed in 184us (727us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130938.831628:0:9503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789130938.831665:0:9503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789130938.831671:0:9503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff8e2d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+3:13169:x1876039508792064:12345-0@lo:104: 00010000:00010000:0.0:1789130938.831680:0:9503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff91dcc7e36c00/0xf3fe2838e1fc2258 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3fe2838e1fc225f expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130938.831713:0:9503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789130938.831718:0:9503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff8e2d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+3:13169:x1876039508792064:12345-0@lo:104: Request processed in 48us (741us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130938.831724:0:9503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789130938.831808:0:13169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130938.831859:0:9504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508792192 00000100:00100000:2.0:1789130938.831875:0:9504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508792192 00000100:00100000:2.0:1789130938.831918:0:9504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789130938.831927:0:9504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff8e0780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+3:13169:x1876039508792192:12345-0@lo:104: 00010000:00010000:2.0:1789130938.831940:0:9504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff91ddc0030200/0xf3fe2838e1fc224a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3fe2838e1fc2251 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130938.831993:0:9504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1789130938.831999:0:9504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff8e0780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+3:13169:x1876039508792192:12345-0@lo:104: Request processed in 74us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130938.832005:0:9504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:2.0:1789130938.832034:0:6489:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789130938.832046:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff91ddc0031a00/0xf3fe2838e1fc2266 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3fe2838e1fc226d expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130938.832054:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddc0031a00 already unused, calling callback (ffffffffc124bc20) 10000000:00010000:2.0:1789130938.832058:0:6489:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff91ddc0031a00/0xf3fe2838e1fc2266 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf3fe2838e1fc226d expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130938.832066:0:6489:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff91ddc0031a00/0xf3fe2838e1fc2266 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf3fe2838e1fc226d expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789130938.832073:0:6489:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff91ddc0031a00/0xf3fe2838e1fc2266 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf3fe2838e1fc226d expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789130938.832079:0:6489:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789130938.832108:0:6489:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff91ddc0031a00/0xf3fe2838e1fc2266 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc226d expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130938.832115:0:6489:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789130938.832137:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff91ddc0031a00/0xf3fe2838e1fc2266 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc226d expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130938.832152:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff91ddc0031a00/0xf3fe2838e1fc2266 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc226d expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130938.832177:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff8e21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3627:1876039508792320:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789130938.832210:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130938.832806:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508792320 00000100:00100000:2.0:1789130938.832812:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508792320 00010000:00010000:2.0:1789130938.832848:0:6487:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91ddc0031400/0xf3fe2838e1fc226d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3fe2838e1fc2266 expref: 24 pid: 6494 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130938.832875:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789130938.832882:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff8e0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+24:3627:x1876039508792320:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789130938.832893:0:6487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789130938.832898:0:6487:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91ddc0031400/0xf3fe2838e1fc226d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3fe2838e1fc2266 expref: 24 pid: 6494 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130938.832908:0:6487:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91ddc0031400/0xf3fe2838e1fc226d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf3fe2838e1fc2266 expref: 24 pid: 6494 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130938.832927:0:6487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789130938.832961:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff8e0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+24:3627:x1876039508792320:12345-0@lo:103:ldlm_bl.0 Request processed in 80us (750us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130938.832969:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789130938.833006:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff8e21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3627:1876039508792320:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789130938.833024:0:6489:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789130938.833028:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff91dcc7e36c00/0xf3fe2838e1fc2258 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3fe2838e1fc225f expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130938.833045:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc7e36c00 already unused, calling callback (ffffffffc124bc20) 10000000:00010000:2.0:1789130938.833048:0:6489:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff91dcc7e36c00/0xf3fe2838e1fc2258 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf3fe2838e1fc225f expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130938.833056:0:6489:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff91dcc7e36c00/0xf3fe2838e1fc2258 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf3fe2838e1fc225f expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789130938.833062:0:6489:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff91dcc7e36c00/0xf3fe2838e1fc2258 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf3fe2838e1fc225f expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789130938.833067:0:6489:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789130938.833085:0:6489:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff91dcc7e36c00/0xf3fe2838e1fc2258 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc225f expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130938.833091:0:6489:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789130938.833104:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff91dcc7e36c00/0xf3fe2838e1fc2258 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc225f expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130938.833111:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff91dcc7e36c00/0xf3fe2838e1fc2258 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc225f expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130938.833130:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff8e21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3628:1876039508792448:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789130938.833159:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789130938.833192:0:6489:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789130938.833197:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff91ddc0030200/0xf3fe2838e1fc224a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3fe2838e1fc2251 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130938.833204:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddc0030200 already unused, calling callback (ffffffffc124bc20) 10000000:00010000:2.0:1789130938.833214:0:6489:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff91ddc0030200/0xf3fe2838e1fc224a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf3fe2838e1fc2251 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130938.833878:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00010000:00010000:1.0:1789130938.834040:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130938.834049:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789130938.834069:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508792448 00000100:00100000:1.0:1789130938.834075:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508792448 00010000:00010000:1.0:1789130938.834101:0:8431:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91dcc7e37000/0xf3fe2838e1fc225f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3fe2838e1fc2258 expref: 24 pid: 6494 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130938.834133:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498222080 00000100:00100000:1.0:1789130938.834136:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498222080 00010000:00010000:1.0:1789130938.834151:0:8431:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91dcc7e36600/0xf3fe2838e1fc2290 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d2698ae expref: 13 pid: 6494 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130938.834176:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789130938.834187:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff8e1a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+24:3628:x1876039508792448:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789130938.834202:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 43 00010000:00010000:1.0:1789130938.834208:0:8431:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789130938.834217:0:8431:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91dcc7e37000/0xf3fe2838e1fc225f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3fe2838e1fc2258 expref: 24 pid: 6494 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130938.834225:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01a5e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+13:2388:x1876039498222080:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789130938.834245:0:6487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789130938.834254:0:6487:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91dcc7e36600/0xf3fe2838e1fc2290 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d2698ae expref: 13 pid: 6494 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130938.834274:0:6487:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91dcc7e36600/0xf3fe2838e1fc2290 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d2698ae expref: 13 pid: 6494 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130938.834297:0:6487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789130938.834318:0:8431:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91dcc7e37000/0xf3fe2838e1fc225f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf3fe2838e1fc2258 expref: 24 pid: 6494 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130938.834336:0:8431:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789130938.834364:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01a5e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+13:2388:x1876039498222080:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 148us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130938.834375:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 43 00000100:00100000:1.0:1789130938.834422:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff8e1a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+24:3628:x1876039508792448:12345-0@lo:103:ldlm_bl.0 Request processed in 230us (1254us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130938.834432:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789130938.834605:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff8e21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3628:1876039508792448:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789130938.834920:0:6489:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff91ddc0030200/0xf3fe2838e1fc224a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf3fe2838e1fc2251 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789130938.834932:0:6489:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff91ddc0030200/0xf3fe2838e1fc224a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf3fe2838e1fc2251 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789130938.834937:0:6489:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789130938.836003:0:6489:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff91ddc0030200/0xf3fe2838e1fc224a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc2251 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130938.836013:0:6489:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789130938.836047:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff91ddc0030200/0xf3fe2838e1fc224a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc2251 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130938.836054:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff91ddc0030200/0xf3fe2838e1fc224a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc2251 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130938.836071:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130938.836073:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130938.836075:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130938.836117:0:13169:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91ddfd0b4400/0xf3fe2838e1fc2243 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d26986f expref: 12 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130938.836135:0:13169:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91ddfd0b4400/0xf3fe2838e1fc2243 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d26986f expref: 12 pid: 6492 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130938.836154:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789130938.836155:0:13169:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff8e2940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13169:1876039508792704:192.168.203.11@tcp:104: 00000100:00100000:0.0:1789130938.836187:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff8e30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3626:1876039508792576:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789130938.836261:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130938.836329:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508792576 00000100:00100000:0.0:1789130938.836353:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508792576 00010000:00010000:0.0:1789130938.836399:0:6487:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91dcc7e37e00/0xf3fe2838e1fc2251 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3fe2838e1fc224a expref: 24 pid: 6493 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130938.836431:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789130938.836440:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01a5cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+24:3626:x1876039508792576:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789130938.836455:0:6487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789130938.836485:0:6487:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91dcc7e37e00/0xf3fe2838e1fc2251 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3fe2838e1fc224a expref: 24 pid: 6493 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130938.836498:0:6487:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91dcc7e37e00/0xf3fe2838e1fc2251 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf3fe2838e1fc224a expref: 24 pid: 6493 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130938.836516:0:6487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789130938.836553:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01a5cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+24:3626:x1876039508792576:12345-0@lo:103:ldlm_bl.0 Request processed in 115us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130938.836561:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789130938.836616:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff8e30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3626:1876039508792576:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789130938.837449:0:13169:0:(client.c:2715:ptlrpc_set_wait()) set ffff91dcc8546cc0 going to sleep for 11 seconds 00010000:00010000:2.0:1789130938.838293:0:13169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91dcc7e36600/0xf3fe2838e1fc2290 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d2698ae expref: 12 pid: 6494 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130938.838315:0:13169:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc78170c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13169:1876039508791552:192.168.203.11@tcp:104: 00010000:00010000:2.0:1789130938.838338:0:13169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91ddfd0b5e00/0xf3fe2838e1fc227b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf3fe2838e1fc2274 expref: 23 pid: 6494 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130938.838346:0:13169:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc78143c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13169:1876039508791680:0@lo:104: 00010000:00010000:2.0:1789130938.838357:0:13169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91ddc0031400/0xf3fe2838e1fc226d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf3fe2838e1fc2266 expref: 22 pid: 6494 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130938.838365:0:13169:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7814b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13169:1876039508791936:0@lo:104: 00010000:00010000:2.0:1789130938.838375:0:13169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91dcc7e37000/0xf3fe2838e1fc225f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf3fe2838e1fc2258 expref: 21 pid: 6494 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130938.838381:0:13169:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff8e3480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13169:1876039508792064:0@lo:104: 00010000:00010000:2.0:1789130938.838403:0:13169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91dcc7e37e00/0xf3fe2838e1fc2251 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf3fe2838e1fc224a expref: 20 pid: 6493 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130938.838411:0:13169:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff8e3c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13169:1876039508792192:0@lo:104: 00000100:00100000:0.0:1789130938.841685:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789130938.841860:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498222208 00000100:00100000:1.0:1789130938.841879:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498222208 00010000:00010000:1.0:1789130938.841925:0:6485:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91ddfd0b4400/0xf3fe2838e1fc2243 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d26986f expref: 12 pid: 6492 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130938.841946:0:13169:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff8e2940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13169:1876039508792704:192.168.203.11@tcp:104: 00000100:00100000:1.0:1789130938.841979:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 45 00000100:00100000:1.0:1789130938.841997:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc33af450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+12:2388:x1876039498222208:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789130938.842015:0:6485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789130938.842022:0:6485:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91ddfd0b4400/0xf3fe2838e1fc2243 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d26986f expref: 12 pid: 6492 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130938.842033:0:13169:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91dcc7f7e400/0xf3fe2838e1fc22b3 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130938.842039:0:6485:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91ddfd0b4400/0xf3fe2838e1fc2243 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d26986f expref: 12 pid: 6492 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130938.842066:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91ddfd0b4400/0xf3fe2838e1fc2243 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d26986f expref: 12 pid: 6492 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130938.842102:0:6485:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91dcc7f7e400/0xf3fe2838e1fc22b3 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130938.842110:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91dcc7f7e400/0xf3fe2838e1fc22b3 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130938.842129:0:6485:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91dcc7f7e400/0xf3fe2838e1fc22b3 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130938.842136:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91dcc7f7e400/0xf3fe2838e1fc22b3 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130938.842142:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91dcc7f7e400/0xf3fe2838e1fc22b3 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130938.842150:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91dcc7f7e400/0xf3fe2838e1fc22b3 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130938.842156:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc7f7e400 already unused, calling callback (ffffffffc0c4e550) 00010000:00010000:1.0:1789130938.842160:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91dcc7f7e400/0xf3fe2838e1fc22b3 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130938.842169:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91dcc7f7e400/0xf3fe2838e1fc22b3 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130938.842178:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91dcc7f7e400/0xf3fe2838e1fc22b3 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130938.842189:0:6485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789130938.842212:0:13169:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91dcc7f7e400/0xf3fe2838e1fc22b3 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130938.842222:0:13169:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91dcc7f7e400/0xf3fe2838e1fc22b3 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130938.842229:0:13169:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91dcc7f7e400/0xf3fe2838e1fc22b3 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130938.842913:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc33af450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+11:2388:x1876039498222208:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 918us (1237us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130938.842933:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 45 00010000:00010000:1.0:1789130939.281710:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789130939.985827:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff8a6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508792832:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789130939.985925:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130939.986150:0:11069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508792832 00000100:00100000:3.0:1789130939.986161:0:11069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508792832 00000100:00100000:3.0:1789130939.986226:0:11069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1789130939.986237:0:11069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff7c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508792832:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789130939.986283:0:11069:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789130939.986343:0:11069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff7c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508792832:12345-0@lo:41:osp-pre-1-0.0 Request processed in 107us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130939.986352:0:11069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1789130939.986521:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff8a6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508792832:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789130939.987624:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01a5fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508792960:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789130939.987696:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130939.987799:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508792960 00000100:00100000:0.0:1789130939.987808:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508792960 00000100:00100000:0.0:1789130939.987860:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1789130939.987871:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff8a5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508792960:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789130939.987903:0:6506:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789130939.987967:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff8a5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508792960:12345-0@lo:41:osp-pre-0-1.0 Request processed in 99us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130939.987975:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1789130939.988103:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01a5fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508792960:0@lo:41:osp-pre-0-1.0 10000000:01000000:0.0:1789130940.306735:0:6497:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789130940.306768:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91ddff549800 from 7 10000000:01000000:0.0:1789130940.306776:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789130940.306840:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff91ddc0030400/0xf3fe2838e1fc22ba lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130940.306854:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff91ddc0030400/0xf3fe2838e1fc22ba lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130940.306867:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff91ddc0030400/0xf3fe2838e1fc22ba lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130940.306903:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01a5da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508793088:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789130940.306999:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130940.307169:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddc33c43c0 going to sleep for 11 seconds 00010000:00010000:2.0:1789130940.307797:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789130940.314209:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508793088 00000100:00100000:1.0:1789130940.314228:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508793088 00000100:00100000:0.0:1789130940.314437:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:0.0:1789130940.314451:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddcf4fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+20:6497:x1876039508793088:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789130940.314494:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130940.314520:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91ddc0030200/0xf3fe2838e1fc22c1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3fe2838e1fc22ba expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130940.314555:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91ddc0030200/0xf3fe2838e1fc22c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3fe2838e1fc22ba expref: 21 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130940.314585:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91ddc0030200/0xf3fe2838e1fc22c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc22ba expref: 21 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130940.314605:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ddc0030200, rc 0) 00000100:00100000:0.0:1789130940.314716:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddcf4fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+21:6497:x1876039508793088:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 268us (7717us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130940.314725:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:0.0:1789130940.314799:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01a5da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508793088:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789130940.314824:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff91ddc0030400/0xf3fe2838e1fc22ba lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc22c1 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130940.314836:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff91ddc0030400/0xf3fe2838e1fc22ba lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3fe2838e1fc22c1 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130940.314939:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01a5da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508793216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789130940.314981:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130940.315020:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddc33c43c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789130940.315037:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508793216 00000100:00100000:0.0:1789130940.315041:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508793216 00000100:00100000:0.0:1789130940.315309:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:0.0:1789130940.315317:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddcf4f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+21:6497:x1876039508793216:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789130940.315496:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddcf4f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+21:6497:x1876039508793216:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 179us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130940.315504:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:0.0:1789130940.315539:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01a5da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508793216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789130940.316888:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01a5da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508793344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789130940.316973:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130940.317021:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddc33c43c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789130940.318196:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508793344 00000100:00100000:0.0:1789130940.318209:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508793344 00000100:00100000:0.0:1789130940.319281:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:0.0:1789130940.319300:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddcf4f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+21:6497:x1876039508793344:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789130940.319546:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddcf4f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+21:6497:x1876039508793344:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 253us (2573us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130940.319575:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:0.0:1789130940.336699:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01a5da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508793344:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789130940.339372:0:13204:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1789130940.344232:0:6497:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1789130940.344274:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789130940.344289:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff91ddc0030400/0xf3fe2838e1fc22ba lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc22c1 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130940.344304:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff91ddc0030400/0xf3fe2838e1fc22ba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc22c1 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789130940.344317:0:6497:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789130940.344320:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91ddff4f9000 from 7 10000000:01000000:1.0:1789130940.344324:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789130940.344389:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff91dde19aae00/0xf3fe2838e1fc22c8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130940.344397:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff91dde19aae00/0xf3fe2838e1fc22c8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130940.344409:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff91dde19aae00/0xf3fe2838e1fc22c8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130940.344441:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7d9b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508793472:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789130940.344595:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130940.344657:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff91dcc10bc180 going to sleep for 11 seconds 00000100:00100000:2.0:1789130940.344799:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508793472 00000100:00100000:2.0:1789130940.344808:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508793472 00000100:00100000:2.0:1789130940.344882:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:2.0:1789130940.344893:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddcf4fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+21:6497:x1876039508793472:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789130940.344910:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130940.344926:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91dcc7f7ee00/0xf3fe2838e1fc22cf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3fe2838e1fc22c8 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130940.344968:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91dcc7f7ee00/0xf3fe2838e1fc22cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3fe2838e1fc22c8 expref: 22 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130940.344981:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91dcc7f7ee00/0xf3fe2838e1fc22cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc22c8 expref: 22 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130940.344992:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dcc7f7ee00, rc 0) 00000100:00100000:2.0:1789130940.345049:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddcf4fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+22:6497:x1876039508793472:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 157us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130940.345057:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:1.0:1789130940.345224:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7d9b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508793472:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789130940.345241:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff91dde19aae00/0xf3fe2838e1fc22c8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc22cf expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130940.345251:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff91dde19aae00/0xf3fe2838e1fc22c8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3fe2838e1fc22cf expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130940.345327:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7d9b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508793600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789130940.345354:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130940.345382:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff91dcc10bc180 going to sleep for 11 seconds 00000100:00100000:0.0:1789130940.345421:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508793600 00000100:00100000:0.0:1789130940.345425:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508793600 00000100:00100000:0.0:1789130940.345453:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:0.0:1789130940.345480:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddcf7c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+22:6497:x1876039508793600:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789130940.345613:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddcf7c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+22:6497:x1876039508793600:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 134us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130940.345620:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:1.0:1789130940.345713:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7d9b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508793600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789130940.345741:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7d9b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508793728:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789130940.345781:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130940.345801:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff91dcc10bc180 going to sleep for 11 seconds 00000100:00100000:0.0:1789130940.345832:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508793728 00000100:00100000:0.0:1789130940.345836:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508793728 00000100:00100000:0.0:1789130940.345865:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:0.0:1789130940.345871:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddcf7c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+22:6497:x1876039508793728:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789130940.345942:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddcf7c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+22:6497:x1876039508793728:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 71us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130940.345948:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:1.0:1789130940.346070:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7d9b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508793728:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789130940.347051:0:13205:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1789130940.347218:0:6497:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1789130940.347241:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789130940.347252:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff91dde19aae00/0xf3fe2838e1fc22c8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc22cf expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130940.347263:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff91dde19aae00/0xf3fe2838e1fc22c8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc22cf expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789130940.347274:0:6497:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789130940.347287:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91ddfce33000 from 7 10000000:01000000:0.0:1789130940.347290:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789130940.347323:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff91ddc0030800/0xf3fe2838e1fc22d6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130940.347330:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff91ddc0030800/0xf3fe2838e1fc22d6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130940.347340:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff91ddc0030800/0xf3fe2838e1fc22d6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130940.347360:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01a5da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508793856:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789130940.347425:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130940.347473:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddfcfc2540 going to sleep for 11 seconds 00000100:00100000:1.0:1789130940.347648:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508793856 00000100:00100000:1.0:1789130940.347656:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508793856 00000100:00100000:1.0:1789130940.347705:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:1.0:1789130940.347714:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddcf7cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+22:6497:x1876039508793856:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789130940.347728:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130940.347742:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91dde19abc00/0xf3fe2838e1fc22dd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3fe2838e1fc22d6 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130940.347781:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91dde19abc00/0xf3fe2838e1fc22dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3fe2838e1fc22d6 expref: 23 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130940.347792:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91dde19abc00/0xf3fe2838e1fc22dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc22d6 expref: 23 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130940.347801:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dde19abc00, rc 0) 00000100:00100000:1.0:1789130940.347842:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddcf7cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+23:6497:x1876039508793856:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130940.347850:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:0.0:1789130940.347980:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01a5da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508793856:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789130940.347995:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff91ddc0030800/0xf3fe2838e1fc22d6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc22dd expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130940.348004:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff91ddc0030800/0xf3fe2838e1fc22d6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3fe2838e1fc22dd expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130940.348068:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01a5da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508793984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789130940.348095:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130940.348115:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddfcfc2540 going to sleep for 11 seconds 00000100:00100000:1.0:1789130940.348152:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508793984 00000100:00100000:1.0:1789130940.348156:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508793984 00000100:00100000:1.0:1789130940.348212:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:1.0:1789130940.348219:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8606050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+23:6497:x1876039508793984:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789130940.348341:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8606050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+23:6497:x1876039508793984:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 121us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130940.348349:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:0.0:1789130940.348409:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01a5da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508793984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789130940.348439:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01a5da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508794112:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789130940.348516:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130940.357636:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddfcfc2540 going to sleep for 11 seconds 00000100:00100000:2.0:1789130940.361393:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508794112 00000100:00100000:2.0:1789130940.361415:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508794112 00000100:00100000:2.0:1789130940.362832:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:2.0:1789130940.362855:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8604c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+23:6497:x1876039508794112:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789130940.364283:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8604c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+23:6497:x1876039508794112:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1427us (15755us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130940.364297:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:0.0:1789130940.364501:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01a5da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508794112:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789130940.365653:0:13207:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1789130940.365901:0:6497:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1789130940.365933:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789130940.365990:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff91ddc0030800/0xf3fe2838e1fc22d6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc22dd expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130940.366005:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff91ddc0030800/0xf3fe2838e1fc22d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc22dd expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789130940.366018:0:6497:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789130940.366021:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91dded7b6800 from 7 10000000:01000000:0.0:1789130940.366025:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789130940.366073:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff91ddc0031400/0xf3fe2838e1fc22e4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130940.366082:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff91ddc0031400/0xf3fe2838e1fc22e4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130940.366092:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff91ddc0031400/0xf3fe2838e1fc22e4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130940.366122:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01a5da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508794240:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789130940.366203:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130940.366302:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddfcfc2540 going to sleep for 11 seconds 00000100:00100000:1.0:1789130940.366345:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508794240 00000100:00100000:1.0:1789130940.366355:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508794240 00000100:00100000:1.0:1789130940.366452:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:1.0:1789130940.366537:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8605050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+23:6497:x1876039508794240:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789130940.366557:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130940.366575:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91dde19aa600/0xf3fe2838e1fc22eb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3fe2838e1fc22e4 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130940.366607:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91dde19aa600/0xf3fe2838e1fc22eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3fe2838e1fc22e4 expref: 24 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130940.366630:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91dde19aa600/0xf3fe2838e1fc22eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc22e4 expref: 24 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130940.366641:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dde19aa600, rc 0) 00000100:00100000:1.0:1789130940.366928:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8605050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+24:6497:x1876039508794240:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 395us (725us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130940.366943:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:0.0:1789130940.367385:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01a5da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508794240:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789130940.367410:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff91ddc0031400/0xf3fe2838e1fc22e4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc22eb expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130940.367420:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff91ddc0031400/0xf3fe2838e1fc22e4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3fe2838e1fc22eb expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130940.367561:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01a5da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508794368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789130940.367611:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130940.367650:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddfcfc2540 going to sleep for 11 seconds 00000100:00100000:1.0:1789130940.367721:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508794368 00000100:00100000:1.0:1789130940.367727:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508794368 00000100:00100000:1.0:1789130940.367771:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:1.0:1789130940.367781:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8607450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+24:6497:x1876039508794368:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789130940.368017:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8607450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+24:6497:x1876039508794368:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 238us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130940.368026:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:0.0:1789130940.368306:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01a5da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508794368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789130940.368339:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01a5da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508794496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789130940.368387:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130940.368422:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddfcfc2540 going to sleep for 11 seconds 00000100:00100000:1.0:1789130940.368487:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508794496 00000100:00100000:1.0:1789130940.368492:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508794496 00000100:00100000:1.0:1789130940.368522:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:1.0:1789130940.368531:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8607850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+24:6497:x1876039508794496:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789130940.368645:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8607850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+24:6497:x1876039508794496:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 114us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130940.368652:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:0.0:1789130940.368728:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01a5da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508794496:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789130940.373053:0:13208:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1789130940.373370:0:6497:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1789130940.373417:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789130940.373450:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff91ddc0031400/0xf3fe2838e1fc22e4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc22eb expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130940.373492:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff91ddc0031400/0xf3fe2838e1fc22e4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc22eb expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130940.766182:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789130940.766304:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498222336 00000100:00100000:2.0:1789130940.766316:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498222336 00000100:00100000:2.0:1789130940.766396:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 328 00000100:00100000:2.0:1789130940.766408:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8606c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+11:6161:x1876039498222336:12345-192.168.203.11@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789130940.766430:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130940.766456:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91dcc7f7fa00/0xf3fe2838e1fc22f2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf8eae2996d2698df expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130940.766510:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91dcc7f7fa00/0xf3fe2838e1fc22f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d2698df expref: 12 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130940.766533:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91dcc7f7fa00/0xf3fe2838e1fc22f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d2698df expref: 12 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130940.766545:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dcc7f7fa00, rc 0) 00000100:00100000:2.0:1789130940.766624:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8606c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+12:6161:x1876039498222336:12345-192.168.203.11@tcp:101:ll_cfg_requeue.0 Request processed in 218us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130940.766632:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 328 00000100:00100000:3.0:1789130940.770773:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789130940.770898:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498222464 00000100:00100000:0.0:1789130940.770910:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498222464 00000100:00100000:0.0:1789130940.770980:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 329 00000100:00100000:0.0:1789130940.770992:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8605450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+12:6161:x1876039498222464:12345-192.168.203.11@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789130940.771218:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8605450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+12:6161:x1876039498222464:12345-192.168.203.11@tcp:501:ll_cfg_requeue.0 Request processed in 215us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130940.771228:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 329 00000100:00100000:3.0:1789130940.776982:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789130940.777169:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498222592 00000100:00100000:0.0:1789130940.777183:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498222592 00000100:00100000:0.0:1789130940.777276:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 330 00000100:00100000:0.0:1789130940.777289:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8604450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+12:6161:x1876039498222592:12345-192.168.203.11@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789130940.777519:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8604450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+12:6161:x1876039498222592:12345-192.168.203.11@tcp:503:ll_cfg_requeue.0 Request processed in 232us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130940.777539:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 330 00000100:00100000:3.0:1789130940.789608:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789130940.789714:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498222720 00000100:00100000:2.0:1789130940.789727:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498222720 00000100:00100000:2.0:1789130940.789802:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 331 00000100:00100000:2.0:1789130940.789815:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8607c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+12:6161:x1876039498222720:12345-192.168.203.11@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789130940.789838:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130940.789862:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91dcc7f7e000/0xf3fe2838e1fc22f9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xf8eae2996d2698e6 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130940.789910:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91dcc7f7e000/0xf3fe2838e1fc22f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d2698e6 expref: 13 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130940.789924:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91dcc7f7e000/0xf3fe2838e1fc22f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d2698e6 expref: 13 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130940.789936:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dcc7f7e000, rc 0) 00000100:00100000:2.0:1789130940.790008:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8607c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+13:6161:x1876039498222720:12345-192.168.203.11@tcp:101:ll_cfg_requeue.0 Request processed in 195us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130940.790016:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 331 00000100:00100000:3.0:1789130940.792152:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789130940.792383:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498222848 00000100:00100000:0.0:1789130940.792396:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498222848 00000100:00100000:0.0:1789130940.792487:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 332 00000100:00100000:0.0:1789130940.792499:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8605850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+13:6161:x1876039498222848:12345-192.168.203.11@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789130940.792691:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8605850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+13:6161:x1876039498222848:12345-192.168.203.11@tcp:501:ll_cfg_requeue.0 Request processed in 194us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130940.792700:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 332 00000100:00100000:3.0:1789130940.797076:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789130940.797212:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498222976 00000100:00100000:0.0:1789130940.797225:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498222976 00000100:00100000:0.0:1789130940.797296:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 333 00000100:00100000:0.0:1789130940.797307:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8604850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+13:6161:x1876039498222976:12345-192.168.203.11@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789130940.800424:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8604850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+13:6161:x1876039498222976:12345-192.168.203.11@tcp:503:ll_cfg_requeue.0 Request processed in 3106us (3351us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130940.800441:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 333 00000100:00100000:3.0:1789130941.279723:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789130941.279763:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789130941.279773:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498223104 00000100:00100000:2.0:1789130941.279786:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498223104 00000100:00100000:3.0:1789130941.279800:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789130941.279819:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789130941.279834:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498223360 00000100:00100000:3.0:1789130941.279836:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498223232 00000100:00100000:2.0:1789130941.279837:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498223360 00000100:00100000:3.0:1789130941.279838:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498223232 00000100:00100000:2.0:1789130941.279851:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498223488 00000100:00100000:2.0:1789130941.279853:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498223488 00000100:00100000:3.0:1789130941.279857:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 195 00000100:00100000:3.0:1789130941.279865:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff8a6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+6:2385:x1876039498223104:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1789130941.279866:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 196 00000100:00100000:2.0:1789130941.279872:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff8a7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fde8d4a8-44db-4e6b-8249-c1c295e4901d+5:2385:x1876039498223360:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1789130941.279932:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff8a7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fde8d4a8-44db-4e6b-8249-c1c295e4901d+5:2385:x1876039498223360:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 59us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130941.279951:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 196 00000100:00100000:2.0:1789130941.279969:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 197 00000100:00100000:2.0:1789130941.279975:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7814b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+5:2385:x1876039498223232:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1789130941.280000:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7814b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+5:2385:x1876039498223232:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 26us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130941.280006:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 197 00000100:00100000:2.0:1789130941.280020:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 198 00000100:00100000:2.0:1789130941.280026:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc78143c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fde8d4a8-44db-4e6b-8249-c1c295e4901d+5:2385:x1876039498223488:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1789130941.280065:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc78143c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fde8d4a8-44db-4e6b-8249-c1c295e4901d+5:2385:x1876039498223488:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 38us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130941.280072:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 198 00000100:00100000:3.0:1789130941.281525:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff8a6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+6:2385:x1876039498223104:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 1655us (1806us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130941.281536:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 195 00000100:00080000:3.0:1789130941.281564:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789130941.281569:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789130941.332471:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789130942.037580:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc78170c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1876039508794624:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789130942.037657:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130942.037734:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7c69680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508794752:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789130942.037761:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130942.037798:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508794624 00000100:00100000:3.0:1789130942.037806:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508794624 00000100:00100000:3.0:1789130942.037848:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508794752 00000100:00100000:3.0:1789130942.037851:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508794752 00000100:00100000:3.0:1789130942.037870:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789130942.037878:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7c68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1876039508794624:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789130942.037906:0:8419:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789130942.037945:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7c68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1876039508794624:12345-0@lo:13:osp-pre-1-1.0 Request processed in 68us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130942.037952:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789130942.037969:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1789130942.037975:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7c683c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1876039508794752:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789130942.037993:0:8419:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789130942.038021:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7c683c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1876039508794752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 46us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130942.038027:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:3.0:1789130942.038046:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789130942.038070:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc7c69680 x1876039508794752/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789130958 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130942.038089:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7c69680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508794752:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1789130942.038116:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc78170c0 x1876039508794624/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789130958 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130942.038127:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc78170c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1876039508794624:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789130942.038515:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01a5da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3626:1876039508794880:0@lo:400:kworker.0 00000100:00100000:0.0:1789130942.038547:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130942.038572:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01a5f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508795392:0@lo:400:kworker.0 00000100:00100000:0.0:1789130942.038593:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130942.038612:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01a5c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508795904:0@lo:400:kworker.0 00000100:00100000:0.0:1789130942.038631:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130942.038648:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789130942.038654:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01a5ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3626:1876039508795264:0@lo:400:kworker.0 00000100:00100000:0.0:1789130942.038676:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130942.038703:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01a5f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1876039508795776:0@lo:400:kworker.0 00000100:00100000:0.0:1789130942.038724:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130942.038757:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508794880 00000100:00100000:0.0:1789130942.038762:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508794880 00000100:00100000:0.0:1789130942.038797:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:0.0:1789130942.038804:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8604050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+24:3626:x1876039508794880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130942.038843:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8604050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+24:3626:x1876039508794880:12345-0@lo:400:kworker.0 Request processed in 39us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130942.038850:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:0.0:1789130942.038878:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508795392 00000100:00100000:0.0:1789130942.038881:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508795392 00000100:00100000:0.0:1789130942.038903:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1789130942.038910:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01a5cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508795392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130942.038942:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01a5cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508795392:12345-0@lo:400:kworker.0 Request processed in 33us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130942.038948:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1789130942.038966:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508795904 00000100:00100000:0.0:1789130942.038969:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508795904 00000100:00100000:0.0:1789130942.038994:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508795776 00000100:00100000:0.0:1789130942.038998:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508795776 00000100:00100000:0.0:1789130942.039019:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789130942.039025:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01a5c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508795904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130942.039054:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01a5c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508795904:12345-0@lo:400:kworker.0 Request processed in 29us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130942.039060:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789130942.039071:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789130942.039077:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc843d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1876039508795776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130942.039116:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc843d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1876039508795776:12345-0@lo:400:kworker.0 Request processed in 39us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130942.039122:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789130942.039140:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508795264 00000100:00100000:0.0:1789130942.039144:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508795264 00000100:00100000:0.0:1789130942.039165:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1789130942.039171:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7893c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1876039508795264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130942.039202:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7893c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1876039508795264:12345-0@lo:400:kworker.0 Request processed in 30us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130942.039207:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1789130942.039244:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01a5ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3626:1876039508795264:0@lo:400:kworker.0 00010000:00080000:0.0:1789130942.039254:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91de01a5f840 x1876039508795776/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789130958 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789130942.039263:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01a5f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1876039508795776:0@lo:400:kworker.0 00000100:00100000:0.0:1789130942.039273:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01a5da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3626:1876039508794880:0@lo:400:kworker.0 00000100:00100000:0.0:1789130942.039281:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01a5f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508795392:0@lo:400:kworker.0 00010000:00080000:0.0:1789130942.039289:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91de01a5c780 x1876039508795904/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789130958 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789130942.039296:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01a5c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508795904:0@lo:400:kworker.0 00000100:00100000:3.0:1789130942.039414:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01a5e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3627:1876039508795008:0@lo:400:kworker.0 00000100:00100000:3.0:1789130942.039443:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130942.039495:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01a5cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3627:1876039508795520:0@lo:400:kworker.0 00000100:00100000:3.0:1789130942.039517:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130942.039533:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01a5fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3627:1876039508796032:0@lo:400:kworker.0 00000100:00100000:3.0:1789130942.039552:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130942.039568:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1789130942.039574:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01a5d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508795136:0@lo:400:kworker.0 00000100:00100000:3.0:1789130942.039593:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130942.039609:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01a5d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3627:1876039508795648:0@lo:400:kworker.0 00000100:00100000:3.0:1789130942.039626:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130942.039637:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01a5e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3627:1876039508796160:0@lo:400:kworker.0 00000100:00100000:3.0:1789130942.039664:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130942.039681:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508795008 00000100:00100000:3.0:1789130942.039685:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508795008 00000100:00100000:3.0:1789130942.039703:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508795520 00000100:00100000:3.0:1789130942.039706:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508795520 00000100:00100000:3.0:1789130942.039718:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508796032 00000100:00100000:3.0:1789130942.039721:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508796032 00000100:00100000:3.0:1789130942.039732:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508795648 00000100:00100000:3.0:1789130942.039734:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508795648 00000100:00100000:3.0:1789130942.039744:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508796160 00000100:00100000:3.0:1789130942.039746:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508796160 00000100:00100000:3.0:1789130942.039761:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1789130942.039767:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7c69680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1876039508795008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130942.039801:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7c69680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1876039508795008:12345-0@lo:400:kworker.0 Request processed in 34us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130942.039807:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1789130942.039818:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1789130942.039822:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7c6a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1876039508795520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130942.039846:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7c6a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1876039508795520:12345-0@lo:400:kworker.0 Request processed in 24us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130942.039852:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1789130942.039861:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1789130942.039866:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7c6a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3627:x1876039508796032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130942.039890:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7c6a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3627:x1876039508796032:12345-0@lo:400:kworker.0 Request processed in 24us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130942.039896:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1789130942.039907:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1789130942.039913:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8414f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1876039508795648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130942.039950:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8414f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1876039508795648:12345-0@lo:400:kworker.0 Request processed in 37us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130942.039957:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1789130942.039969:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1789130942.039974:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8415680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3627:x1876039508796160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130942.039999:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8415680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3627:x1876039508796160:12345-0@lo:400:kworker.0 Request processed in 25us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130942.040005:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1789130942.040022:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508795136 00000100:00100000:3.0:1789130942.040026:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508795136 00000100:00100000:3.0:1789130942.040048:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1789130942.040054:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc78170c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508795136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130942.040084:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc78170c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508795136:12345-0@lo:400:kworker.0 Request processed in 31us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130942.040089:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00080000:3.0:1789130942.040105:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789130942.040109:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789130942.040111:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789130942.040150:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01a5d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508795136:0@lo:400:kworker.0 00010000:00080000:3.0:1789130942.040160:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91de01a5d680 x1876039508795648/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130958 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130942.040168:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01a5d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3627:1876039508795648:0@lo:400:kworker.0 00010000:00080000:3.0:1789130942.040176:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91de01a5e580 x1876039508796160/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130958 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130942.040184:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01a5e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3627:1876039508796160:0@lo:400:kworker.0 00000100:00100000:3.0:1789130942.040199:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01a5e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3627:1876039508795008:0@lo:400:kworker.0 00000100:00100000:3.0:1789130942.040206:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01a5cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3627:1876039508795520:0@lo:400:kworker.0 00000100:00100000:3.0:1789130942.040213:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01a5fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3627:1876039508796032:0@lo:400:kworker.0 00010000:00010000:1.0:1789130942.355181:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789130942.547943:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc84143c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508796288:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789130942.548012:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130942.548182:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508796288 00000100:00100000:3.0:1789130942.548190:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508796288 00000100:00100000:3.0:1789130942.548240:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1789130942.548249:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7d9b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1876039508796288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789130942.548278:0:8419:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789130942.548493:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7d9b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1876039508796288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 244us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130942.548501:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00010000:00080000:1.0:1789130942.548642:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc84143c0 x1876039508796288/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789130958 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789130942.548675:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc84143c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508796288:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789130943.058824:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8414b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1876039508796416:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789130943.058890:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130943.063157:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508796416 00000100:00100000:0.0:1789130943.063173:0:8418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508796416 00000100:00100000:0.0:1789130943.063241:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789130943.063253:0:8418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc84143c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1876039508796416:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789130943.063290:0:8418:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789130943.063387:0:8418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc84143c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1876039508796416:12345-0@lo:13:osp-pre-0-1.0 Request processed in 137us (4497us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130943.063394:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00010000:00080000:3.0:1789130943.067253:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc8414b40 x1876039508796416/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789130959 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130943.067281:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8414b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1876039508796416:0@lo:13:osp-pre-0-1.0 00000001:02000400:0.0:1789130943.196802:0:13368:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg311-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1789130943.381700:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130944.401900:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789130945.108745:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc843cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508796544:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789130945.108857:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130945.110313:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc843c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1876039508796672:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789130945.110397:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130945.110513:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508796544 00000100:00100000:1.0:1789130945.110522:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508796544 00000100:00100000:1.0:1789130945.110580:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508796672 00000100:00100000:1.0:1789130945.110584:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508796672 00000100:00100000:1.0:1789130945.110603:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1789130945.110614:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8495e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508796544:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789130945.110663:0:6506:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789130945.114091:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1789130945.114115:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff8a4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3628:x1876039508796672:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789130945.114168:0:6505:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789130945.114302:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff8a4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3628:x1876039508796672:12345-0@lo:41:osp-pre-1-0.0 Request processed in 196us (3903us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130945.114311:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1789130945.114501:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc843c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1876039508796672:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789130945.115386:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8495e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508796544:12345-0@lo:41:osp-pre-0-1.0 Request processed in 4768us (6524us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130945.115399:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1789130945.116949:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc843cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508796544:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789130945.429756:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789130946.396912:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789130946.396949:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789130946.396980:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789130946.397001:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789130946.397025:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789130946.397052:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498223616 00000100:00100000:1.0:1789130946.397062:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498223616 00000100:00100000:1.0:1789130946.397111:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 335 00000100:00100000:1.0:1789130946.397121:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8606850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+13:2386:x1876039498223616:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1789130946.397190:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8606850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+13:2386:x1876039498223616:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 70us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130946.397207:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 335 00000100:00100000:1.0:1789130946.397239:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498223744 00000100:00100000:1.0:1789130946.397242:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498223744 00000100:00100000:1.0:1789130946.397269:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498224000 00000100:00100000:1.0:1789130946.397271:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498224000 00000100:00100000:1.0:1789130946.397285:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498223872 00000100:00100000:1.0:1789130946.397288:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498223872 00000100:00100000:1.0:1789130946.397300:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498224128 00000100:00100000:1.0:1789130946.397302:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498224128 00000100:00100000:1.0:1789130946.397316:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 205 00000100:00100000:1.0:1789130946.397322:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7c79680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+6:2386:x1876039498223744:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1789130946.397367:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7c79680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+6:2386:x1876039498223744:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 45us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130946.397374:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 205 00000100:00100000:1.0:1789130946.397388:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 206 00000100:00100000:1.0:1789130946.397395:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7c7ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fde8d4a8-44db-4e6b-8249-c1c295e4901d+5:2386:x1876039498224000:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1789130946.397417:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7c7ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fde8d4a8-44db-4e6b-8249-c1c295e4901d+5:2386:x1876039498224000:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 23us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130946.397424:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 206 00000100:00100000:1.0:1789130946.397433:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 207 00000100:00100000:1.0:1789130946.397438:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7c7b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+5:2386:x1876039498223872:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1789130946.397489:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7c7b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+5:2386:x1876039498223872:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 50us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130946.397496:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 207 00000100:00100000:1.0:1789130946.397508:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 208 00000100:00100000:1.0:1789130946.397536:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7c7a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fde8d4a8-44db-4e6b-8249-c1c295e4901d+5:2386:x1876039498224128:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1789130946.397565:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7c7a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fde8d4a8-44db-4e6b-8249-c1c295e4901d+5:2386:x1876039498224128:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 44us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130946.397572:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 208 00000100:00080000:3.0:1789130946.397818:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789130946.397823:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789130946.459938:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789130947.156127:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc843de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3625:1876039508796800:0@lo:400:kworker.0 00000100:00100000:0.0:1789130947.156790:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130947.156885:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01a5fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508797312:0@lo:400:kworker.0 00000100:00100000:0.0:1789130947.156923:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130947.156949:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01a5d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508797824:0@lo:400:kworker.0 00000100:00100000:0.0:1789130947.156984:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130947.157009:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01a5da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508798336:0@lo:400:kworker.0 00000100:00100000:0.0:1789130947.157055:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130947.157109:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1789130947.157118:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc843fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3625:1876039508796928:0@lo:400:kworker.0 00000100:00100000:0.0:1789130947.157620:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130947.157652:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01a5cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3625:1876039508797440:0@lo:400:kworker.0 00000100:00100000:0.0:1789130947.157677:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130947.157710:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01a5d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3625:1876039508797952:0@lo:400:kworker.0 00000100:00100000:0.0:1789130947.157736:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130947.157788:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc843cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508797056:0@lo:400:kworker.0 00000100:00100000:0.0:1789130947.157819:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130947.157842:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01a5e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3627:1876039508797568:0@lo:400:kworker.0 00000100:00100000:2.0:1789130947.157900:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc843c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3628:1876039508797184:0@lo:400:kworker.0 00000100:00100000:2.0:1789130947.157944:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130947.157969:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01a5e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1876039508797696:0@lo:400:kworker.0 00000100:00100000:2.0:1789130947.158004:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130947.158029:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01a5f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1876039508798208:0@lo:400:kworker.0 00000100:00100000:0.0:1789130947.158038:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130947.158063:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01a5c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3627:1876039508798080:0@lo:400:kworker.0 00000100:00100000:2.0:1789130947.158069:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130947.158103:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff8e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1876039508798464:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789130947.158131:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130947.158172:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508796928 00000100:00100000:2.0:1789130947.158180:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508796928 00000100:00100000:2.0:1789130947.158227:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508797440 00000100:00100000:2.0:1789130947.158230:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508797440 00000100:00100000:2.0:1789130947.158257:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508797952 00000100:00100000:2.0:1789130947.158260:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508797952 00000100:00100000:2.0:1789130947.158272:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508797184 00000100:00100000:2.0:1789130947.158274:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508797184 00000100:00100000:2.0:1789130947.158291:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508797568 00000100:00100000:2.0:1789130947.158294:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508797568 00000100:00100000:0.0:1789130947.158314:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130947.158319:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1789130947.158347:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8508000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1876039508796928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130947.158364:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508796800 00000100:00100000:0.0:1789130947.158371:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508796800 00000100:00100000:0.0:1789130947.158411:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:2.0:1789130947.158419:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8508000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1876039508796928:12345-0@lo:400:kworker.0 Request processed in 89us (798us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130947.158423:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8606450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+24:3625:x1876039508796800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130947.158433:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1789130947.158454:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508798080 00000100:00100000:2.0:1789130947.158482:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508798080 00000100:00100000:0.0:1789130947.158500:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8606450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+24:3625:x1876039508796800:12345-0@lo:400:kworker.0 Request processed in 80us (1710us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130947.158508:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1789130947.158515:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8508780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1876039508797440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130947.158559:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8508780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1876039508797440:12345-0@lo:400:kworker.0 Request processed in 45us (881us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130947.158577:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1789130947.158589:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1789130947.158596:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc850ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1876039508797952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130947.158627:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc850ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1876039508797952:12345-0@lo:400:kworker.0 Request processed in 33us (891us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130947.158634:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1789130947.158645:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1789130947.158650:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff8e1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3628:x1876039508797184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130947.158682:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff8e1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3628:x1876039508797184:12345-0@lo:400:kworker.0 Request processed in 31us (737us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130947.158688:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1789130947.158699:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:2.0:1789130947.158705:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc850a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1876039508797568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130947.158712:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:2.0:1789130947.158746:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc850a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1876039508797568:12345-0@lo:400:kworker.0 Request processed in 41us (708us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130947.158754:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1789130947.158758:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508797312 00000100:00100000:0.0:1789130947.158763:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508797312 00000100:00100000:2.0:1789130947.158772:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:2.0:1789130947.158781:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8508f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3627:x1876039508798080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130947.158796:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508797056 00000100:00100000:0.0:1789130947.158802:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508797056 00000100:00100000:2.0:1789130947.158822:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8508f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3627:x1876039508798080:12345-0@lo:400:kworker.0 Request processed in 41us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130947.158827:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1789130947.158837:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1789130947.158842:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01a5f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1876039508797312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130947.158862:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508797824 00000100:00100000:2.0:1789130947.158867:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508797824 00000100:00100000:2.0:1789130947.158888:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508798336 00000100:00100000:2.0:1789130947.158890:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508798336 00000100:00100000:2.0:1789130947.158915:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508797696 00000100:00100000:2.0:1789130947.158917:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508797696 00000100:00100000:2.0:1789130947.158932:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508798208 00000100:00100000:2.0:1789130947.158935:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508798208 00000100:00100000:2.0:1789130947.158951:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789130947.158960:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01a5ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1876039508797824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130947.158969:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01a5f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1876039508797312:12345-0@lo:400:kworker.0 Request processed in 130us (2043us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130947.158977:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1789130947.158993:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1789130947.159002:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc850bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508797056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130947.159005:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01a5ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1876039508797824:12345-0@lo:400:kworker.0 Request processed in 45us (2019us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130947.159014:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789130947.159030:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789130947.159038:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc850a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1876039508798336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130947.159060:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc850bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508797056:12345-0@lo:400:kworker.0 Request processed in 59us (1239us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130947.159075:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc850a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1876039508798336:12345-0@lo:400:kworker.0 Request processed in 38us (2019us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130947.159080:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789130947.159090:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789130947.159095:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff8e2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3628:x1876039508797696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130947.159120:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff8e2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3628:x1876039508797696:12345-0@lo:400:kworker.0 Request processed in 25us (1127us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130947.159125:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789130947.159135:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789130947.159141:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff8e3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3628:x1876039508798208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130947.159165:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff8e3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3628:x1876039508798208:12345-0@lo:400:kworker.0 Request processed in 25us (1101us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130947.159170:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789130947.159192:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508798464 00000100:00100000:2.0:1789130947.159195:0:8418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508798464 00000100:00100000:2.0:1789130947.159219:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789130947.159233:0:8418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff8e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1876039508798464:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789130947.159258:0:8418:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789130947.159296:0:8418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff8e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1876039508798464:12345-0@lo:13:osp-pre-1-1.0 Request processed in 64us (1164us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130947.159302:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:2.0:1789130947.159319:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789130947.159323:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789130947.159336:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789130947.159339:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789130947.159382:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc843fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3625:1876039508796928:0@lo:400:kworker.0 00000100:00100000:2.0:1789130947.159397:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01a5cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3625:1876039508797440:0@lo:400:kworker.0 00000100:00100000:2.0:1789130947.159408:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01a5d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3625:1876039508797952:0@lo:400:kworker.0 00000100:00100000:2.0:1789130947.159419:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc843de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3625:1876039508796800:0@lo:400:kworker.0 00000100:00100000:2.0:1789130947.159431:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01a5fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508797312:0@lo:400:kworker.0 00010000:00080000:2.0:1789130947.159445:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91de01a5d680 x1876039508797824/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789130963 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789130947.159480:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01a5d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508797824:0@lo:400:kworker.0 00010000:00080000:2.0:1789130947.159495:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91de01a5da40 x1876039508798336/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789130963 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789130947.159505:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01a5da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508798336:0@lo:400:kworker.0 00010000:00080000:2.0:1789130947.159558:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91ddff8e0000 x1876039508798464/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789130963 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789130947.159574:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff8e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1876039508798464:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789130947.159609:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc843c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3628:1876039508797184:0@lo:400:kworker.0 00010000:00080000:2.0:1789130947.159619:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91de01a5e580 x1876039508797696/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789130963 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789130947.159628:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01a5e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1876039508797696:0@lo:400:kworker.0 00010000:00080000:2.0:1789130947.159637:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91de01a5f0c0 x1876039508798208/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789130963 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789130947.159644:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01a5f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1876039508798208:0@lo:400:kworker.0 00000100:00100000:0.0:1789130947.160012:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1789130947.160098:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7c78780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1876039508798592:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789130947.160150:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130947.160205:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508798592 00000100:00100000:1.0:1789130947.160211:0:8418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508798592 00000100:00100000:1.0:1789130947.160244:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789130947.160251:0:8418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8509680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1876039508798592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789130947.160267:0:8418:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789130947.160696:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc843cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508797056:0@lo:400:kworker.0 00010000:00080000:0.0:1789130947.160715:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91de01a5e940 x1876039508797568/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130963 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789130947.160728:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01a5e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3627:1876039508797568:0@lo:400:kworker.0 00010000:00080000:0.0:1789130947.160741:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91de01a5c780 x1876039508798080/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130963 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789130947.160750:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01a5c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3627:1876039508798080:0@lo:400:kworker.0 00000100:00100000:1.0:1789130947.163320:0:8418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8509680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1876039508798592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3054us (3155us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130947.163353:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00010000:00080000:0.0:1789130947.163830:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc7c78780 x1876039508798592/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789130963 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789130947.163876:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7c78780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1876039508798592:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789130947.473653:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789130947.686150:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff8e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1876039508798720:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789130947.686252:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130947.686365:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508798720 00000100:00100000:2.0:1789130947.686375:0:8418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508798720 00000100:00100000:2.0:1789130947.686431:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1789130947.686441:0:8418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff8e30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1876039508798720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789130947.686512:0:8418:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789130947.686730:0:8418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff8e30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1876039508798720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 288us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130947.686739:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00010000:00080000:2.0:1789130947.686788:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91ddff8e0000 x1876039508798720/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789130963 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789130947.686811:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff8e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1876039508798720:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789130948.177817:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8494780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508798848:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789130948.177885:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130948.177917:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508798848 00000100:00100000:3.0:1789130948.177929:0:8418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508798848 00000100:00100000:3.0:1789130948.177995:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789130948.178006:0:8418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff8e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508798848:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789130948.178028:0:8418:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789130948.178076:0:8418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff8e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508798848:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130948.178083:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00010000:00080000:3.0:1789130948.178121:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc8494780 x1876039508798848/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789130964 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130948.178139:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8494780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508798848:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1789130948.499042:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130949.521649:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789130950.227326:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8509e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1876039508798976:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789130950.227396:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130950.227500:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff8e21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1876039508799104:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789130950.230727:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130950.233731:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508798976 00000100:00100000:1.0:1789130950.233742:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508798976 00000100:00100000:1.0:1789130950.233793:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508799104 00000100:00100000:1.0:1789130950.233796:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508799104 00000100:00100000:1.0:1789130950.233815:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1789130950.233824:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8495a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1876039508798976:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789130950.233861:0:6505:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789130950.233933:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8495a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1876039508798976:12345-0@lo:41:osp-pre-0-1.0 Request processed in 111us (6537us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130950.233941:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1789130950.233958:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1789130950.233965:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01a5c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1876039508799104:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789130950.233981:0:6505:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789130950.234022:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01a5c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1876039508799104:12345-0@lo:41:osp-pre-1-0.0 Request processed in 57us (3302us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130950.234028:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1789130950.234376:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff8e21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1876039508799104:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789130950.234430:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8509e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1876039508798976:0@lo:41:osp-pre-0-1.0 00000020:00000080:2.0:1789130950.479318:0:13661:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff86d71480 20000000:00000080:2.0:1789130950.479336:0:13661:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff91dcc85bb000 uarg=0000000000000000 20000000:01000000:2.0:1789130950.479378:0:13661:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='lod.lustre-MDT0000-mdtlov.enable_compr_rotational=1' 20000000:01000000:2.0:1789130950.479386:0:13661:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.lustre-MDT0000-mdtlov.enable_compr_rotational=1' 20000000:01000000:2.0:1789130950.479390:0:13661:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/lod.lustre-MDT0000-mdtlov.enable_compr_rotational=1 del=0 00000040:00080000:1.0:1789130950.488122:0:13662:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:2.0:1789130950.488300:0:13661:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.lod.lustre-MDT0000-mdtlov.enable_compr_rotational=1 in log params 00000040:00080000:0.0:1789130950.500850:0:13661:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:0.0:1789130950.500888:0:13661:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 144 off9680 00000040:00080000:0.0:1789130950.500905:0:13661:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9904 10000000:01000000:0.0:1789130950.500919:0:13661:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789130950.500940:0:13661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91ddfa939e00/0xf3fe2838e1fc2300 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130950.500959:0:13661:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91ddc0030200/0xf3fe2838e1fc22c1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc22ba expref: 23 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130950.500997:0:13661:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91dcc7f7ee00/0xf3fe2838e1fc22cf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc22c8 expref: 23 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130950.501005:0:13661:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91dde19abc00/0xf3fe2838e1fc22dd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc22d6 expref: 23 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130950.501012:0:13661:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91dde19aa600/0xf3fe2838e1fc22eb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc22e4 expref: 23 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130950.501021:0:13661:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91dcc7f7fa00/0xf3fe2838e1fc22f2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d2698df expref: 12 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130950.501029:0:13661:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91dcc7f7e000/0xf3fe2838e1fc22f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d2698e6 expref: 12 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130950.501036:0:13661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91ddfa939e00/0xf3fe2838e1fc2300 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130950.501075:0:13661:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91dcc7f7e000/0xf3fe2838e1fc22f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d2698e6 expref: 12 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130950.501089:0:13661:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91dcc7f7e000/0xf3fe2838e1fc22f9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d2698e6 expref: 12 pid: 6493 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130950.501104:0:13661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc850b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13661:1876039508799232:192.168.203.11@tcp:104: 00010000:00010000:0.0:1789130950.501205:0:13661:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91dcc7f7fa00/0xf3fe2838e1fc22f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d2698df expref: 12 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130950.501214:0:13661:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91dcc7f7fa00/0xf3fe2838e1fc22f2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d2698df expref: 12 pid: 6493 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130950.501229:0:13661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc85092c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13661:1876039508799360:192.168.203.11@tcp:104: 00010000:00010000:0.0:1789130950.501259:0:13661:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91dde19aa600/0xf3fe2838e1fc22eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf3fe2838e1fc22e4 expref: 23 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130950.501268:0:13661:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91dde19aa600/0xf3fe2838e1fc22eb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf3fe2838e1fc22e4 expref: 23 pid: 6492 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130950.501277:0:13661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc85083c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13661:1876039508799488:0@lo:104: 00000100:00100000:0.0:1789130950.501323:0:13661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789130950.502094:0:13661:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91dde19abc00/0xf3fe2838e1fc22dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf3fe2838e1fc22d6 expref: 23 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130950.502106:0:13661:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91dde19abc00/0xf3fe2838e1fc22dd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf3fe2838e1fc22d6 expref: 23 pid: 6492 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130950.502116:0:13661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc850a580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13661:1876039508799616:0@lo:104: 00010000:00010000:0.0:1789130950.502147:0:13661:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91dcc7f7ee00/0xf3fe2838e1fc22cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf3fe2838e1fc22c8 expref: 23 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130950.502155:0:13661:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91dcc7f7ee00/0xf3fe2838e1fc22cf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf3fe2838e1fc22c8 expref: 23 pid: 6493 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130950.502163:0:13661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8509a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13661:1876039508799744:0@lo:104: 00010000:00010000:0.0:1789130950.502188:0:13661:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91ddc0030200/0xf3fe2838e1fc22c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf3fe2838e1fc22ba expref: 23 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130950.502196:0:13661:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91ddc0030200/0xf3fe2838e1fc22c1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf3fe2838e1fc22ba expref: 23 pid: 6494 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130950.502217:0:13661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc850b0c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13661:1876039508799872:0@lo:104: 00000100:00100000:0.0:1789130950.502239:0:13661:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddc4c14c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789130950.506345:0:6484:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1789130950.506391:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130950.506438:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130950.506473:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130950.506498:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508799488 00000100:00100000:1.0:1789130950.506506:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508799488 00000100:00100000:2.0:1789130950.506512:0:9503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508799616 00000100:00100000:2.0:1789130950.506588:0:9503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508799616 00000100:00100000:2.0:1789130950.506625:0:9503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508799744 00000100:00100000:2.0:1789130950.506628:0:9503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508799744 00000100:00100000:2.0:1789130950.506636:0:9503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508799872 00000100:00100000:2.0:1789130950.506638:0:9503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508799872 00000100:00100000:2.0:1789130950.506652:0:9503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789130950.506661:0:9503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7c78f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+6:13661:x1876039508799616:12345-0@lo:104: 00010000:00010000:2.0:1789130950.506678:0:9503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff91ddc0030800/0xf3fe2838e1fc22d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3fe2838e1fc22dd expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130950.506755:0:9503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789130950.506761:0:9503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7c78f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+6:13661:x1876039508799616:12345-0@lo:104: Request processed in 102us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130950.506768:0:9503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789130950.506783:0:9503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789130950.506789:0:9503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7c7a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+5:13661:x1876039508799744:12345-0@lo:104: 00010000:00010000:2.0:1789130950.506807:0:9503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff91dde19aae00/0xf3fe2838e1fc22c8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3fe2838e1fc22cf expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130950.506838:0:9503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789130950.507222:0:9503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7c7a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+5:13661:x1876039508799744:12345-0@lo:104: Request processed in 432us (783us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130950.507229:0:9503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789130950.507244:0:9503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789130950.507250:0:9503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7c79a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+4:13661:x1876039508799872:12345-0@lo:104: 00010000:00010000:2.0:1789130950.507258:0:9503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff91ddc0030400/0xf3fe2838e1fc22ba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3fe2838e1fc22c1 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130950.507323:0:9503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1789130950.507329:0:9503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7c79a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+4:13661:x1876039508799872:12345-0@lo:104: Request processed in 79us (870us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130950.507335:0:9503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789130950.507511:0:13661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc850a580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13661:1876039508799616:0@lo:104: 00000100:00100000:0.0:1789130950.507529:0:13661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8509a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13661:1876039508799744:0@lo:104: 00000100:00100000:0.0:1789130950.507537:0:13661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc850b0c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13661:1876039508799872:0@lo:104: 00000100:00100000:1.0:1789130950.507844:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789130950.507853:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff844050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+3:13661:x1876039508799488:12345-0@lo:104: 00010000:00010000:1.0:1789130950.507863:0:6484:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff91ddc0031400/0xf3fe2838e1fc22e4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3fe2838e1fc22eb expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130950.507900:0:6484:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1789130950.507905:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff844050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+3:13661:x1876039508799488:12345-0@lo:104: Request processed in 55us (6583us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130950.507911:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00010000:1.0:1789130950.507946:0:6488:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1789130950.507953:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff91ddc0030800/0xf3fe2838e1fc22d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3fe2838e1fc22dd expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130950.507960:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddc0030800 already unused, calling callback (ffffffffc124bc20) 10000000:00010000:1.0:1789130950.507964:0:6488:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff91ddc0030800/0xf3fe2838e1fc22d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xf3fe2838e1fc22dd expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130950.507983:0:6488:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff91ddc0030800/0xf3fe2838e1fc22d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xf3fe2838e1fc22dd expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789130950.508002:0:6488:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff91ddc0030800/0xf3fe2838e1fc22d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xf3fe2838e1fc22dd expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789130950.508008:0:6488:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:0.0:1789130950.508043:0:13661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc85083c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13661:1876039508799488:0@lo:104: 00010000:00010000:1.0:1789130950.508047:0:6488:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff91ddc0030800/0xf3fe2838e1fc22d6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc22dd expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130950.508055:0:6488:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789130950.508086:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff91ddc0030800/0xf3fe2838e1fc22d6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc22dd expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130950.508094:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff91ddc0030800/0xf3fe2838e1fc22d6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc22dd expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130950.508105:0:6488:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789130950.508109:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff91dde19aae00/0xf3fe2838e1fc22c8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3fe2838e1fc22cf expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130950.508114:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dde19aae00 already unused, calling callback (ffffffffc124bc20) 10000000:00010000:1.0:1789130950.508117:0:6488:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff91dde19aae00/0xf3fe2838e1fc22c8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf3fe2838e1fc22cf expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130950.508123:0:6488:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff91dde19aae00/0xf3fe2838e1fc22c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf3fe2838e1fc22cf expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789130950.508130:0:6488:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff91dde19aae00/0xf3fe2838e1fc22c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf3fe2838e1fc22cf expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789130950.508135:0:6488:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789130950.508157:0:6488:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff91dde19aae00/0xf3fe2838e1fc22c8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc22cf expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130950.508164:0:6488:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789130950.508186:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff91dde19aae00/0xf3fe2838e1fc22c8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc22cf expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130950.508192:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff91dde19aae00/0xf3fe2838e1fc22c8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc22cf expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130950.508202:0:6488:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789130950.508205:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff91ddc0030400/0xf3fe2838e1fc22ba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3fe2838e1fc22c1 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130950.508211:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddc0030400 already unused, calling callback (ffffffffc124bc20) 10000000:00010000:1.0:1789130950.508213:0:6488:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff91ddc0030400/0xf3fe2838e1fc22ba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf3fe2838e1fc22c1 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130950.508219:0:6488:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff91ddc0030400/0xf3fe2838e1fc22ba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf3fe2838e1fc22c1 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789130950.508225:0:6488:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff91ddc0030400/0xf3fe2838e1fc22ba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf3fe2838e1fc22c1 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789130950.508230:0:6488:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789130950.508243:0:6488:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff91ddc0030400/0xf3fe2838e1fc22ba lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc22c1 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130950.508248:0:6488:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789130950.508253:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff91ddc0030400/0xf3fe2838e1fc22ba lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc22c1 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130950.508271:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff91ddc0030400/0xf3fe2838e1fc22ba lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc22c1 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130950.508280:0:6488:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789130950.508283:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff91ddc0031400/0xf3fe2838e1fc22e4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3fe2838e1fc22eb expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130950.508289:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddc0031400 already unused, calling callback (ffffffffc124bc20) 10000000:00010000:1.0:1789130950.508292:0:6488:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff91ddc0031400/0xf3fe2838e1fc22e4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf3fe2838e1fc22eb expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130950.508300:0:6488:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff91ddc0031400/0xf3fe2838e1fc22e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf3fe2838e1fc22eb expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789130950.508319:0:6488:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff91ddc0031400/0xf3fe2838e1fc22e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf3fe2838e1fc22eb expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789130950.508325:0:6488:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:0.0:1789130950.508329:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7c78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3628:1876039508800000:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789130950.508341:0:6488:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff91ddc0031400/0xf3fe2838e1fc22e4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc22eb expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130950.508348:0:6488:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789130950.508355:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff91ddc0031400/0xf3fe2838e1fc22e4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc22eb expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130950.508363:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff91ddc0031400/0xf3fe2838e1fc22e4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc22eb expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130950.508373:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789130950.508379:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130950.508388:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130950.508390:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789130950.508411:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7816940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3627:1876039508800384:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789130950.508440:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130950.508498:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508800000 00000100:00100000:1.0:1789130950.508503:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508800000 00000100:00100000:0.0:1789130950.508741:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508800384 00010000:00010000:1.0:1789130950.508746:0:8431:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91dde19abc00/0xf3fe2838e1fc22dd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3fe2838e1fc22d6 expref: 24 pid: 6492 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130950.508747:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508800384 00010000:00010000:0.0:1789130950.508769:0:6486:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91dde19aa600/0xf3fe2838e1fc22eb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3fe2838e1fc22e4 expref: 25 pid: 6492 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130950.508776:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789130950.508788:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8509e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+25:3628:x1876039508800000:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789130950.508799:0:8431:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1789130950.508803:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00010000:00010000:1.0:1789130950.508806:0:8431:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91dde19abc00/0xf3fe2838e1fc22dd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3fe2838e1fc22d6 expref: 25 pid: 6492 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130950.508815:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7817840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+25:3627:x1876039508800384:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789130950.508820:0:8431:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91dde19abc00/0xf3fe2838e1fc22dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf3fe2838e1fc22d6 expref: 25 pid: 6492 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130950.508825:0:6486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789130950.508833:0:6486:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91dde19aa600/0xf3fe2838e1fc22eb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3fe2838e1fc22e4 expref: 25 pid: 6492 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130950.508839:0:8431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91dde19abc00/0xf3fe2838e1fc22dd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf3fe2838e1fc22d6 expref: 25 pid: 6492 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130950.508847:0:6486:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91dde19aa600/0xf3fe2838e1fc22eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf3fe2838e1fc22e4 expref: 25 pid: 6492 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130950.509076:0:8431:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789130950.509081:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91dde19aa600/0xf3fe2838e1fc22eb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf3fe2838e1fc22e4 expref: 24 pid: 6492 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130950.509092:0:6486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789130950.509119:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8509e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+23:3628:x1876039508800000:12345-0@lo:103:ldlm_bl.0 Request processed in 333us (745us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130950.509128:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789130950.509146:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7817840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+22:3627:x1876039508800384:12345-0@lo:103:ldlm_bl.0 Request processed in 332us (702us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130950.509155:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789130950.509169:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7816940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3627:1876039508800384:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789130950.509196:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7c78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3628:1876039508800000:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789130950.509236:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7c78780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3625:1876039508800128:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789130950.509269:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130950.509312:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789130950.509319:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7814000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3625:1876039508800256:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789130950.509340:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130950.509403:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508800128 00000100:00100000:1.0:1789130950.509413:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508800128 00010000:00010000:1.0:1789130950.509428:0:8431:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91dcc7f7ee00/0xf3fe2838e1fc22cf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3fe2838e1fc22c8 expref: 22 pid: 6493 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130950.509453:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508800256 00000100:00100000:1.0:1789130950.509486:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508800256 00010000:00010000:1.0:1789130950.509498:0:8431:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91ddc0030200/0xf3fe2838e1fc22c1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3fe2838e1fc22ba expref: 23 pid: 6494 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130950.509821:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789130950.509828:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789130950.510179:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789130950.510189:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01a5e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+23:3625:x1876039508800128:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789130950.510199:0:8431:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789130950.510204:0:8431:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91dcc7f7ee00/0xf3fe2838e1fc22cf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3fe2838e1fc22c8 expref: 23 pid: 6493 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130950.510214:0:8431:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91dcc7f7ee00/0xf3fe2838e1fc22cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf3fe2838e1fc22c8 expref: 23 pid: 6493 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130950.510226:0:8431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91dcc7f7ee00/0xf3fe2838e1fc22cf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf3fe2838e1fc22c8 expref: 23 pid: 6493 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130950.510237:0:8431:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789130950.510282:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01a5e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+22:3625:x1876039508800128:12345-0@lo:103:ldlm_bl.0 Request processed in 96us (1013us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130950.510289:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789130950.510313:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789130950.510320:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01a5f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+21:3625:x1876039508800256:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789130950.510327:0:8431:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789130950.510331:0:8431:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91ddc0030200/0xf3fe2838e1fc22c1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3fe2838e1fc22ba expref: 21 pid: 6494 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130950.510351:0:8431:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91ddc0030200/0xf3fe2838e1fc22c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf3fe2838e1fc22ba expref: 21 pid: 6494 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130950.510361:0:8431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91ddc0030200/0xf3fe2838e1fc22c1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf3fe2838e1fc22ba expref: 21 pid: 6494 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130950.510369:0:8431:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789130950.510393:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01a5f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+20:3625:x1876039508800256:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (1052us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130950.510398:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789130950.510479:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7814000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3625:1876039508800256:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789130950.510489:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7c78780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3625:1876039508800128:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789130950.512194:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789130950.512278:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789130950.512317:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498224256 00000100:00100000:2.0:1789130950.512325:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498224256 00010000:00010000:2.0:1789130950.512357:0:6487:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91dcc7f7e000/0xf3fe2838e1fc22f9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d2698e6 expref: 13 pid: 6493 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130950.512377:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498224384 00000100:00100000:2.0:1789130950.512380:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498224384 00010000:00010000:2.0:1789130950.512391:0:6487:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91dcc7f7fa00/0xf3fe2838e1fc22f2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d2698df expref: 14 pid: 6493 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130950.512424:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 50 00000100:00100000:2.0:1789130950.512433:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01a5e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+14:2387:x1876039498224256:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789130950.512445:0:6487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789130950.512450:0:6487:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91dcc7f7e000/0xf3fe2838e1fc22f9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d2698e6 expref: 14 pid: 6493 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130950.512479:0:6487:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91dcc7f7e000/0xf3fe2838e1fc22f9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d2698e6 expref: 14 pid: 6493 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130950.512497:0:6487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789130950.512541:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01a5e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+14:2387:x1876039498224256:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 109us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130950.512550:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 50 00000100:00100000:2.0:1789130950.512566:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 51 00000100:00100000:2.0:1789130950.512572:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01a5da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+13:2387:x1876039498224384:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789130950.512579:0:6487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789130950.512584:0:6487:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91dcc7f7fa00/0xf3fe2838e1fc22f2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d2698df expref: 13 pid: 6493 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130950.512593:0:6487:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91dcc7f7fa00/0xf3fe2838e1fc22f2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d2698df expref: 13 pid: 6493 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130950.512605:0:6487:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91ddfa939e00/0xf3fe2838e1fc2300 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 13661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130950.512612:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91ddfa939e00/0xf3fe2838e1fc2300 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 13661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130950.512634:0:6487:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91ddfa939e00/0xf3fe2838e1fc2300 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130950.512642:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91ddfa939e00/0xf3fe2838e1fc2300 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130950.512649:0:6487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91ddfa939e00/0xf3fe2838e1fc2300 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130950.512656:0:6487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91ddfa939e00/0xf3fe2838e1fc2300 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130950.512662:0:6487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddfa939e00 already unused, calling callback (ffffffffc0c4e550) 00010000:00010000:2.0:1789130950.512667:0:6487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91ddfa939e00/0xf3fe2838e1fc2300 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130950.512675:0:6487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91ddfa939e00/0xf3fe2838e1fc2300 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130950.512684:0:6487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91ddfa939e00/0xf3fe2838e1fc2300 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130950.512692:0:6487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789130950.512712:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01a5da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+13:2387:x1876039498224384:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 140us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130950.512718:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 51 00010000:00010000:0.0:1789130950.515137:0:13661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91dcc7f7e000/0xf3fe2838e1fc22f9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d2698e6 expref: 12 pid: 6493 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130950.515158:0:13661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc850b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13661:1876039508799232:192.168.203.11@tcp:104: 00010000:00010000:0.0:1789130950.515172:0:13661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91dcc7f7fa00/0xf3fe2838e1fc22f2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d2698df expref: 11 pid: 6493 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130950.515182:0:13661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc85092c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13661:1876039508799360:192.168.203.11@tcp:104: 00010000:00010000:0.0:1789130950.515217:0:13661:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91ddfa939e00/0xf3fe2838e1fc2300 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130950.515226:0:13661:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91ddfa939e00/0xf3fe2838e1fc2300 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130950.515232:0:13661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91ddfa939e00/0xf3fe2838e1fc2300 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130950.515237:0:13661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91ddfa939e00/0xf3fe2838e1fc2300 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130950.546048:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789130951.518254:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789130951.518352:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789130951.519674:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498224640 00000100:00100000:2.0:1789130951.519688:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498224640 00000100:00100000:2.0:1789130951.519760:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 215 00000100:00100000:2.0:1789130951.519773:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc85092c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+6:2388:x1876039498224640:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1789130951.519856:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc85092c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+6:2388:x1876039498224640:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 86us (1502us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130951.519864:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 215 00000100:00080000:2.0:1789130951.519891:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789130951.520988:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498224512 00000100:00100000:1.0:1789130951.520998:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498224512 00000100:00100000:1.0:1789130951.521079:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 337 00000100:00100000:1.0:1789130951.521088:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8607050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+11:2388:x1876039498224512:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1789130951.521156:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8607050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+11:2388:x1876039498224512:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 68us (2911us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130951.521163:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 337 00000100:00100000:0.0:1789130951.526520:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789130951.526559:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789130951.533016:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498224768 00000100:00100000:2.0:1789130951.533032:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498224768 00000100:00100000:2.0:1789130951.533110:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498224896 00000100:00100000:2.0:1789130951.533114:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498224896 00000100:00100000:2.0:1789130951.533149:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 216 00000100:00080000:1.0:1789130951.533156:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789130951.533161:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc850b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+5:2388:x1876039498224768:12345-192.168.203.11@tcp:400:kworker.0 00000100:00080000:1.0:1789130951.533164:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789130951.533258:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc850b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+5:2388:x1876039498224768:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 99us (6744us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130951.533265:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 216 00000100:00100000:2.0:1789130951.533287:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 217 00000100:00100000:2.0:1789130951.533306:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc85083c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fde8d4a8-44db-4e6b-8249-c1c295e4901d+5:2388:x1876039498224896:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1789130951.533335:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc85083c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fde8d4a8-44db-4e6b-8249-c1c295e4901d+5:2388:x1876039498224896:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 42us (6775us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130951.533342:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 217 00000100:00100000:2.0:1789130951.540173:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789130951.540269:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498225024 00000100:00100000:1.0:1789130951.540279:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498225024 00000100:00100000:1.0:1789130951.540368:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 218 00000100:00100000:1.0:1789130951.540380:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01a5d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fde8d4a8-44db-4e6b-8249-c1c295e4901d+5:2388:x1876039498225024:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1789130951.540486:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01a5d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fde8d4a8-44db-4e6b-8249-c1c295e4901d+5:2388:x1876039498225024:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 107us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130951.540495:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 218 00000100:00080000:2.0:1789130951.540637:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1789130951.569867:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789130951.762112:0:6497:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789130951.762120:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91ddff549800 from 7 10000000:01000000:1.0:1789130951.762125:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789130951.762186:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff91dde19aba00/0xf3fe2838e1fc2307 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130951.762199:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff91dde19aba00/0xf3fe2838e1fc2307 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130951.762211:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff91dde19aba00/0xf3fe2838e1fc2307 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130951.762239:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7816940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508800512:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789130951.762319:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130951.762407:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff91de01a870c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789130951.762549:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508800512 00000100:00100000:0.0:1789130951.762557:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508800512 00000100:00100000:0.0:1789130951.762646:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:0.0:1789130951.762669:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8605c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+20:6497:x1876039508800512:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789130951.762682:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130951.762695:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91ddfa939e00/0xf3fe2838e1fc230e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3fe2838e1fc2307 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130951.762718:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91ddfa939e00/0xf3fe2838e1fc230e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3fe2838e1fc2307 expref: 21 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130951.762729:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91ddfa939e00/0xf3fe2838e1fc230e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc2307 expref: 21 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130951.762738:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ddfa939e00, rc 0) 00000100:00100000:0.0:1789130951.762806:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8605c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+21:6497:x1876039508800512:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 139us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130951.762813:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:1.0:1789130951.762904:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7816940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508800512:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789130951.762920:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff91dde19aba00/0xf3fe2838e1fc2307 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc230e expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130951.762928:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff91dde19aba00/0xf3fe2838e1fc2307 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3fe2838e1fc230e expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130951.762985:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7816940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508800640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789130951.763019:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130951.765711:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff91de01a870c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789130951.765717:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508800640 00000100:00100000:2.0:1789130951.765727:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508800640 00000100:00100000:0.0:1789130951.768033:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:0.0:1789130951.768056:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8603850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+21:6497:x1876039508800640:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789130951.768233:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8603850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+21:6497:x1876039508800640:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 181us (5212us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130951.768241:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:2.0:1789130951.768345:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7816940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508800640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789130951.768405:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01a5fc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508800768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789130951.768491:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130951.772714:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508800768 00000100:00100000:3.0:1789130951.772729:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508800768 00000100:00100000:2.0:1789130951.772759:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddff7d7b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789130951.772921:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:3.0:1789130951.773071:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8602c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+21:6497:x1876039508800768:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789130951.773554:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8602c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+21:6497:x1876039508800768:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 487us (5061us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130951.773571:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:2.0:1789130951.773659:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01a5fc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508800768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789130951.774621:0:13722:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7816940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:13722:1876039508800896:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789130951.774677:0:13722:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130951.774751:0:13722:0:(client.c:2715:ptlrpc_set_wait()) set ffff91de01a87cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789130951.776754:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508800896 00000100:00100000:0.0:1789130951.776768:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508800896 00000100:00100000:0.0:1789130951.776819:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:0.0:1789130951.776828:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8601450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+21:13722:x1876039508800896:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789130951.777130:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8601450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+21:13722:x1876039508800896:12345-0@lo:502:llog_process_th.0 Request processed in 302us (2450us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130951.777138:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:2.0:1789130951.777534:0:13722:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7816940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:13722:1876039508800896:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789130951.777568:0:13722:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789130951.777578:0:13722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789130951.777580:0:13722:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:2.0:1789130951.777586:0:13722:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff91ddff549800 00000020:00000080:2.0:1789130951.777589:0:13722:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789130951.777681:0:13722:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01a5fc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:13722:1876039508801024:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789130951.777725:0:13722:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130951.777754:0:13722:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddff7d7b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789130951.779840:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508801024 00000100:00100000:2.0:1789130951.779860:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508801024 00000100:00100000:2.0:1789130951.779904:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:2.0:1789130951.779913:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8600450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+21:13722:x1876039508801024:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789130951.780062:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8600450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+21:13722:x1876039508801024:12345-0@lo:502:llog_process_th.0 Request processed in 148us (2335us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130951.780071:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:2.0:1789130951.780126:0:13722:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01a5fc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:13722:1876039508801024:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789130951.780156:0:13722:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789130951.780163:0:13722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789130951.780165:0:13722:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000040:00080000:2.0:1789130951.780169:0:13722:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1789130951.780423:0:6497:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1789130951.780442:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789130951.780452:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff91dde19aba00/0xf3fe2838e1fc2307 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc230e expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130951.780490:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff91dde19aba00/0xf3fe2838e1fc2307 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc230e expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789130951.780501:0:6497:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789130951.780503:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91ddff4f9000 from 7 10000000:01000000:2.0:1789130951.780506:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789130951.780532:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7f400/0xf3fe2838e1fc2315 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130951.780540:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7f400/0xf3fe2838e1fc2315 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130951.780548:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7f400/0xf3fe2838e1fc2315 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130951.780566:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01a5fc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508801152:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789130951.780597:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130951.780622:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddff7d7b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789130951.780634:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508801152 00000100:00100000:2.0:1789130951.780638:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508801152 00000100:00100000:2.0:1789130951.780655:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:2.0:1789130951.780661:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8603c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+21:6497:x1876039508801152:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789130951.780671:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130951.780682:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91dcc7f7f200/0xf3fe2838e1fc231c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3fe2838e1fc2315 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130951.780702:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91dcc7f7f200/0xf3fe2838e1fc231c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3fe2838e1fc2315 expref: 22 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130951.780724:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91dcc7f7f200/0xf3fe2838e1fc231c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc2315 expref: 22 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130951.780733:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dcc7f7f200, rc 0) 00000100:00100000:2.0:1789130951.780761:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8603c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+22:6497:x1876039508801152:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 100us (164us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130951.780768:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:2.0:1789130951.780794:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01a5fc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508801152:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789130951.780805:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7f400/0xf3fe2838e1fc2315 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc231c expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130951.780813:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7f400/0xf3fe2838e1fc2315 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3fe2838e1fc231c expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130951.781289:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01a5fc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508801280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789130951.781328:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130951.781348:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddff7d7b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789130951.781361:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508801280 00000100:00100000:2.0:1789130951.781365:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508801280 00000100:00100000:2.0:1789130951.781383:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:2.0:1789130951.781389:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8601850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+22:6497:x1876039508801280:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789130951.782096:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8601850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+22:6497:x1876039508801280:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 705us (767us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130951.782104:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:2.0:1789130951.782141:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01a5fc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508801280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789130951.782178:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01a5fc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508801408:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789130951.783310:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130951.783344:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddff7d7b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789130951.783362:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508801408 00000100:00100000:2.0:1789130951.783367:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508801408 00000100:00100000:2.0:1789130951.783999:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:2.0:1789130951.784009:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8600850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+22:6497:x1876039508801408:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789130951.784114:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8600850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+22:6497:x1876039508801408:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 105us (805us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130951.784121:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:1.0:1789130951.789213:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01a5fc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508801408:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789130951.794176:0:13724:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7814000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:13724:1876039508801536:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789130951.794276:0:13724:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130951.794337:0:13724:0:(client.c:2715:ptlrpc_set_wait()) set ffff91de01a87180 going to sleep for 11 seconds 00000100:00100000:0.0:1789130951.795717:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508801536 00000100:00100000:0.0:1789130951.795730:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508801536 00000100:00100000:0.0:1789130951.795790:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:0.0:1789130951.795800:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8600050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+22:13724:x1876039508801536:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789130951.796061:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8600050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+22:13724:x1876039508801536:12345-0@lo:502:llog_process_th.0 Request processed in 261us (1784us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130951.796069:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:1.0:1789130951.796997:0:13724:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7814000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:13724:1876039508801536:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789130951.797034:0:13724:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789130951.797044:0:13724:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789130951.797046:0:13724:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:1.0:1789130951.797056:0:13724:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff91ddff4f9000 00000020:00000080:1.0:1789130951.797058:0:13724:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789130951.797146:0:13724:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7814000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:13724:1876039508801664:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789130951.797196:0:13724:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130951.797225:0:13724:0:(client.c:2715:ptlrpc_set_wait()) set ffff91de01a87180 going to sleep for 11 seconds 00000100:00100000:0.0:1789130951.797393:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508801664 00000100:00100000:0.0:1789130951.797408:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508801664 00000100:00100000:0.0:1789130951.797440:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:0.0:1789130951.797447:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8602850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+22:13724:x1876039508801664:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789130951.797545:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8602850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+22:13724:x1876039508801664:12345-0@lo:502:llog_process_th.0 Request processed in 98us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130951.797553:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:1.0:1789130951.798226:0:13724:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7814000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:13724:1876039508801664:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789130951.798251:0:13724:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789130951.798257:0:13724:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789130951.798259:0:13724:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000040:00080000:1.0:1789130951.798264:0:13724:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1789130951.798339:0:6497:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1789130951.798360:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789130951.798370:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7f400/0xf3fe2838e1fc2315 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc231c expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130951.798381:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7f400/0xf3fe2838e1fc2315 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc231c expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789130951.799487:0:6497:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789130951.799498:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91ddfce33000 from 7 10000000:01000000:1.0:1789130951.799502:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789130951.799534:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff91dde19aae00/0xf3fe2838e1fc2323 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130951.799543:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff91dde19aae00/0xf3fe2838e1fc2323 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130951.799553:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff91dde19aae00/0xf3fe2838e1fc2323 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130951.799573:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7814000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508801792:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789130951.799624:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130951.799660:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff91de01a87180 going to sleep for 11 seconds 00000100:00100000:3.0:1789130951.800064:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508801792 00000100:00100000:3.0:1789130951.800070:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508801792 00000100:00100000:3.0:1789130951.800105:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:3.0:1789130951.800113:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8602450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+22:6497:x1876039508801792:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789130951.800125:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130951.800136:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91ddfd0b5a00/0xf3fe2838e1fc232a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3fe2838e1fc2323 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130951.800158:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91ddfd0b5a00/0xf3fe2838e1fc232a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3fe2838e1fc2323 expref: 23 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130951.800169:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91ddfd0b5a00/0xf3fe2838e1fc232a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc2323 expref: 23 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130951.800177:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ddfd0b5a00, rc 0) 00000100:00100000:3.0:1789130951.800218:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8602450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+23:6497:x1876039508801792:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 105us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130951.800225:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:0.0:1789130951.800337:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7814000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508801792:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789130951.800351:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff91dde19aae00/0xf3fe2838e1fc2323 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc232a expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130951.800360:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff91dde19aae00/0xf3fe2838e1fc2323 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3fe2838e1fc232a expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130951.800983:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc850b0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508801920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789130951.801018:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130951.801096:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddc3293180 going to sleep for 11 seconds 00000100:00100000:3.0:1789130951.801149:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508801920 00000100:00100000:3.0:1789130951.801154:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508801920 00000100:00100000:3.0:1789130951.801183:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:3.0:1789130951.801189:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8603050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+23:6497:x1876039508801920:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789130951.805549:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8603050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+23:6497:x1876039508801920:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 4350us (4520us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130951.805562:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:1.0:1789130951.808399:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc850b0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508801920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789130951.808958:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7814000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508802048:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789130951.809040:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130951.809088:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff91de01a87540 going to sleep for 11 seconds 00000100:00100000:0.0:1789130951.809216:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508802048 00000100:00100000:0.0:1789130951.809223:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508802048 00000100:00100000:0.0:1789130951.809279:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:0.0:1789130951.809307:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8601c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+23:6497:x1876039508802048:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789130951.809422:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8601c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+23:6497:x1876039508802048:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 126us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130951.809430:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:1.0:1789130951.809672:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7814000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508802048:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789130951.813608:0:13726:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7814000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:13726:1876039508802176:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789130951.813687:0:13726:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130951.813725:0:13726:0:(client.c:2715:ptlrpc_set_wait()) set ffff91de01a87f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789130951.815041:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508802176 00000100:00100000:3.0:1789130951.815058:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508802176 00000100:00100000:3.0:1789130951.815104:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:3.0:1789130951.815112:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8602050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+23:13726:x1876039508802176:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789130951.815254:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8602050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+23:13726:x1876039508802176:12345-0@lo:502:llog_process_th.0 Request processed in 142us (1567us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130951.815263:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:2.0:1789130951.815382:0:13726:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7814000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:13726:1876039508802176:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789130951.815413:0:13726:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789130951.815423:0:13726:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789130951.815425:0:13726:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:2.0:1789130951.815433:0:13726:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff91ddfce33000 00000020:00000080:2.0:1789130951.815435:0:13726:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789130951.815535:0:13726:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01a5d2c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:13726:1876039508802304:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789130951.815578:0:13726:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130951.815606:0:13726:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddff7d7000 going to sleep for 11 seconds 00000100:00100000:3.0:1789130951.815659:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508802304 00000100:00100000:3.0:1789130951.815664:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508802304 00000100:00100000:3.0:1789130951.815696:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:3.0:1789130951.815704:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8600c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+23:13726:x1876039508802304:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789130951.815767:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8600c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+23:13726:x1876039508802304:12345-0@lo:502:llog_process_th.0 Request processed in 63us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130951.815774:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:2.0:1789130951.816178:0:13726:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01a5d2c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:13726:1876039508802304:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789130951.816199:0:13726:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789130951.816204:0:13726:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789130951.816206:0:13726:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000040:00080000:2.0:1789130951.816210:0:13726:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1789130951.816391:0:6497:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1789130951.816416:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789130951.816426:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff91dde19aae00/0xf3fe2838e1fc2323 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc232a expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130951.816436:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff91dde19aae00/0xf3fe2838e1fc2323 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc232a expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789130951.816453:0:6497:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789130951.816486:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91dded7b6800 from 7 10000000:01000000:1.0:1789130951.816489:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789130951.816514:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff91dde19abc00/0xf3fe2838e1fc2331 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130951.816521:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff91dde19abc00/0xf3fe2838e1fc2331 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130951.816530:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff91dde19abc00/0xf3fe2838e1fc2331 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130951.816544:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7816940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508802432:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789130951.816582:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130951.816604:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff91de01a876c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789130951.816678:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508802432 00000100:00100000:3.0:1789130951.816684:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508802432 00000100:00100000:3.0:1789130951.816720:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:3.0:1789130951.816728:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8601050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+23:6497:x1876039508802432:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789130951.816737:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130951.816750:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91ddfd0b4800/0xf3fe2838e1fc2338 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3fe2838e1fc2331 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130951.816770:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91ddfd0b4800/0xf3fe2838e1fc2338 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3fe2838e1fc2331 expref: 24 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130951.816780:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91ddfd0b4800/0xf3fe2838e1fc2338 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc2331 expref: 24 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130951.818496:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ddfd0b4800, rc 0) 00000100:00100000:3.0:1789130951.818578:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8601050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+24:6497:x1876039508802432:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1848us (1992us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130951.818585:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:1.0:1789130951.819025:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7816940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508802432:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789130951.819047:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff91dde19abc00/0xf3fe2838e1fc2331 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc2338 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130951.819058:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff91dde19abc00/0xf3fe2838e1fc2331 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3fe2838e1fc2338 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130951.819135:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7816940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508802560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789130951.819170:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130951.819198:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff91de01a876c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789130951.819215:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508802560 00000100:00100000:1.0:1789130951.819219:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508802560 00000100:00100000:1.0:1789130951.819263:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:1.0:1789130951.819271:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8603450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+24:6497:x1876039508802560:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789130951.819389:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8603450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+24:6497:x1876039508802560:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 120us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130951.819396:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:1.0:1789130951.819423:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7816940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508802560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789130951.819450:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7816940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508802688:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789130951.819506:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130951.819519:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff91de01a876c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789130951.819530:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508802688 00000100:00100000:1.0:1789130951.819533:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508802688 00000100:00100000:1.0:1789130951.819549:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:1.0:1789130951.819555:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddf5cc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+24:6497:x1876039508802688:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789130951.819628:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddf5cc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+24:6497:x1876039508802688:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 73us (122us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130951.819635:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:1.0:1789130951.819674:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7816940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508802688:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789130951.819877:0:13727:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7816940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:13727:1876039508802816:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789130951.819912:0:13727:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130951.819931:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508802816 00000100:00100000:1.0:1789130951.819935:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508802816 00000100:00100000:1.0:1789130951.819953:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:1.0:1789130951.819959:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddf5cc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+24:13727:x1876039508802816:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789130951.820025:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddf5cc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+24:13727:x1876039508802816:12345-0@lo:502:llog_process_th.0 Request processed in 65us (112us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130951.820037:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:1.0:1789130951.820061:0:13727:0:(client.c:2715:ptlrpc_set_wait()) set ffff91de01a873c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789130951.820074:0:13727:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7816940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:13727:1876039508802816:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789130951.820094:0:13727:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789130951.820103:0:13727:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789130951.820105:0:13727:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:1.0:1789130951.820116:0:13727:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff91dded7b6800 00000020:00000080:1.0:1789130951.820118:0:13727:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789130951.820178:0:13727:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7816940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:13727:1876039508802944:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789130951.820211:0:13727:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130951.820229:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508802944 00000100:00100000:1.0:1789130951.820232:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508802944 00000100:00100000:1.0:1789130951.820249:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:1.0:1789130951.820255:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddf5cc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+24:13727:x1876039508802944:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789130951.820322:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddf5cc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+24:13727:x1876039508802944:12345-0@lo:502:llog_process_th.0 Request processed in 66us (110us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130951.820329:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:1.0:1789130951.820355:0:13727:0:(client.c:2715:ptlrpc_set_wait()) set ffff91de01a873c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789130951.820366:0:13727:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7816940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:13727:1876039508802944:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789130951.820382:0:13727:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789130951.820386:0:13727:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789130951.820388:0:13727:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000040:00080000:1.0:1789130951.820392:0:13727:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1789130951.820445:0:6497:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1789130951.820485:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789130951.820493:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff91dde19abc00/0xf3fe2838e1fc2331 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc2338 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130951.820510:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff91dde19abc00/0xf3fe2838e1fc2331 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc2338 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130951.965004:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789130951.965237:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498225152 00000100:00100000:2.0:1789130951.965245:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498225152 00000100:00100000:2.0:1789130951.965331:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 358 00000100:00100000:2.0:1789130951.965340:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddf5cc6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+11:6161:x1876039498225152:12345-192.168.203.11@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789130951.965355:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130951.965371:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91dcc7f7f000/0xf3fe2838e1fc233f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf8eae2996d2698ed expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130951.965397:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91dcc7f7f000/0xf3fe2838e1fc233f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d2698ed expref: 12 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130951.965408:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91dcc7f7f000/0xf3fe2838e1fc233f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d2698ed expref: 12 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130951.965418:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dcc7f7f000, rc 0) 00000100:00100000:2.0:1789130951.965773:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddf5cc6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+12:6161:x1876039498225152:12345-192.168.203.11@tcp:101:ll_cfg_requeue.0 Request processed in 432us (785us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130951.965781:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 358 00000100:00100000:0.0:1789130951.982157:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789130951.982922:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498225280 00000100:00100000:2.0:1789130951.982932:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498225280 00000100:00100000:2.0:1789130951.983042:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 359 00000100:00100000:2.0:1789130951.983053:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddf5cc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+12:6161:x1876039498225280:12345-192.168.203.11@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789130951.983196:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddf5cc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+12:6161:x1876039498225280:12345-192.168.203.11@tcp:501:ll_cfg_requeue.0 Request processed in 145us (1049us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130951.983203:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 359 00000100:00100000:2.0:1789130951.994086:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789130952.002933:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498225408 00000100:00100000:1.0:1789130952.002950:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498225408 00000100:00100000:1.0:1789130952.003189:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 360 00000100:00100000:1.0:1789130952.003202:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddf5cc4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+12:6161:x1876039498225408:12345-192.168.203.11@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789130952.003368:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddf5cc4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+12:6161:x1876039498225408:12345-192.168.203.11@tcp:503:ll_cfg_requeue.0 Request processed in 168us (9940us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130952.003377:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 360 00000100:00100000:1.0:1789130952.010415:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789130952.010605:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498225536 00000100:00100000:2.0:1789130952.010614:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498225536 00000100:00100000:2.0:1789130952.010668:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 361 00000100:00100000:2.0:1789130952.010678:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddf5cc5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+12:10316:x1876039498225536:12345-192.168.203.11@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789130952.010841:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddf5cc5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+12:10316:x1876039498225536:12345-192.168.203.11@tcp:502:llog_process_th.0 Request processed in 165us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130952.010849:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 361 00000100:00100000:0.0:1789130952.017204:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789130952.017777:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498225664 00000100:00100000:3.0:1789130952.017787:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498225664 00000100:00100000:3.0:1789130952.017846:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 362 00000100:00100000:3.0:1789130952.017858:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddf5cc7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+12:10316:x1876039498225664:12345-192.168.203.11@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789130952.018256:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddf5cc7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+12:10316:x1876039498225664:12345-192.168.203.11@tcp:502:llog_process_th.0 Request processed in 399us (1062us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130952.018265:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 362 00000100:00100000:3.0:1789130952.027719:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789130952.027893:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498225792 00000100:00100000:1.0:1789130952.027903:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498225792 00000100:00100000:1.0:1789130952.027961:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 363 00000100:00100000:1.0:1789130952.027970:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddf5cc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+12:6161:x1876039498225792:12345-192.168.203.11@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789130952.027987:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130952.028116:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91dde19aa800/0xf3fe2838e1fc2346 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xf8eae2996d2698f4 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130952.028143:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91dde19aa800/0xf3fe2838e1fc2346 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d2698f4 expref: 13 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130952.028154:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91dde19aa800/0xf3fe2838e1fc2346 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d2698f4 expref: 13 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130952.028181:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dde19aa800, rc 0) 00000100:00100000:1.0:1789130952.028286:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddf5cc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+13:6161:x1876039498225792:12345-192.168.203.11@tcp:101:ll_cfg_requeue.0 Request processed in 317us (576us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130952.028302:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 363 00000100:00100000:1.0:1789130952.037433:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789130952.037952:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498225920 00000100:00100000:3.0:1789130952.037966:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498225920 00000100:00100000:3.0:1789130952.038035:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 364 00000100:00100000:3.0:1789130952.038047:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddf5cc6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+13:6161:x1876039498225920:12345-192.168.203.11@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789130952.038268:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddf5cc6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+13:6161:x1876039498225920:12345-192.168.203.11@tcp:501:ll_cfg_requeue.0 Request processed in 223us (850us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130952.038278:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 364 00000100:00100000:0.0:1789130952.044271:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789130952.044371:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498226048 00000100:00100000:1.0:1789130952.044384:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498226048 00000100:00100000:1.0:1789130952.044451:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 365 00000100:00100000:1.0:1789130952.044499:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddf5cc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+13:6161:x1876039498226048:12345-192.168.203.11@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789130952.044761:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddf5cc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+13:6161:x1876039498226048:12345-192.168.203.11@tcp:503:ll_cfg_requeue.0 Request processed in 299us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130952.044769:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 365 00000100:00100000:2.0:1789130952.062475:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789130952.065394:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498226176 00000100:00100000:3.0:1789130952.065415:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498226176 00000100:00100000:3.0:1789130952.066395:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 366 00000100:00100000:3.0:1789130952.066418:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddf5cc4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+13:10319:x1876039498226176:12345-192.168.203.11@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789130952.068155:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddf5cc4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+13:10319:x1876039498226176:12345-192.168.203.11@tcp:502:llog_process_th.0 Request processed in 1725us (5690us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130952.068172:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 366 00000100:00100000:3.0:1789130952.080181:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789130952.080314:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498226304 00000100:00100000:2.0:1789130952.080326:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498226304 00000100:00100000:2.0:1789130952.080394:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 367 00000100:00100000:2.0:1789130952.080406:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddf5cc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+13:10319:x1876039498226304:12345-192.168.203.11@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789130952.080790:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddf5cc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+13:10319:x1876039498226304:12345-192.168.203.11@tcp:502:llog_process_th.0 Request processed in 384us (623us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130952.080799:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 367 00000100:00100000:0.0:1789130952.274185:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7816940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1876039508803072:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789130952.274305:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130952.274633:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508803072 00000100:00100000:3.0:1789130952.274645:0:8418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508803072 00000100:00100000:0.0:1789130952.275150:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789130952.275163:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01a5fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1876039508803456:0@lo:400:kworker.0 00000100:00100000:0.0:1789130952.275212:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130952.275276:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01a5cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3626:1876039508803328:0@lo:400:kworker.0 00000100:00100000:0.0:1789130952.275322:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130952.275341:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789130952.275346:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01a5d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3626:1876039508803200:0@lo:400:kworker.0 00000100:00100000:0.0:1789130952.275374:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130952.275427:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789130952.275435:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc850b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508803584:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789130952.275483:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789130952.275602:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789130952.275620:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508803456 00000100:00100000:1.0:1789130952.275626:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508803456 00000100:00100000:1.0:1789130952.275683:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1789130952.275924:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508803584 00000100:00100000:3.0:1789130952.275929:0:8418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508803584 00000100:00100000:3.0:1789130952.276099:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789130952.276111:0:8418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8509a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1876039508803072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789130952.276151:0:8418:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789130952.276206:0:8418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8509a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1876039508803072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (1902us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130952.276214:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789130952.276233:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789130952.276238:0:8418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc850b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508803584:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789130952.276247:0:8418:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789130952.276490:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc850a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3628:x1876039508803456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130952.276658:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc850a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3628:x1876039508803456:12345-0@lo:400:kworker.0 Request processed in 965us (1445us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130952.276665:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1789130952.276706:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508803328 00000100:00100000:1.0:1789130952.276711:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508803328 00000100:00100000:3.0:1789130952.277003:0:8418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc850b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508803584:12345-0@lo:13:osp-pre-1-1.0 Request processed in 763us (1518us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130952.277009:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01a5fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1876039508803456:0@lo:400:kworker.0 00000100:00100000:3.0:1789130952.277015:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00010000:00080000:0.0:1789130952.277035:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc7816940 x1876039508803072/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789130968 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789130952.277056:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7816940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1876039508803072:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789130952.277057:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc843cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3625:1876039508803712:0@lo:400:kworker.0 00000100:00100000:0.0:1789130952.277092:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789130952.277106:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130952.277134:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc843c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3628:1876039508803968:0@lo:400:kworker.0 00000100:00100000:3.0:1789130952.277136:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789130952.277146:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc843cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508803840:0@lo:400:kworker.0 00000100:00100000:3.0:1789130952.277179:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130952.277210:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508803840 00000100:00100000:3.0:1789130952.277214:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508803840 00000100:00100000:0.0:1789130952.277239:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130952.277251:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1789130952.277261:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8496d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1876039508803840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130952.277282:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508803712 00000100:00100000:0.0:1789130952.277287:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508803712 00000100:00100000:3.0:1789130952.277319:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8496d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1876039508803840:12345-0@lo:400:kworker.0 Request processed in 57us (137us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130952.277334:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1789130952.277362:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc843cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508803840:0@lo:400:kworker.0 00000100:00100000:0.0:1789130952.277398:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508803968 00000100:00100000:0.0:1789130952.277402:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508803968 00000100:00100000:1.0:1789130952.277423:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1789130952.277430:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8495680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1876039508803712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130952.277495:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8495680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1876039508803712:12345-0@lo:400:kworker.0 Request processed in 64us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130952.277509:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1789130952.277518:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8508b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1876039508803328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130952.277526:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1789130952.277546:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1789130952.277555:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01a5fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3628:x1876039508803968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130952.277565:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8508b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1876039508803328:12345-0@lo:400:kworker.0 Request processed in 48us (2241us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130952.277574:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1789130952.277599:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01a5fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3628:x1876039508803968:12345-0@lo:400:kworker.0 Request processed in 45us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130952.277607:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1789130952.277616:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc843c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3628:1876039508803968:0@lo:400:kworker.0 00000100:00080000:1.0:1789130952.277641:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789130952.277648:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789130952.277707:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01a5cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3626:1876039508803328:0@lo:400:kworker.0 00000100:00100000:1.0:1789130952.277877:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508803200 00000100:00100000:1.0:1789130952.277885:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508803200 00000100:00100000:1.0:1789130952.277923:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:1.0:1789130952.277930:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddf5cc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+24:3626:x1876039508803200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130952.277976:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddf5cc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+24:3626:x1876039508803200:12345-0@lo:400:kworker.0 Request processed in 46us (2600us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130952.277983:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:1.0:1789130952.278018:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01a5d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3626:1876039508803200:0@lo:400:kworker.0 00000100:00100000:2.0:1789130952.279103:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc843fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508804224:0@lo:400:kworker.0 00000100:00100000:2.0:1789130952.279189:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130952.279242:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc843cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3625:1876039508803712:0@lo:400:kworker.0 00000100:00100000:2.0:1789130952.279261:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789130952.279266:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc843c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508804352:0@lo:400:kworker.0 00000100:00100000:2.0:1789130952.279301:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130952.279341:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508804224 00000100:00100000:2.0:1789130952.279347:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508804224 00000100:00100000:2.0:1789130952.279400:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508804352 00000100:00100000:2.0:1789130952.279403:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508804352 00000100:00100000:2.0:1789130952.279428:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789130952.279435:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01ad30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508804224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130952.279923:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01ad30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508804224:12345-0@lo:400:kworker.0 Request processed in 485us (731us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130952.279943:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789130952.279972:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789130952.279979:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01ad2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1876039508804352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130952.280014:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01ad2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1876039508804352:12345-0@lo:400:kworker.0 Request processed in 36us (712us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130952.280019:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00010000:00080000:2.0:1789130952.280078:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc843c000 x1876039508804352/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789130968 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789130952.280091:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc843c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508804352:0@lo:400:kworker.0 00010000:00080000:2.0:1789130952.280102:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc843fc00 x1876039508804224/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789130968 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789130952.280112:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc843fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508804224:0@lo:400:kworker.0 00000100:00080000:2.0:1789130952.280136:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789130952.280501:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc843de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3628:1876039508804096:0@lo:400:kworker.0 00000100:00100000:0.0:1789130952.280809:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130952.280955:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff7c03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3628:1876039508804608:0@lo:400:kworker.0 00000100:00100000:0.0:1789130952.280992:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1789130952.281155:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc850b840 x1876039508803584/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789130968 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130952.281251:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc850b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508803584:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789130952.281282:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc843cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3627:1876039508804480:0@lo:400:kworker.0 00000100:00100000:1.0:1789130952.282379:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508804096 00000100:00100000:1.0:1789130952.282394:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508804096 00000100:00100000:3.0:1789130952.282547:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789130952.282790:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789130952.284036:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508804608 00000100:00100000:1.0:1789130952.284037:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508804480 00000100:00100000:1.0:1789130952.284047:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508804480 00000100:00100000:2.0:1789130952.284048:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508804608 00000100:00100000:2.0:1789130952.284278:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1789130952.284301:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01a5d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3628:x1876039508804096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130952.284413:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01a5d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3628:x1876039508804096:12345-0@lo:400:kworker.0 Request processed in 126us (3603us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130952.284421:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1789130952.284441:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1789130952.284447:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01a5cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3628:x1876039508804608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130952.284510:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01a5cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3628:x1876039508804608:12345-0@lo:400:kworker.0 Request processed in 63us (3517us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130952.284537:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00010000:00080000:0.0:1789130952.284598:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc843de00 x1876039508804096/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130968 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789130952.284617:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc843de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3628:1876039508804096:0@lo:400:kworker.0 00010000:00080000:0.0:1789130952.284632:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91ddff7c03c0 x1876039508804608/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130968 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789130952.284642:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff7c03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3628:1876039508804608:0@lo:400:kworker.0 00000100:00080000:2.0:1789130952.290185:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789130952.290268:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789130952.290749:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1789130952.290765:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc84970c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3627:x1876039508804480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130952.290906:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc84970c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3627:x1876039508804480:12345-0@lo:400:kworker.0 Request processed in 147us (8360us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130952.290937:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1789130952.291360:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc843cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3627:1876039508804480:0@lo:400:kworker.0 00010000:00010000:3.0:1789130952.595624:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789130952.796217:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789130952.796245:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff7c03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508804736:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789130952.796355:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130952.796628:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508804736 00000100:00100000:0.0:1789130952.796639:0:8418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508804736 00000100:00100000:0.0:1789130952.796719:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1789130952.796729:0:8418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8497c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508804736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789130952.796779:0:8418:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789130952.796851:0:8418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8497c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508804736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 123us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130952.796859:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00010000:00080000:3.0:1789130952.797515:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91ddff7c03c0 x1876039508804736/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789130968 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130952.797542:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff7c03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508804736:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789130953.298731:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789130953.298764:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8496940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508804864:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789130953.298850:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130953.298960:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508804864 00000100:00100000:0.0:1789130953.298970:0:8418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508804864 00000100:00100000:0.0:1789130953.299031:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789130953.299042:0:8418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8497840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508804864:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789130953.299071:0:8418:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789130953.299143:0:8418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8497840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508804864:12345-0@lo:13:osp-pre-0-1.0 Request processed in 102us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130953.299151:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00010000:00080000:0.0:1789130953.299199:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc8496940 x1876039508804864/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789130969 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789130953.299221:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8496940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508804864:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1789130953.617819:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130954.643661:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789130955.346524:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7816940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508804992:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789130955.346594:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130955.346674:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508804992 00000100:00100000:1.0:1789130955.346681:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508804992 00000100:00100000:1.0:1789130955.346722:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1789130955.346731:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7814000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508804992:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789130955.346766:0:6506:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789130955.346809:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7814000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508804992:12345-0@lo:41:osp-pre-0-1.0 Request processed in 78us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130955.346817:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1789130955.346858:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7816940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508804992:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789130955.348605:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01ad0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1876039508805120:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789130955.348676:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130955.348792:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508805120 00000100:00100000:2.0:1789130955.348798:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508805120 00000100:00100000:2.0:1789130955.348843:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1789130955.348852:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddfd064b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3628:x1876039508805120:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789130955.348878:0:6505:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789130955.348920:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddfd064b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3628:x1876039508805120:12345-0@lo:41:osp-pre-1-0.0 Request processed in 69us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130955.348928:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1789130955.349009:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01ad0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1876039508805120:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789130955.665937:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789130956.583050:0:13960:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe97460510 20000000:00000080:1.0:1789130956.583069:0:13960:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff91de01adac00 uarg=0000000000000000 20000000:01000000:1.0:1789130956.583111:0:13960:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='lod.lustre-MDT0001-mdtlov.enable_compr_rotational=1' 20000000:01000000:1.0:1789130956.583118:0:13960:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.lustre-MDT0001-mdtlov.enable_compr_rotational=1' 20000000:01000000:1.0:1789130956.583124:0:13960:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/lod.lustre-MDT0001-mdtlov.enable_compr_rotational=1 del=0 00000040:00080000:3.0:1789130956.589511:0:13961:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 20000000:02000000:1.0:1789130956.589801:0:13960:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.lod.lustre-MDT0001-mdtlov.enable_compr_rotational=1 in log params 00000040:00080000:0.0:1789130956.599855:0:13960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10128 00000040:00080000:0.0:1789130956.599893:0:13960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 144 off10272 00000040:00080000:0.0:1789130956.599909:0:13960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 224 off10496 10000000:01000000:0.0:1789130956.599925:0:13960:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789130956.599946:0:13960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91ddfa938c00/0xf3fe2838e1fc234d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130956.599981:0:13960:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91ddfa939e00/0xf3fe2838e1fc230e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc2307 expref: 23 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130956.599989:0:13960:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91dcc7f7f200/0xf3fe2838e1fc231c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc2315 expref: 23 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130956.599995:0:13960:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91ddfd0b5a00/0xf3fe2838e1fc232a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc2323 expref: 23 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130956.600002:0:13960:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91ddfd0b4800/0xf3fe2838e1fc2338 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc2331 expref: 23 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130956.600010:0:13960:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91dcc7f7f000/0xf3fe2838e1fc233f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d2698ed expref: 12 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130956.600017:0:13960:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91dde19aa800/0xf3fe2838e1fc2346 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d2698f4 expref: 12 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130956.600024:0:13960:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91ddfa938c00/0xf3fe2838e1fc234d lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130956.600064:0:13960:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91dde19aa800/0xf3fe2838e1fc2346 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d2698f4 expref: 12 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130956.600081:0:13960:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91dde19aa800/0xf3fe2838e1fc2346 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d2698f4 expref: 12 pid: 6494 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130956.600098:0:13960:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddfd067840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13960:1876039508805248:192.168.203.11@tcp:104: 00010000:00010000:0.0:1789130956.600346:0:13960:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91dcc7f7f000/0xf3fe2838e1fc233f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d2698ed expref: 12 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130956.600361:0:13960:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91dcc7f7f000/0xf3fe2838e1fc233f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d2698ed expref: 12 pid: 6494 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130956.600370:0:13960:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddfd065e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13960:1876039508805376:192.168.203.11@tcp:104: 00010000:00010000:0.0:1789130956.600404:0:13960:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91ddfd0b4800/0xf3fe2838e1fc2338 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf3fe2838e1fc2331 expref: 23 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130956.600411:0:13960:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91ddfd0b4800/0xf3fe2838e1fc2338 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf3fe2838e1fc2331 expref: 23 pid: 6492 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130956.600419:0:13960:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddfd067480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13960:1876039508805504:0@lo:104: 00000100:00100000:0.0:1789130956.600454:0:13960:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789130956.600530:0:13960:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91ddfd0b5a00/0xf3fe2838e1fc232a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf3fe2838e1fc2323 expref: 23 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130956.600538:0:13960:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91ddfd0b5a00/0xf3fe2838e1fc232a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf3fe2838e1fc2323 expref: 23 pid: 6492 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130956.600547:0:13960:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddfd0643c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13960:1876039508805632:0@lo:104: 00000100:00100000:0.0:1789130956.600568:0:13960:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789130956.600606:0:13960:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91dcc7f7f200/0xf3fe2838e1fc231c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf3fe2838e1fc2315 expref: 23 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130956.600614:0:13960:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91dcc7f7f200/0xf3fe2838e1fc231c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf3fe2838e1fc2315 expref: 23 pid: 6493 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130956.600621:0:13960:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddfd065a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13960:1876039508805760:0@lo:104: 00000100:00100000:0.0:1789130956.600642:0:13960:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789130956.600677:0:13960:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91ddfa939e00/0xf3fe2838e1fc230e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf3fe2838e1fc2307 expref: 23 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130956.600685:0:13960:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91ddfa939e00/0xf3fe2838e1fc230e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf3fe2838e1fc2307 expref: 23 pid: 6492 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130956.600692:0:13960:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddfd066940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13960:1876039508805888:0@lo:104: 00000100:00100000:3.0:1789130956.600716:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508805504 00000100:00100000:0.0:1789130956.600722:0:13960:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130956.600726:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508805504 00000100:00100000:0.0:1789130956.600741:0:13960:0:(client.c:2715:ptlrpc_set_wait()) set ffff91dcc7fabb40 going to sleep for 11 seconds 00000100:00100000:3.0:1789130956.600777:0:6484:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1789130956.600785:0:9503:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (1/3 left), rc = 0 00000100:00100000:0.0:1789130956.600791:0:9503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508805632 00000100:00100000:3.0:1789130956.600794:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508805760 00000100:00100000:0.0:1789130956.600795:0:9503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508805632 00000100:00100000:3.0:1789130956.600799:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508805760 00000100:00100000:0.0:1789130956.600819:0:9503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508805888 00000100:00100000:0.0:1789130956.600823:0:9503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508805888 00000100:00100000:3.0:1789130956.600838:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789130956.600848:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddfd0652c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+6:13960:x1876039508805504:12345-0@lo:104: 00010000:00010000:3.0:1789130956.600861:0:6484:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff91dde19abc00/0xf3fe2838e1fc2331 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3fe2838e1fc2338 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130956.600920:0:6484:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789130956.600926:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddfd0652c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+6:13960:x1876039508805504:12345-0@lo:104: Request processed in 80us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130956.601076:0:9503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789130956.601085:0:9503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddfd066580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+6:13960:x1876039508805632:12345-0@lo:104: 00010000:00010000:0.0:1789130956.601093:0:9503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff91dde19aae00/0xf3fe2838e1fc2323 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3fe2838e1fc232a expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130956.601149:0:9503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789130956.601155:0:9503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddfd066580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+6:13960:x1876039508805632:12345-0@lo:104: Request processed in 73us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130956.601161:0:9503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789130956.601177:0:9503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789130956.601183:0:9503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddfd0670c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+5:13960:x1876039508805760:12345-0@lo:104: 00010000:00010000:0.0:1789130956.601190:0:9503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7f400/0xf3fe2838e1fc2315 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3fe2838e1fc231c expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130956.601222:0:9503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1789130956.601233:0:9503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddfd0670c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+5:13960:x1876039508805760:12345-0@lo:104: Request processed in 50us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130956.601239:0:9503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789130956.601253:0:9503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789130956.601268:0:9503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01ad8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+4:13960:x1876039508805888:12345-0@lo:104: 00010000:00010000:0.0:1789130956.601277:0:9503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff91dde19aba00/0xf3fe2838e1fc2307 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3fe2838e1fc230e expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130956.601305:0:9503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1789130956.601310:0:9503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01ad8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+4:13960:x1876039508805888:12345-0@lo:104: Request processed in 53us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130956.601316:0:9503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789130956.601349:0:13960:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddfd067480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13960:1876039508805504:0@lo:104: 00000100:00100000:0.0:1789130956.601358:0:13960:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddfd0643c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13960:1876039508805632:0@lo:104: 00000100:00100000:0.0:1789130956.601365:0:13960:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddfd065a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13960:1876039508805760:0@lo:104: 00000100:00100000:0.0:1789130956.601371:0:13960:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddfd066940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13960:1876039508805888:0@lo:104: 00010000:00010000:0.0:1789130956.601392:0:6489:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1789130956.601398:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff91dde19abc00/0xf3fe2838e1fc2331 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3fe2838e1fc2338 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130956.601406:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dde19abc00 already unused, calling callback (ffffffffc124bc20) 10000000:00010000:0.0:1789130956.601411:0:6489:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff91dde19abc00/0xf3fe2838e1fc2331 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xf3fe2838e1fc2338 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130956.601419:0:6489:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff91dde19abc00/0xf3fe2838e1fc2331 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xf3fe2838e1fc2338 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789130956.601426:0:6489:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff91dde19abc00/0xf3fe2838e1fc2331 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xf3fe2838e1fc2338 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789130956.601437:0:6489:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789130956.601880:0:6489:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff91dde19abc00/0xf3fe2838e1fc2331 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc2338 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130956.601887:0:6489:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789130956.601913:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff91dde19abc00/0xf3fe2838e1fc2331 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc2338 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130956.601920:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff91dde19abc00/0xf3fe2838e1fc2331 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc2338 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130956.601933:0:6489:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789130956.601935:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff91dde19aae00/0xf3fe2838e1fc2323 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3fe2838e1fc232a expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130956.601941:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dde19aae00 already unused, calling callback (ffffffffc124bc20) 10000000:00010000:0.0:1789130956.601943:0:6489:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff91dde19aae00/0xf3fe2838e1fc2323 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf3fe2838e1fc232a expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130956.601950:0:6489:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff91dde19aae00/0xf3fe2838e1fc2323 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf3fe2838e1fc232a expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789130956.601956:0:6489:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff91dde19aae00/0xf3fe2838e1fc2323 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf3fe2838e1fc232a expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789130956.601961:0:6489:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789130956.601973:0:6489:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff91dde19aae00/0xf3fe2838e1fc2323 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc232a expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130956.601979:0:6489:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789130956.601991:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff91dde19aae00/0xf3fe2838e1fc2323 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc232a expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130956.601997:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff91dde19aae00/0xf3fe2838e1fc2323 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc232a expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130956.602005:0:6489:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789130956.602008:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7f400/0xf3fe2838e1fc2315 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3fe2838e1fc231c expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130956.602013:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc7f7f400 already unused, calling callback (ffffffffc124bc20) 10000000:00010000:0.0:1789130956.602015:0:6489:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7f400/0xf3fe2838e1fc2315 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf3fe2838e1fc231c expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130956.602021:0:6489:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7f400/0xf3fe2838e1fc2315 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf3fe2838e1fc231c expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789130956.602027:0:6489:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7f400/0xf3fe2838e1fc2315 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf3fe2838e1fc231c expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789130956.602031:0:6489:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789130956.602043:0:6489:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7f400/0xf3fe2838e1fc2315 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc231c expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130956.602048:0:6489:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789130956.602062:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7f400/0xf3fe2838e1fc2315 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc231c expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130956.602068:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7f400/0xf3fe2838e1fc2315 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc231c expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130956.602077:0:6489:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789130956.602087:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff91dde19aba00/0xf3fe2838e1fc2307 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3fe2838e1fc230e expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130956.602093:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dde19aba00 already unused, calling callback (ffffffffc124bc20) 10000000:00010000:0.0:1789130956.602096:0:6489:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff91dde19aba00/0xf3fe2838e1fc2307 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf3fe2838e1fc230e expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130956.602103:0:6489:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff91dde19aba00/0xf3fe2838e1fc2307 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf3fe2838e1fc230e expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789130956.602109:0:6489:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff91dde19aba00/0xf3fe2838e1fc2307 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf3fe2838e1fc230e expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789130956.602114:0:6489:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789130956.602440:0:6489:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff91dde19aba00/0xf3fe2838e1fc2307 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc230e expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130956.602447:0:6489:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789130956.602455:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff91dde19aba00/0xf3fe2838e1fc2307 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc230e expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130956.602533:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff91dde19aba00/0xf3fe2838e1fc2307 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc230e expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130956.602547:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130956.602549:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130956.602551:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789130956.602565:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddfd064780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3626:1876039508806144:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789130956.602606:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130956.602638:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789130956.602644:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddfd064000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3626:1876039508806016:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789130956.602673:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130956.602696:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddfd067c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3628:1876039508806400:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789130956.602717:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130956.602737:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789130956.602743:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddfd066d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3628:1876039508806272:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789130956.602762:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789130956.602800:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789130956.602824:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508806144 00000100:00100000:0.0:1789130956.602829:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508806144 00010000:00010000:0.0:1789130956.602851:0:8431:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91ddfd0b5a00/0xf3fe2838e1fc232a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3fe2838e1fc2323 expref: 24 pid: 6492 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130956.602866:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508806016 00000100:00100000:0.0:1789130956.602869:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508806016 00010000:00010000:0.0:1789130956.602877:0:8431:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91ddfd0b4800/0xf3fe2838e1fc2338 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3fe2838e1fc2331 expref: 25 pid: 6492 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130956.602885:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508806400 00000100:00100000:0.0:1789130956.602887:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508806400 00010000:00010000:0.0:1789130956.602894:0:8431:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91ddfa939e00/0xf3fe2838e1fc230e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3fe2838e1fc2307 expref: 26 pid: 6492 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130956.602901:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508806272 00000100:00100000:0.0:1789130956.602903:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508806272 00010000:00010000:0.0:1789130956.602912:0:8431:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91dcc7f7f200/0xf3fe2838e1fc231c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3fe2838e1fc2315 expref: 27 pid: 6493 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130956.602923:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789130956.602930:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc33af850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+27:3626:x1876039508806144:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789130956.605614:0:8431:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789130956.605644:0:8431:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91ddfd0b5a00/0xf3fe2838e1fc232a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3fe2838e1fc2323 expref: 27 pid: 6492 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130956.605659:0:8431:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91ddfd0b5a00/0xf3fe2838e1fc232a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf3fe2838e1fc2323 expref: 27 pid: 6492 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130956.605676:0:8431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91ddfd0b5a00/0xf3fe2838e1fc232a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf3fe2838e1fc2323 expref: 27 pid: 6492 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130956.605692:0:8431:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789130956.605771:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc33af850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+26:3626:x1876039508806144:12345-0@lo:103:ldlm_bl.0 Request processed in 2841us (3163us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130956.605780:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789130956.605842:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789130956.605853:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddfd0661c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+25:3626:x1876039508806016:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789130956.605861:0:8431:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789130956.605865:0:8431:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91ddfd0b4800/0xf3fe2838e1fc2338 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3fe2838e1fc2331 expref: 25 pid: 6492 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130956.605873:0:8431:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91ddfd0b4800/0xf3fe2838e1fc2338 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf3fe2838e1fc2331 expref: 25 pid: 6492 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130956.605883:0:8431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91ddfd0b4800/0xf3fe2838e1fc2338 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf3fe2838e1fc2331 expref: 25 pid: 6492 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130956.605891:0:8431:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789130956.605914:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddfd0661c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+24:3626:x1876039508806016:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (3241us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130956.605920:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789130956.606172:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789130956.606182:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddfd064f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+23:3628:x1876039508806400:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789130956.606191:0:6487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789130956.606196:0:6487:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91ddfa939e00/0xf3fe2838e1fc230e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3fe2838e1fc2307 expref: 23 pid: 6492 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130956.606205:0:6487:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91ddfa939e00/0xf3fe2838e1fc230e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf3fe2838e1fc2307 expref: 23 pid: 6492 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130956.606215:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91ddfa939e00/0xf3fe2838e1fc230e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf3fe2838e1fc2307 expref: 23 pid: 6492 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130956.606225:0:6487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789130956.606270:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddfd064f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+22:3628:x1876039508806400:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (3540us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130956.606277:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789130956.606291:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789130956.606306:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddfd065680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+21:3628:x1876039508806272:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789130956.606315:0:6487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789130956.606319:0:6487:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91dcc7f7f200/0xf3fe2838e1fc231c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3fe2838e1fc2315 expref: 21 pid: 6493 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130956.606327:0:6487:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91dcc7f7f200/0xf3fe2838e1fc231c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf3fe2838e1fc2315 expref: 21 pid: 6493 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130956.606336:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91dcc7f7f200/0xf3fe2838e1fc231c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf3fe2838e1fc2315 expref: 21 pid: 6493 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130956.606345:0:6487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789130956.606369:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddfd065680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+20:3628:x1876039508806272:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (3606us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130956.606375:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789130956.606414:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddfd066d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3628:1876039508806272:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789130956.606425:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddfd067c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3628:1876039508806400:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789130956.606596:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddfd064000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3626:1876039508806016:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789130956.606614:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddfd064780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3626:1876039508806144:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789130956.607074:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789130956.610989:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789130956.612327:0:13960:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddfd067840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13960:1876039508805248:192.168.203.11@tcp:104: 00000100:00100000:0.0:1789130956.612340:0:13960:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddfd065e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13960:1876039508805376:192.168.203.11@tcp:104: 00010000:00010000:0.0:1789130956.612375:0:13960:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91ddfa938c00/0xf3fe2838e1fc234d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130956.612604:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789130956.612657:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789130956.612723:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498226432 00000100:00100000:3.0:1789130956.612731:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498226432 00010000:00010000:3.0:1789130956.612764:0:6487:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91dde19aa800/0xf3fe2838e1fc2346 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d2698f4 expref: 13 pid: 6494 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130956.612797:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498226560 00000100:00100000:3.0:1789130956.612801:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498226560 00010000:00010000:3.0:1789130956.612812:0:6487:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91dcc7f7f000/0xf3fe2838e1fc233f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d2698ed expref: 14 pid: 6494 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130956.612830:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 56 00000100:00100000:3.0:1789130956.612837:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7817840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+14:2388:x1876039498226432:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789130956.612850:0:6487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789130956.612855:0:6487:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91dde19aa800/0xf3fe2838e1fc2346 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d2698f4 expref: 14 pid: 6494 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130956.612867:0:6487:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91dde19aa800/0xf3fe2838e1fc2346 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d2698f4 expref: 14 pid: 6494 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130956.612884:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91dde19aa800/0xf3fe2838e1fc2346 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d2698f4 expref: 14 pid: 6494 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130956.612907:0:6487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789130956.612951:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7817840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+13:2388:x1876039498226432:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 114us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130956.612959:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 56 00000100:00100000:3.0:1789130956.612976:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 57 00000100:00100000:3.0:1789130956.612983:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7816940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+12:2388:x1876039498226560:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789130956.612990:0:6487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789130956.612995:0:6487:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91dcc7f7f000/0xf3fe2838e1fc233f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d2698ed expref: 12 pid: 6494 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130956.613004:0:6487:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91dcc7f7f000/0xf3fe2838e1fc233f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d2698ed expref: 12 pid: 6494 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130956.613015:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91dcc7f7f000/0xf3fe2838e1fc233f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d2698ed expref: 12 pid: 6494 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130956.613025:0:6487:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91ddfa938c00/0xf3fe2838e1fc234d lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130956.613034:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91ddfa938c00/0xf3fe2838e1fc234d lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130956.613048:0:6487:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91ddfa938c00/0xf3fe2838e1fc234d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130956.613056:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91ddfa938c00/0xf3fe2838e1fc234d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130956.613072:0:6487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91ddfa938c00/0xf3fe2838e1fc234d lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130956.613079:0:6487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91ddfa938c00/0xf3fe2838e1fc234d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130956.613176:0:6487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddfa938c00 already unused, calling callback (ffffffffc0c4e550) 00010000:00010000:3.0:1789130956.613181:0:6487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91ddfa938c00/0xf3fe2838e1fc234d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130956.613190:0:6487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91ddfa938c00/0xf3fe2838e1fc234d lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130956.613202:0:6487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91ddfa938c00/0xf3fe2838e1fc234d lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130956.613211:0:6487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789130956.613231:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7816940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+11:2388:x1876039498226560:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 249us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130956.613238:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 57 00010000:00010000:0.0:1789130956.615469:0:13960:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91ddfa938c00/0xf3fe2838e1fc234d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130956.615485:0:13960:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91ddfa938c00/0xf3fe2838e1fc234d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130956.615492:0:13960:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91ddfa938c00/0xf3fe2838e1fc234d lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130956.650191:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789130956.650224:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789130956.650255:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789130956.650307:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789130956.650333:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498226816 00000100:00100000:1.0:1789130956.650341:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498226816 00000100:00100000:1.0:1789130956.650394:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498227072 00000100:00100000:1.0:1789130956.650398:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498227072 00000100:00100000:1.0:1789130956.650410:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498226688 00000100:00100000:1.0:1789130956.650412:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498226688 00000100:00100000:1.0:1789130956.650421:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498226944 00000100:00100000:1.0:1789130956.650423:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498226944 00000100:00100000:1.0:1789130956.650438:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 225 00000100:00100000:1.0:1789130956.650447:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7c78f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+5:2385:x1876039498226816:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1789130956.650476:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 226 00000100:00100000:1.0:1789130956.650529:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7c78f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+5:2385:x1876039498226816:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 82us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130956.650534:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7c7a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fde8d4a8-44db-4e6b-8249-c1c295e4901d+5:2385:x1876039498227072:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1789130956.650537:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 225 00000100:00100000:1.0:1789130956.650554:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 227 00000100:00100000:3.0:1789130956.650561:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7c7a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fde8d4a8-44db-4e6b-8249-c1c295e4901d+5:2385:x1876039498227072:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 78us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130956.650561:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7c79a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+6:2385:x1876039498226688:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1789130956.650568:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 226 00000100:00100000:3.0:1789130956.650580:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 228 00000100:00100000:1.0:1789130956.650582:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7c79a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+6:2385:x1876039498226688:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 22us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130956.650586:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7c78780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fde8d4a8-44db-4e6b-8249-c1c295e4901d+5:2385:x1876039498226944:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1789130956.650588:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 227 00000100:00100000:3.0:1789130956.650615:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7c78780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fde8d4a8-44db-4e6b-8249-c1c295e4901d+5:2385:x1876039498226944:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 29us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130956.650621:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 228 00000100:00080000:3.0:1789130956.650646:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789130956.650649:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1789130956.698704:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789130957.394546:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddfd067840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3626:1876039508806656:0@lo:400:kworker.0 00000100:00100000:0.0:1789130957.394613:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130957.394662:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddfd067480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3626:1876039508807168:0@lo:400:kworker.0 00000100:00100000:0.0:1789130957.394685:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130957.394709:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddfd0670c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3626:1876039508807680:0@lo:400:kworker.0 00000100:00100000:0.0:1789130957.394730:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130957.394759:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:0.0:1789130957.394766:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddfd065e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3626:1876039508806528:0@lo:400:kworker.0 00000100:00100000:0.0:1789130957.394793:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130957.394814:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddfd0643c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508807040:0@lo:400:kworker.0 00000100:00100000:0.0:1789130957.394849:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130957.394868:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddfd066580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508807552:0@lo:400:kworker.0 00000100:00100000:0.0:1789130957.394891:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130957.394908:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddfd066d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508808064:0@lo:400:kworker.0 00000100:00100000:0.0:1789130957.394936:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130957.394964:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddfd066940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508806784:0@lo:400:kworker.0 00000100:00100000:0.0:1789130957.394985:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130957.395002:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddfd064780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3627:1876039508807296:0@lo:400:kworker.0 00000100:00100000:0.0:1789130957.395018:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130957.395031:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddfd0652c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3627:1876039508807808:0@lo:400:kworker.0 00000100:00100000:0.0:1789130957.395049:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130957.395059:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789130957.395064:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddfd065a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3627:1876039508806912:0@lo:400:kworker.0 00000100:00100000:0.0:1789130957.395079:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130957.395089:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddfd064000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508807424:0@lo:400:kworker.0 00000100:00100000:0.0:1789130957.395105:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130957.395121:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddfd067c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508807936:0@lo:400:kworker.0 00000100:00100000:0.0:1789130957.395141:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130957.395194:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508806656 00000100:00100000:0.0:1789130957.395200:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508806656 00000100:00100000:0.0:1789130957.395233:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508807168 00000100:00100000:3.0:1789130957.395821:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789130957.395831:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8494b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1876039508808320:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789130957.395866:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130957.395893:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508808320 00000100:00100000:3.0:1789130957.395897:0:8418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508808320 00000100:00100000:3.0:1789130957.395935:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1789130957.395944:0:8418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8494000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1876039508808320:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789130957.395970:0:8418:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789130957.396011:0:8418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8494000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1876039508808320:12345-0@lo:13:osp-pre-1-1.0 Request processed in 67us (143us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130957.396019:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00080000:3.0:1789130957.396039:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789130957.396068:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc8494b40 x1876039508808320/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789130973 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130957.396085:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8494b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1876039508808320:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789130957.396152:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508807168 00000100:00100000:0.0:1789130957.396187:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508807680 00000100:00100000:0.0:1789130957.396190:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508807680 00000100:00100000:0.0:1789130957.396203:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508807296 00000100:00100000:0.0:1789130957.396205:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508807296 00000100:00100000:0.0:1789130957.396230:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508807808 00000100:00100000:0.0:1789130957.396233:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508807808 00000100:00100000:0.0:1789130957.396322:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508806912 00000100:00100000:0.0:1789130957.396326:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508806912 00000100:00100000:0.0:1789130957.396336:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1789130957.396342:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01a5e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1876039508806656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130957.396379:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01a5e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1876039508806656:12345-0@lo:400:kworker.0 Request processed in 37us (1766us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130957.396385:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1789130957.396396:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1789130957.396401:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01a5f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1876039508807168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130957.396426:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01a5f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1876039508807168:12345-0@lo:400:kworker.0 Request processed in 25us (1741us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130957.396432:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1789130957.396443:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1789130957.396448:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01a5e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1876039508807680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130957.396643:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789130957.396656:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7fd0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508808192:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789130957.396685:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130957.396745:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508808192 00000100:00100000:1.0:1789130957.396750:0:8418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508808192 00000100:00100000:1.0:1789130957.396775:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789130957.396781:0:8418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff750000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1876039508808192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789130957.396791:0:8418:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789130957.396831:0:8418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff750000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1876039508808192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 50us (144us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130957.396838:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00010000:00080000:1.0:1789130957.396866:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc7fd0780 x1876039508808192/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789130973 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789130957.396879:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7fd0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508808192:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789130957.397360:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01a5e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1876039508807680:12345-0@lo:400:kworker.0 Request processed in 910us (2627us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130957.397368:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1789130957.397385:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1789130957.397392:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7fd2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1876039508807296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130957.397436:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7fd2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1876039508807296:12345-0@lo:400:kworker.0 Request processed in 45us (2416us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130957.397443:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1789130957.397455:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00080000:3.0:1789130957.397591:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789130957.397595:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789130957.397598:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789130957.397698:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91ddfd064780 x1876039508807296/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130973 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789130957.397710:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddfd064780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3627:1876039508807296:0@lo:400:kworker.0 00000100:00100000:0.0:1789130957.397746:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7fd1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3627:x1876039508807808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130957.397797:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7fd1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3627:x1876039508807808:12345-0@lo:400:kworker.0 Request processed in 309us (2747us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130957.397803:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1789130957.397815:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1789130957.397821:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7fd30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1876039508806912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130957.397844:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7fd30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1876039508806912:12345-0@lo:400:kworker.0 Request processed in 24us (2764us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130957.397850:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1789130957.397876:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508806528 00000100:00100000:0.0:1789130957.397880:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508806528 00000100:00100000:1.0:1789130957.397954:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddfd065a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3627:1876039508806912:0@lo:400:kworker.0 00010000:00080000:1.0:1789130957.397965:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91ddfd0652c0 x1876039508807808/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130973 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789130957.397974:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddfd0652c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3627:1876039508807808:0@lo:400:kworker.0 00000100:00100000:0.0:1789130957.398272:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:0.0:1789130957.398280:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddf5cc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+20:3626:x1876039508806528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130957.398315:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddf5cc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+20:3626:x1876039508806528:12345-0@lo:400:kworker.0 Request processed in 37us (3522us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130957.398321:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00000100:00100000:1.0:1789130957.399190:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508807040 00000100:00100000:1.0:1789130957.399198:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508807040 00000100:00100000:1.0:1789130957.399263:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508806784 00000100:00100000:1.0:1789130957.399267:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508806784 00000100:00100000:1.0:1789130957.399284:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1789130957.399291:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01a5da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508807040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130957.399340:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01a5da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508807040:12345-0@lo:400:kworker.0 Request processed in 50us (4491us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130957.399347:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1789130957.399361:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1789130957.399367:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7fd03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508806784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130957.399414:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7fd03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508806784:12345-0@lo:400:kworker.0 Request processed in 48us (4428us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130957.399420:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1789130957.399439:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508807552 00000100:00100000:1.0:1789130957.399443:0:9827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508807552 00000100:00100000:1.0:1789130957.399672:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508808064 00000100:00100000:1.0:1789130957.399676:0:9827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508808064 00000100:00100000:1.0:1789130957.399689:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508807424 00000100:00100000:1.0:1789130957.399692:0:9827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508807424 00000100:00100000:1.0:1789130957.399704:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508807936 00000100:00100000:1.0:1789130957.399707:0:9827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508807936 00000100:00100000:1.0:1789130957.399717:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789130957.399722:0:9827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff7c03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508807552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130957.399754:0:9827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff7c03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508807552:12345-0@lo:400:kworker.0 Request processed in 31us (4862us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130957.399760:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789130957.399771:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789130957.399777:0:9827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7fd12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508808064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130957.399803:0:9827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7fd12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508808064:12345-0@lo:400:kworker.0 Request processed in 27us (4866us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130957.399809:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789130957.399819:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1789130957.399824:0:9827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7fd2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508807424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130957.399849:0:9827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7fd2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508807424:12345-0@lo:400:kworker.0 Request processed in 25us (4743us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130957.399854:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1789130957.399865:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789130957.399876:0:9827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7fd0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508807936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130957.399905:0:9827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7fd0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508807936:12345-0@lo:400:kworker.0 Request processed in 30us (4764us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130957.399910:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00010000:00080000:1.0:1789130957.399958:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91ddfd064000 x1876039508807424/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789130973 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789130957.399971:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddfd064000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508807424:0@lo:400:kworker.0 00010000:00080000:1.0:1789130957.399982:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91ddfd067c00 x1876039508807936/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789130973 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789130957.399988:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddfd067c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508807936:0@lo:400:kworker.0 00000100:00100000:1.0:1789130957.399998:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddfd066940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508806784:0@lo:400:kworker.0 00000100:00100000:1.0:1789130957.402434:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddfd065e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3626:1876039508806528:0@lo:400:kworker.0 00000100:00100000:1.0:1789130957.402454:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddfd0643c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508807040:0@lo:400:kworker.0 00010000:00080000:1.0:1789130957.402505:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91ddfd066580 x1876039508807552/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789130973 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789130957.402516:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddfd066580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508807552:0@lo:400:kworker.0 00010000:00080000:1.0:1789130957.402530:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91ddfd066d00 x1876039508808064/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789130973 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789130957.402539:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddfd066d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508808064:0@lo:400:kworker.0 00000100:00100000:1.0:1789130957.402551:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddfd067840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3626:1876039508806656:0@lo:400:kworker.0 00000100:00100000:1.0:1789130957.402562:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddfd067480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3626:1876039508807168:0@lo:400:kworker.0 00000100:00100000:1.0:1789130957.402587:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddfd0670c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3626:1876039508807680:0@lo:400:kworker.0 00000100:00080000:3.0:1789130957.402947:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789130957.713981:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789130957.909134:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789130957.909161:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7fd2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1876039508808448:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789130957.909245:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130957.909369:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508808448 00000100:00100000:2.0:1789130957.909378:0:8418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508808448 00000100:00100000:2.0:1789130957.909429:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1789130957.909441:0:8418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff753480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1876039508808448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789130957.909501:0:8418:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789130957.909553:0:8418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff753480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1876039508808448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 115us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130957.909561:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00010000:00080000:0.0:1789130957.910034:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc7fd2d00 x1876039508808448/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789130973 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789130957.910059:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7fd2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1876039508808448:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789130957.983059:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789130957.983202:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498227200 00000100:00100000:1.0:1789130957.983221:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498227200 00000100:00100000:1.0:1789130957.983290:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 370 00000100:00100000:1.0:1789130957.983301:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddf5cc4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+11:6161:x1876039498227200:12345-192.168.203.11@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789130957.983318:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130957.983336:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91dde19aa800/0xf3fe2838e1fc2354 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf8eae2996d2698fb expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130957.983364:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91dde19aa800/0xf3fe2838e1fc2354 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d2698fb expref: 12 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130957.983376:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91dde19aa800/0xf3fe2838e1fc2354 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d2698fb expref: 12 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130957.983386:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dde19aa800, rc 0) 00000100:00100000:1.0:1789130957.983445:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddf5cc4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+12:6161:x1876039498227200:12345-192.168.203.11@tcp:101:ll_cfg_requeue.0 Request processed in 146us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130957.983452:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 370 00000100:00100000:1.0:1789130957.998268:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789130957.998367:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498227328 00000100:00100000:0.0:1789130957.998377:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498227328 00000100:00100000:0.0:1789130957.998432:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 371 00000100:00100000:0.0:1789130957.998442:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddcf4fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+12:6161:x1876039498227328:12345-192.168.203.11@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789130957.998627:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddcf4fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+12:6161:x1876039498227328:12345-192.168.203.11@tcp:501:ll_cfg_requeue.0 Request processed in 186us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130957.998651:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 371 00000100:00100000:2.0:1789130958.002892:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789130958.002978:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498227456 00000100:00100000:3.0:1789130958.002987:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498227456 00000100:00100000:3.0:1789130958.003045:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 372 00000100:00100000:3.0:1789130958.003055:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddcf4fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+12:6161:x1876039498227456:12345-192.168.203.11@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789130958.003193:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddcf4fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+12:6161:x1876039498227456:12345-192.168.203.11@tcp:503:ll_cfg_requeue.0 Request processed in 139us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130958.003200:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 372 00000100:00100000:3.0:1789130958.020888:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789130958.021055:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498227584 00000100:00100000:1.0:1789130958.021065:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498227584 00000100:00100000:1.0:1789130958.021122:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 373 00000100:00100000:1.0:1789130958.021134:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddcf4fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+12:10376:x1876039498227584:12345-192.168.203.11@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789130958.021306:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddcf4fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+12:10376:x1876039498227584:12345-192.168.203.11@tcp:502:llog_process_th.0 Request processed in 173us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130958.021314:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 373 00000100:00100000:1.0:1789130958.033566:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789130958.033677:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498227712 00000100:00100000:0.0:1789130958.033688:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498227712 00000100:00100000:0.0:1789130958.033743:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 374 00000100:00100000:0.0:1789130958.033753:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddcf4f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+12:10376:x1876039498227712:12345-192.168.203.11@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789130958.033900:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddcf4f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+12:10376:x1876039498227712:12345-192.168.203.11@tcp:502:llog_process_th.0 Request processed in 147us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130958.033908:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 374 00000100:00100000:2.0:1789130958.046185:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789130958.046336:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498227840 00000100:00100000:3.0:1789130958.046345:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498227840 00000100:00100000:3.0:1789130958.046403:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 375 00000100:00100000:3.0:1789130958.046412:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddcf4fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+12:6161:x1876039498227840:12345-192.168.203.11@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789130958.046428:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130958.046447:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91ddfd0b4200/0xf3fe2838e1fc235b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269902 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130958.046517:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91ddfd0b4200/0xf3fe2838e1fc235b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269902 expref: 13 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130958.046529:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91ddfd0b4200/0xf3fe2838e1fc235b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269902 expref: 13 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130958.046539:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ddfd0b4200, rc 0) 00000100:00100000:3.0:1789130958.052587:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddcf4fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+13:6161:x1876039498227840:12345-192.168.203.11@tcp:101:ll_cfg_requeue.0 Request processed in 6164us (6401us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130958.052607:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 375 00000100:00100000:3.0:1789130958.061652:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789130958.061913:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498227968 00000100:00100000:1.0:1789130958.061922:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498227968 00000100:00100000:1.0:1789130958.061980:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 376 00000100:00100000:1.0:1789130958.061990:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddcf4f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+13:6161:x1876039498227968:12345-192.168.203.11@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789130958.062140:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddcf4f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+13:6161:x1876039498227968:12345-192.168.203.11@tcp:501:ll_cfg_requeue.0 Request processed in 150us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130958.062147:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 376 00000100:00100000:1.0:1789130958.063980:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789130958.064057:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498228096 00000100:00100000:3.0:1789130958.064065:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498228096 00000100:00100000:3.0:1789130958.064126:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 377 00000100:00100000:3.0:1789130958.064136:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddcf4f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+13:6161:x1876039498228096:12345-192.168.203.11@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789130958.064280:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddcf4f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+13:6161:x1876039498228096:12345-192.168.203.11@tcp:503:ll_cfg_requeue.0 Request processed in 144us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130958.064289:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 377 00000100:00100000:2.0:1789130958.078051:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789130958.078440:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498228224 00000100:00100000:0.0:1789130958.078451:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498228224 00000100:00100000:0.0:1789130958.078540:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 378 00000100:00100000:0.0:1789130958.078550:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddcf4fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+13:10379:x1876039498228224:12345-192.168.203.11@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789130958.078692:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddcf4fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+13:10379:x1876039498228224:12345-192.168.203.11@tcp:502:llog_process_th.0 Request processed in 142us (651us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130958.078700:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 378 00000100:00100000:0.0:1789130958.090135:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789130958.090240:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498228352 00000100:00100000:1.0:1789130958.090259:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498228352 00000100:00100000:1.0:1789130958.090315:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 379 00000100:00100000:1.0:1789130958.090326:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddcf4fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+13:10379:x1876039498228352:12345-192.168.203.11@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789130958.090507:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddcf4fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+13:10379:x1876039498228352:12345-192.168.203.11@tcp:502:llog_process_th.0 Request processed in 181us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130958.090515:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 379 10000000:01000000:0.0:1789130958.353592:0:6497:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789130958.353602:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91ddff549800 from 10 10000000:01000000:0.0:1789130958.353609:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789130958.353665:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff91ddfa939600/0xf3fe2838e1fc2362 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130958.353676:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff91ddfa939600/0xf3fe2838e1fc2362 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130958.353687:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff91ddfa939600/0xf3fe2838e1fc2362 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130958.353728:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7fd2d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508808576:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789130958.353797:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130958.353876:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff91dcc7fabf00 going to sleep for 11 seconds 00000100:00100000:3.0:1789130958.354130:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508808576 00000100:00100000:3.0:1789130958.354138:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508808576 00000100:00100000:3.0:1789130958.354185:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:3.0:1789130958.354194:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddcf4f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+20:6497:x1876039508808576:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789130958.354207:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130958.354220:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91ddfd0b4600/0xf3fe2838e1fc2369 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3fe2838e1fc2362 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130958.354244:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91ddfd0b4600/0xf3fe2838e1fc2369 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3fe2838e1fc2362 expref: 21 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130958.354265:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91ddfd0b4600/0xf3fe2838e1fc2369 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc2362 expref: 21 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130958.354275:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ddfd0b4600, rc 0) 00000100:00100000:3.0:1789130958.354324:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddcf4f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+21:6497:x1876039508808576:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130958.354339:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00000100:00100000:0.0:1789130958.354647:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7fd2d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508808576:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789130958.354664:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff91ddfa939600/0xf3fe2838e1fc2362 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc2369 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130958.354673:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff91ddfa939600/0xf3fe2838e1fc2362 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3fe2838e1fc2369 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130958.354739:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7fd2d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508808704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789130958.354765:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130958.354796:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff91dcc7fabf00 going to sleep for 11 seconds 00000100:00100000:1.0:1789130958.354850:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508808704 00000100:00100000:1.0:1789130958.354855:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508808704 00000100:00100000:1.0:1789130958.354888:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 381 00000100:00100000:1.0:1789130958.354897:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddcf4f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+21:6497:x1876039508808704:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789130958.355007:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddcf4f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+21:6497:x1876039508808704:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 111us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130958.355026:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 381 00000100:00100000:0.0:1789130958.355101:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7fd2d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508808704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789130958.355127:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7fd2d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508808832:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789130958.355164:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130958.355186:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff91dcc7fabf00 going to sleep for 11 seconds 00000100:00100000:1.0:1789130958.355235:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508808832 00000100:00100000:1.0:1789130958.355239:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508808832 00000100:00100000:1.0:1789130958.355281:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:1.0:1789130958.355287:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddcf4fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+21:6497:x1876039508808832:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789130958.355381:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddcf4fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+21:6497:x1876039508808832:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 93us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130958.355388:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00000100:00100000:2.0:1789130958.355511:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7fd2d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508808832:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789130958.356048:0:14021:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01ad3c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:14021:1876039508808960:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789130958.356090:0:14021:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130958.356122:0:14021:0:(client.c:2715:ptlrpc_set_wait()) set ffff91dcc85460c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789130958.356172:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508808960 00000100:00100000:1.0:1789130958.356177:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508808960 00000100:00100000:1.0:1789130958.356198:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383 00000100:00100000:1.0:1789130958.356204:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddcf4fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+21:14021:x1876039508808960:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789130958.356300:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddcf4fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+21:14021:x1876039508808960:12345-0@lo:502:llog_process_th.0 Request processed in 94us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130958.356306:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383 00000100:00100000:2.0:1789130958.356634:0:14021:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01ad3c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:14021:1876039508808960:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789130958.356658:0:14021:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789130958.356668:0:14021:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789130958.356670:0:14021:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre lod.lustre-MDT0001-mdtlov.enable_compr_rotational 00000020:01000000:2.0:1789130958.356676:0:14021:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff91ddff549800 00000020:00000080:2.0:1789130958.356679:0:14021:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789130958.356752:0:14021:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01ad3c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:14021:1876039508809088:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789130958.356789:0:14021:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130958.356817:0:14021:0:(client.c:2715:ptlrpc_set_wait()) set ffff91dcc85460c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789130958.357940:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508809088 00000100:00100000:1.0:1789130958.357948:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508809088 00000100:00100000:1.0:1789130958.357997:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:1.0:1789130958.358005:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddcf7c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+21:14021:x1876039508809088:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789130958.358145:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddcf7c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+21:14021:x1876039508809088:12345-0@lo:502:llog_process_th.0 Request processed in 141us (1356us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130958.358153:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00000100:00100000:2.0:1789130958.358341:0:14021:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01ad3c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:14021:1876039508809088:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789130958.358366:0:14021:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789130958.358371:0:14021:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789130958.358374:0:14021:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre lod.lustre-MDT0001-mdtlov.enable_compr_rotational 00000040:00080000:2.0:1789130958.358377:0:14021:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1789130958.359625:0:6497:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-12 (rc=0) 10000000:01000000:1.0:1789130958.359657:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789130958.359668:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff91ddfa939600/0xf3fe2838e1fc2362 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc2369 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130958.359692:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff91ddfa939600/0xf3fe2838e1fc2362 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc2369 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789130958.359702:0:6497:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789130958.359704:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91ddff4f9000 from 10 10000000:01000000:1.0:1789130958.359707:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789130958.359737:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff91dde19aa600/0xf3fe2838e1fc2370 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130958.359745:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff91dde19aa600/0xf3fe2838e1fc2370 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130958.359755:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff91dde19aa600/0xf3fe2838e1fc2370 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130958.359777:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff7503c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508809216:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789130958.359832:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130958.359875:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff91dcc7d68c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789130958.360102:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508809216 00000100:00100000:2.0:1789130958.360109:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508809216 00000100:00100000:2.0:1789130958.360158:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 385 00000100:00100000:2.0:1789130958.360167:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddcf7c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+21:6497:x1876039508809216:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789130958.360179:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130958.360190:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91dcc7f7f200/0xf3fe2838e1fc2377 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3fe2838e1fc2370 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130958.360219:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91dcc7f7f200/0xf3fe2838e1fc2377 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3fe2838e1fc2370 expref: 22 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130958.360229:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91dcc7f7f200/0xf3fe2838e1fc2377 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc2370 expref: 22 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130958.360238:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dcc7f7f200, rc 0) 00000100:00100000:2.0:1789130958.360291:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddcf7c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+22:6497:x1876039508809216:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130958.360298:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 385 00000100:00100000:1.0:1789130958.361987:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff7503c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508809216:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789130958.362024:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff91dde19aa600/0xf3fe2838e1fc2370 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc2377 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130958.362036:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff91dde19aa600/0xf3fe2838e1fc2370 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3fe2838e1fc2377 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130958.362115:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff7503c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508809344:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789130958.362164:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130958.362602:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff91dcc7d68c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789130958.370133:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508809344 00000100:00100000:3.0:1789130958.370147:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508809344 00000100:00100000:3.0:1789130958.370259:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:3.0:1789130958.370270:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddcf7cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+22:6497:x1876039508809344:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789130958.370446:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddcf7cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+22:6497:x1876039508809344:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 177us (8280us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130958.370480:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00000100:00100000:0.0:1789130958.370820:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff7503c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508809344:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789130958.370870:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7fd3c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508809472:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789130958.370916:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130958.374344:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff91dcc7fabd80 going to sleep for 11 seconds 00000100:00100000:2.0:1789130958.374512:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508809472 00000100:00100000:2.0:1789130958.374521:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508809472 00000100:00100000:2.0:1789130958.374569:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 387 00000100:00100000:2.0:1789130958.374580:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8606050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+22:6497:x1876039508809472:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789130958.374727:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8606050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+22:6497:x1876039508809472:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 150us (3810us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130958.374735:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 387 00000100:00100000:2.0:1789130958.374790:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7fd3c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508809472:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789130958.374983:0:14024:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01ad3c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:14024:1876039508809600:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789130958.375314:0:14024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130958.375409:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508809600 00000100:00100000:2.0:1789130958.375414:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508809600 00000100:00100000:2.0:1789130958.375438:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00000100:00100000:2.0:1789130958.375445:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8604c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+22:14024:x1876039508809600:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789130958.375594:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8604c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+22:14024:x1876039508809600:12345-0@lo:502:llog_process_th.0 Request processed in 149us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130958.375609:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00000100:00100000:2.0:1789130958.375649:0:14024:0:(client.c:2715:ptlrpc_set_wait()) set ffff91dcc8546e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789130958.375665:0:14024:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01ad3c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:14024:1876039508809600:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789130958.375688:0:14024:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789130958.375698:0:14024:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789130958.375700:0:14024:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre lod.lustre-MDT0001-mdtlov.enable_compr_rotational 00000020:01000000:2.0:1789130958.375707:0:14024:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff91ddff4f9000 00000020:00000080:2.0:1789130958.375710:0:14024:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789130958.375781:0:14024:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01ad3c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:14024:1876039508809728:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789130958.375818:0:14024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130958.375837:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508809728 00000100:00100000:2.0:1789130958.375840:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508809728 00000100:00100000:2.0:1789130958.375857:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 389 00000100:00100000:2.0:1789130958.375863:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8605050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+22:14024:x1876039508809728:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789130958.376724:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8605050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+22:14024:x1876039508809728:12345-0@lo:502:llog_process_th.0 Request processed in 856us (901us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130958.376734:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 389 00000100:00100000:2.0:1789130958.376781:0:14024:0:(client.c:2715:ptlrpc_set_wait()) set ffff91dcc8546e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789130958.376798:0:14024:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01ad3c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:14024:1876039508809728:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789130958.376821:0:14024:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789130958.376826:0:14024:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789130958.376828:0:14024:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre lod.lustre-MDT0001-mdtlov.enable_compr_rotational 00000040:00080000:2.0:1789130958.376831:0:14024:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1789130958.376892:0:6497:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-12 (rc=0) 10000000:01000000:2.0:1789130958.376920:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789130958.376930:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff91dde19aa600/0xf3fe2838e1fc2370 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc2377 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130958.376947:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff91dde19aa600/0xf3fe2838e1fc2370 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc2377 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789130958.376956:0:6497:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789130958.376958:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91ddfce33000 from 10 10000000:01000000:2.0:1789130958.376961:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789130958.376985:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7f000/0xf3fe2838e1fc237e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130958.376993:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7f000/0xf3fe2838e1fc237e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130958.377001:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7f000/0xf3fe2838e1fc237e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130958.377129:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01ad3c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508809856:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789130958.377164:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130958.377183:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff91dcc8546e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789130958.377197:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508809856 00000100:00100000:2.0:1789130958.377201:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508809856 00000100:00100000:2.0:1789130958.377226:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 390 00000100:00100000:2.0:1789130958.377234:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8607450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+22:6497:x1876039508809856:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789130958.377244:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130958.377264:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91dcc7f7f400/0xf3fe2838e1fc2385 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3fe2838e1fc237e expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130958.377287:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91dcc7f7f400/0xf3fe2838e1fc2385 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3fe2838e1fc237e expref: 23 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130958.377307:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91dcc7f7f400/0xf3fe2838e1fc2385 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc237e expref: 23 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130958.377314:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dcc7f7f400, rc 0) 00000100:00100000:2.0:1789130958.377444:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8607450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+23:6497:x1876039508809856:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 211us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130958.377451:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 390 00000100:00100000:2.0:1789130958.377511:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01ad3c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508809856:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789130958.377524:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7f000/0xf3fe2838e1fc237e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc2385 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130958.377532:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7f000/0xf3fe2838e1fc237e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3fe2838e1fc2385 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130958.377579:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01ad3c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508809984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789130958.377609:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130958.377627:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff91dcc8546e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789130958.377641:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508809984 00000100:00100000:2.0:1789130958.377644:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508809984 00000100:00100000:2.0:1789130958.377664:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 391 00000100:00100000:2.0:1789130958.377670:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8607850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+23:6497:x1876039508809984:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789130958.377758:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8607850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+23:6497:x1876039508809984:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 88us (148us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130958.377765:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 391 00000100:00100000:2.0:1789130958.377794:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01ad3c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508809984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789130958.377834:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01ad3c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508810112:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789130958.377868:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130958.377882:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff91dcc8546e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789130958.377894:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508810112 00000100:00100000:2.0:1789130958.377897:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508810112 00000100:00100000:2.0:1789130958.377914:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 392 00000100:00100000:2.0:1789130958.377920:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8606c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+23:6497:x1876039508810112:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789130958.377983:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8606c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+23:6497:x1876039508810112:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 62us (113us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130958.377989:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 392 00000100:00100000:2.0:1789130958.378203:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01ad3c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508810112:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789130958.385402:0:14025:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01ad3c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:14025:1876039508810240:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789130958.385585:0:14025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130958.385639:0:14025:0:(client.c:2715:ptlrpc_set_wait()) set ffff91dcc8546e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789130958.385861:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508810240 00000100:00100000:3.0:1789130958.385869:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508810240 00000100:00100000:3.0:1789130958.385920:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 393 00000100:00100000:3.0:1789130958.385930:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8605450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+23:14025:x1876039508810240:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789130958.386051:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8605450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+23:14025:x1876039508810240:12345-0@lo:502:llog_process_th.0 Request processed in 123us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130958.386059:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 393 00000100:00100000:2.0:1789130958.386601:0:14025:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01ad3c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:14025:1876039508810240:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789130958.386637:0:14025:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789130958.386647:0:14025:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789130958.386650:0:14025:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre lod.lustre-MDT0001-mdtlov.enable_compr_rotational 00000020:01000000:2.0:1789130958.386658:0:14025:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff91ddfce33000 00000020:00000080:2.0:1789130958.386660:0:14025:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789130958.386743:0:14025:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01ad3c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:14025:1876039508810368:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789130958.386789:0:14025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130958.386823:0:14025:0:(client.c:2715:ptlrpc_set_wait()) set ffff91dcc8546e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789130958.387632:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508810368 00000100:00100000:0.0:1789130958.387639:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508810368 00000100:00100000:0.0:1789130958.387692:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 394 00000100:00100000:0.0:1789130958.387708:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8604450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+23:14025:x1876039508810368:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789130958.387814:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8604450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+23:14025:x1876039508810368:12345-0@lo:502:llog_process_th.0 Request processed in 107us (1024us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130958.387821:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 394 00000100:00100000:2.0:1789130958.388141:0:14025:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01ad3c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:14025:1876039508810368:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789130958.388179:0:14025:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789130958.388186:0:14025:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789130958.388188:0:14025:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre lod.lustre-MDT0001-mdtlov.enable_compr_rotational 00000040:00080000:2.0:1789130958.388192:0:14025:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1789130958.388862:0:6497:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-12 (rc=0) 10000000:01000000:0.0:1789130958.388893:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789130958.388903:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7f000/0xf3fe2838e1fc237e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc2385 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130958.388914:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7f000/0xf3fe2838e1fc237e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc2385 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789130958.388925:0:6497:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789130958.388927:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91dded7b6800 from 10 10000000:01000000:0.0:1789130958.388930:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789130958.388960:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff91ddfa938c00/0xf3fe2838e1fc238c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130958.388968:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff91ddfa938c00/0xf3fe2838e1fc238c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130958.388977:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff91ddfa938c00/0xf3fe2838e1fc238c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130958.388998:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7fd21c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508810496:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789130958.389045:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130958.389088:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff91dcc7fab780 going to sleep for 11 seconds 00000100:00100000:1.0:1789130958.389185:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508810496 00000100:00100000:1.0:1789130958.389190:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508810496 00000100:00100000:1.0:1789130958.389234:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 395 00000100:00100000:1.0:1789130958.389242:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8607c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+23:6497:x1876039508810496:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789130958.389263:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130958.389276:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91dde19ab000/0xf3fe2838e1fc2393 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3fe2838e1fc238c expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130958.389299:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91dde19ab000/0xf3fe2838e1fc2393 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3fe2838e1fc238c expref: 24 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130958.389611:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91dde19ab000/0xf3fe2838e1fc2393 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc238c expref: 24 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130958.389623:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dde19ab000, rc 0) 00000100:00100000:1.0:1789130958.389805:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8607c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+24:6497:x1876039508810496:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 563us (758us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130958.389813:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 395 00000100:00100000:0.0:1789130958.395223:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7fd21c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508810496:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789130958.395434:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff91ddfa938c00/0xf3fe2838e1fc238c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc2393 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130958.395593:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff91ddfa938c00/0xf3fe2838e1fc238c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3fe2838e1fc2393 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130958.395682:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7fd21c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508810624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789130958.395741:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130958.395834:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff91dcc7fab780 going to sleep for 11 seconds 00000100:00100000:3.0:1789130958.401955:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508810624 00000100:00100000:3.0:1789130958.401970:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508810624 00000100:00100000:3.0:1789130958.402029:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 396 00000100:00100000:3.0:1789130958.402040:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8605850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+24:6497:x1876039508810624:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789130958.402200:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8605850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+24:6497:x1876039508810624:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 161us (6457us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130958.402208:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 396 00000100:00100000:3.0:1789130958.402284:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7fd21c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508810624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789130958.402344:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8494b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508810752:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789130958.402393:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130958.402421:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddc4ccff00 going to sleep for 11 seconds 00000100:00100000:3.0:1789130958.402434:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508810752 00000100:00100000:3.0:1789130958.402438:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508810752 00000100:00100000:3.0:1789130958.402476:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 397 00000100:00100000:3.0:1789130958.402483:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8604850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+24:6497:x1876039508810752:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789130958.402554:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8604850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+24:6497:x1876039508810752:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 71us (161us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130958.402571:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 397 00000100:00100000:3.0:1789130958.402609:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8494b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508810752:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789130958.402776:0:14027:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8494b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:14027:1876039508810880:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789130958.402813:0:14027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130958.402843:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508810880 00000100:00100000:3.0:1789130958.402847:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508810880 00000100:00100000:3.0:1789130958.402866:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 398 00000100:00100000:3.0:1789130958.402871:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8604050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+24:14027:x1876039508810880:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789130958.402936:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8604050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+24:14027:x1876039508810880:12345-0@lo:502:llog_process_th.0 Request processed in 64us (122us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130958.402943:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 398 00000100:00100000:3.0:1789130958.402972:0:14027:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddc4ccf300 going to sleep for 11 seconds 00000100:00100000:3.0:1789130958.402984:0:14027:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8494b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:14027:1876039508810880:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789130958.403004:0:14027:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789130958.403013:0:14027:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789130958.403015:0:14027:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre lod.lustre-MDT0001-mdtlov.enable_compr_rotational 00000020:01000000:3.0:1789130958.403022:0:14027:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff91dded7b6800 00000020:00000080:3.0:1789130958.403024:0:14027:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789130958.403090:0:14027:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8494b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:14027:1876039508811008:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789130958.403122:0:14027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130958.403138:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508811008 00000100:00100000:3.0:1789130958.403141:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508811008 00000100:00100000:3.0:1789130958.403162:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 399 00000100:00100000:3.0:1789130958.403168:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8606850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+24:14027:x1876039508811008:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789130958.403225:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8606850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+24:14027:x1876039508811008:12345-0@lo:502:llog_process_th.0 Request processed in 56us (102us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130958.403237:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 399 00000100:00100000:3.0:1789130958.403276:0:14027:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddc4ccf300 going to sleep for 11 seconds 00000100:00100000:3.0:1789130958.403287:0:14027:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8494b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:14027:1876039508811008:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789130958.403303:0:14027:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789130958.403307:0:14027:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789130958.403309:0:14027:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre lod.lustre-MDT0001-mdtlov.enable_compr_rotational 00000040:00080000:3.0:1789130958.403313:0:14027:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1789130958.403360:0:6497:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-12 (rc=0) 10000000:01000000:3.0:1789130958.403377:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789130958.403386:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff91ddfa938c00/0xf3fe2838e1fc238c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc2393 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130958.403397:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff91ddfa938c00/0xf3fe2838e1fc238c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc2393 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130958.425656:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789130958.425684:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8494b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1876039508811136:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789130958.425755:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130958.425814:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508811136 00000100:00100000:3.0:1789130958.425961:0:8418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508811136 00000100:00100000:3.0:1789130958.426009:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1789130958.426018:0:8418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc84961c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1876039508811136:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789130958.426040:0:8418:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789130958.426083:0:8418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc84961c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1876039508811136:12345-0@lo:13:osp-pre-0-1.0 Request processed in 66us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130958.426090:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00010000:00080000:3.0:1789130958.426130:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc8494b40 x1876039508811136/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789130974 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130958.427424:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8494b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1876039508811136:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1789130958.737680:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130959.764309:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789130960.466729:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789130960.466761:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01ad3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508811264:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789130960.466871:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130960.466952:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508811264 00000100:00100000:2.0:1789130960.466963:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508811264 00000100:00100000:2.0:1789130960.467158:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1789130960.467169:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01ad21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1876039508811264:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789130960.467212:0:6505:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789130960.467353:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01ad21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1876039508811264:12345-0@lo:41:osp-pre-1-0.0 Request processed in 184us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130960.467361:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1789130960.467423:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01ad3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508811264:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789130960.468128:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789130960.468144:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7fd1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1876039508811392:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789130960.468200:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130960.469777:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508811392 00000100:00100000:0.0:1789130960.469795:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508811392 00000100:00100000:0.0:1789130960.469861:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1789130960.469871:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8494b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3628:x1876039508811392:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789130960.469915:0:6506:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789130960.470022:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8494b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3628:x1876039508811392:12345-0@lo:41:osp-pre-0-1.0 Request processed in 151us (1819us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130960.470030:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1789130960.470087:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7fd1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1876039508811392:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789130960.785671:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789130961.777220:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789130961.777276:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789130961.777309:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789130961.777360:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789130961.777525:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498228736 00000100:00100000:0.0:1789130961.777534:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498228736 00000100:00100000:0.0:1789130961.777596:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498228608 00000100:00100000:0.0:1789130961.777599:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498228608 00000100:00100000:0.0:1789130961.777613:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498228864 00000100:00100000:0.0:1789130961.777615:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498228864 00000100:00100000:0.0:1789130961.777633:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 235 00000100:00100000:0.0:1789130961.777642:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff751680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+5:2388:x1876039498228736:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1789130961.777713:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff751680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+5:2388:x1876039498228736:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 71us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130961.777738:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 235 00000100:00100000:0.0:1789130961.777756:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 236 00000100:00100000:0.0:1789130961.777761:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff7530c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+6:2387:x1876039498228608:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1789130961.777788:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff7530c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+6:2387:x1876039498228608:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 26us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130961.777794:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 236 00000100:00100000:0.0:1789130961.777805:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 237 00000100:00100000:0.0:1789130961.777811:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff753840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fde8d4a8-44db-4e6b-8249-c1c295e4901d+5:2387:x1876039498228864:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1789130961.777836:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff753840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fde8d4a8-44db-4e6b-8249-c1c295e4901d+5:2387:x1876039498228864:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 25us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130961.777841:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 237 00000100:00100000:3.0:1789130961.778498:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498228480 00000100:00100000:3.0:1789130961.778504:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498228480 00000100:00100000:3.0:1789130961.778538:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 400 00000100:00100000:3.0:1789130961.778545:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8606450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+13:2388:x1876039498228480:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1789130961.778584:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8606450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+13:2388:x1876039498228480:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 39us (1374us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130961.778590:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 400 00000100:00100000:3.0:1789130961.778643:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789130961.778708:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498228992 00000100:00100000:3.0:1789130961.778712:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498228992 00000100:00100000:3.0:1789130961.778740:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 238 00000100:00100000:3.0:1789130961.778746:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8496940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fde8d4a8-44db-4e6b-8249-c1c295e4901d+5:2388:x1876039498228992:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1789130961.778777:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8496940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fde8d4a8-44db-4e6b-8249-c1c295e4901d+5:2388:x1876039498228992:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 31us (134us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130961.778783:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 238 00000100:00080000:1.0:1789130961.779854:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789130961.779862:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1789130961.809689:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789130962.516253:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7fd1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1876039508811520:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789130962.516350:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130962.516445:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508811520 00000100:00100000:0.0:1789130962.516454:0:8418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508811520 00000100:00100000:0.0:1789130962.516545:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789130962.516556:0:8418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7fd0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1876039508811520:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789130962.516604:0:8418:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789130962.516652:0:8418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7fd0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1876039508811520:12345-0@lo:13:osp-pre-1-1.0 Request processed in 98us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130962.516659:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00080000:0.0:1789130962.516682:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789130962.516713:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc7fd1680 x1876039508811520/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789130978 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789130962.516749:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7fd1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1876039508811520:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789130962.517745:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01ad0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3626:1876039508811776:0@lo:400:kworker.0 00000100:00100000:2.0:1789130962.517805:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130962.517837:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01ad12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3626:1876039508812288:0@lo:400:kworker.0 00000100:00100000:2.0:1789130962.517862:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130962.517879:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01ad3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3626:1876039508812800:0@lo:400:kworker.0 00000100:00100000:2.0:1789130962.517903:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130962.517926:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1789130962.517932:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01ad1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3626:1876039508811648:0@lo:400:kworker.0 00000100:00100000:2.0:1789130962.517972:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130962.518011:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01ad3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508812160:0@lo:400:kworker.0 00000100:00100000:2.0:1789130962.518038:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130962.518056:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01ad1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508812672:0@lo:400:kworker.0 00000100:00100000:2.0:1789130962.518082:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130962.518116:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508811776 00000100:00100000:2.0:1789130962.518125:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508811776 00000100:00100000:2.0:1789130962.518168:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508812288 00000100:00100000:2.0:1789130962.518170:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508812288 00000100:00100000:2.0:1789130962.518191:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508812800 00000100:00100000:2.0:1789130962.518194:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508812800 00000100:00100000:2.0:1789130962.518211:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1789130962.518230:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01ad0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1876039508811776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130962.518279:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01ad0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1876039508811776:12345-0@lo:400:kworker.0 Request processed in 61us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130962.518286:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1789130962.518301:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1789130962.518306:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc843cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1876039508812288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130962.518326:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc843cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1876039508812288:12345-0@lo:400:kworker.0 Request processed in 20us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130962.518333:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1789130962.518342:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1789130962.518346:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc843de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1876039508812800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130962.518367:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc843de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1876039508812800:12345-0@lo:400:kworker.0 Request processed in 21us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130962.518372:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1789130962.518396:0:11069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508812160 00000100:00100000:2.0:1789130962.518399:0:11069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508812160 00000100:00100000:2.0:1789130962.518433:0:11069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1789130962.518439:0:11069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc843fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508812160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130962.518512:0:11069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc843fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508812160:12345-0@lo:400:kworker.0 Request processed in 72us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130962.518518:0:11069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1789130962.518536:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508812672 00000100:00100000:2.0:1789130962.518539:0:9827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508812672 00000100:00100000:2.0:1789130962.518566:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1789130962.518571:0:9827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc843c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508812672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130962.518601:0:9827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc843c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508812672:12345-0@lo:400:kworker.0 Request processed in 30us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130962.518607:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1789130962.518645:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01ad3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508812160:0@lo:400:kworker.0 00010000:00080000:2.0:1789130962.518659:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91de01ad1a40 x1876039508812672/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789130978 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789130962.518670:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01ad1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508812672:0@lo:400:kworker.0 00000100:00100000:2.0:1789130962.518682:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01ad0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3626:1876039508811776:0@lo:400:kworker.0 00000100:00100000:2.0:1789130962.518690:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01ad12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3626:1876039508812288:0@lo:400:kworker.0 00000100:00100000:2.0:1789130962.518700:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01ad3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3626:1876039508812800:0@lo:400:kworker.0 00000100:00100000:0.0:1789130962.519187:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508811648 00000100:00100000:0.0:1789130962.519195:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508811648 00000100:00100000:0.0:1789130962.519254:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 401 00000100:00100000:0.0:1789130962.519262:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8607050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+24:3626:x1876039508811648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130962.519313:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8607050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+24:3626:x1876039508811648:12345-0@lo:400:kworker.0 Request processed in 53us (1341us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130962.519320:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 401 00000100:00100000:0.0:1789130962.519392:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7fd1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508813184:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789130962.519424:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130962.519479:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01ad3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508811904:0@lo:400:kworker.0 00000100:00100000:0.0:1789130962.519507:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130962.519522:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01ad03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3627:1876039508812416:0@lo:400:kworker.0 00000100:00100000:0.0:1789130962.519544:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130962.519561:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01ad2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3627:1876039508812928:0@lo:400:kworker.0 00000100:00100000:0.0:1789130962.519716:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130962.519748:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789130962.519755:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01ad1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3627:1876039508812032:0@lo:400:kworker.0 00000100:00100000:0.0:1789130962.519780:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130962.519802:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01ad2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508812544:0@lo:400:kworker.0 00000100:00100000:0.0:1789130962.519828:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130962.519844:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01ad0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1876039508813056:0@lo:400:kworker.0 00000100:00100000:0.0:1789130962.519866:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130962.519904:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508812416 00000100:00100000:0.0:1789130962.519908:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508812416 00000100:00100000:0.0:1789130962.519937:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508812928 00000100:00100000:0.0:1789130962.519940:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508812928 00000100:00100000:0.0:1789130962.519954:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508812032 00000100:00100000:0.0:1789130962.519956:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508812032 00000100:00100000:0.0:1789130962.519969:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1789130962.519975:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7fd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1876039508812416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130962.520014:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7fd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1876039508812416:12345-0@lo:400:kworker.0 Request processed in 39us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130962.520021:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1789130962.520033:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1789130962.520039:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7fd0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3627:x1876039508812928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130962.520066:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7fd0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3627:x1876039508812928:12345-0@lo:400:kworker.0 Request processed in 27us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130962.520072:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1789130962.520083:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1789130962.520088:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7fd21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1876039508812032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130962.520115:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7fd21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1876039508812032:12345-0@lo:400:kworker.0 Request processed in 26us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130962.520121:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00080000:0.0:1789130962.520137:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789130962.520142:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789130962.520144:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789130962.520155:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508813184 00000100:00100000:0.0:1789130962.520159:0:8418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508813184 00000100:00100000:0.0:1789130962.520190:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789130962.520197:0:8418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7fd3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1876039508813184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789130962.520237:0:8418:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789130962.520278:0:8418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7fd3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1876039508813184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (854us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130962.520285:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00080000:0.0:1789130962.520302:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789130962.520330:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc7fd1680 x1876039508813184/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789130978 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789130962.520349:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7fd1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508813184:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789130962.520403:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01ad1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3627:1876039508812032:0@lo:400:kworker.0 00010000:00080000:0.0:1789130962.520415:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91de01ad03c0 x1876039508812416/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130978 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789130962.520425:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01ad03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3627:1876039508812416:0@lo:400:kworker.0 00010000:00080000:0.0:1789130962.520435:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91de01ad2d00 x1876039508812928/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130978 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789130962.520443:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01ad2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3627:1876039508812928:0@lo:400:kworker.0 00000100:00100000:1.0:1789130962.520543:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508812544 00000100:00100000:1.0:1789130962.520548:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508812544 00000100:00100000:1.0:1789130962.520606:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508813056 00000100:00100000:1.0:1789130962.520610:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508813056 00000100:00100000:1.0:1789130962.520626:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789130962.520632:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7fd3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508812544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130962.520678:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7fd3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508812544:12345-0@lo:400:kworker.0 Request processed in 47us (850us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130962.520685:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789130962.520698:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1789130962.520704:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7fd2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3627:x1876039508813056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130962.520751:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7fd2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3627:x1876039508813056:12345-0@lo:400:kworker.0 Request processed in 47us (884us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130962.520757:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00010000:00080000:1.0:1789130962.520792:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91de01ad2580 x1876039508812544/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789130978 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789130962.520802:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01ad2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508812544:0@lo:400:kworker.0 00010000:00080000:1.0:1789130962.520813:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91de01ad0780 x1876039508813056/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789130978 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789130962.520820:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01ad0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1876039508813056:0@lo:400:kworker.0 00000100:00080000:0.0:1789130962.520987:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789130962.521078:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508811904 00000100:00100000:2.0:1789130962.521083:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508811904 00000100:00100000:2.0:1789130962.521238:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1789130962.521246:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7fd1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508811904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130962.521301:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7fd1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508811904:12345-0@lo:400:kworker.0 Request processed in 57us (1794us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130962.521313:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1789130962.521480:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01ad1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3626:1876039508811648:0@lo:400:kworker.0 00000100:00100000:1.0:1789130962.521556:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01ad3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508811904:0@lo:400:kworker.0 00010000:00010000:1.0:1789130962.836324:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789130963.020056:0:14163:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 08:49:21 (1789130961) === 00000100:00100000:0.0:1789130963.025698:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789130963.025733:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7fd1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508813312:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789130963.025850:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130963.025943:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508813312 00000100:00100000:0.0:1789130963.025953:0:8418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508813312 00000100:00100000:0.0:1789130963.026014:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1789130963.026026:0:8418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7fd0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1876039508813312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789130963.026062:0:8418:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789130963.026127:0:8418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7fd0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1876039508813312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130963.026134:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00010000:00080000:0.0:1789130963.026182:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc7fd1680 x1876039508813312/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789130979 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789130963.026203:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7fd1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508813312:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789130963.543703:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789130963.543737:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8496580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1876039508813440:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789130963.543852:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130963.544333:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508813440 00000100:00100000:2.0:1789130963.544343:0:8418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508813440 00000100:00100000:2.0:1789130963.544413:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789130963.544433:0:8418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7fd1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1876039508813440:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789130963.544521:0:8418:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789130963.544587:0:8418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7fd1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1876039508813440:12345-0@lo:13:osp-pre-0-1.0 Request processed in 164us (735us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130963.544595:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00010000:00080000:1.0:1789130963.544712:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc8496580 x1876039508813440/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789130979 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789130963.544736:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8496580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1876039508813440:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1789130963.861573:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789130964.764073:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789130964.764127:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789130964.764212:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498229120 00000100:00100000:0.0:1789130964.764226:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498229120 00000100:00100000:3.0:1789130964.764236:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498229248 00000100:00100000:3.0:1789130964.764244:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498229248 00000100:00100000:3.0:1789130964.764308:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2 00000100:00100000:0.0:1789130964.764309:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 22 00000100:00100000:0.0:1789130964.764326:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01ad0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+7:2387:x1876039498229120:12345-192.168.203.11@tcp:41:mkdir.0 00000100:00100000:3.0:1789130964.764327:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01ad3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+7:10751:x1876039498229248:12345-192.168.203.11@tcp:700:mkdir.0 00000004:00000024:0.0:1789130964.764380:0:9769:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789130964.764449:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01ad3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+7:10751:x1876039498229248:12345-192.168.203.11@tcp:700:mkdir.0 Request processed in 126us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130964.764456:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01ad0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+7:2387:x1876039498229120:12345-192.168.203.11@tcp:41:mkdir.0 Request processed in 133us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130964.764492:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2 00000100:00100000:0.0:1789130964.764497:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 22 00000100:00080000:2.0:1789130964.764649:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789130964.768795:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789130964.771639:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498229504 00000100:00100000:1.0:1789130964.771677:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498229504 00000100:00100000:1.0:1789130964.771756:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 23 00000100:00100000:1.0:1789130964.771767:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8609680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+6:10751:x1876039498229504:12345-192.168.203.11@tcp:36:mkdir.0 00010000:00010000:1.0:1789130964.771908:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789130964.772065:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7e36200/0xf3fe2838e1fc21a2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d26985a expref: 6 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130964.772096:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91dcc7d6c700) 00010000:00010000:1.0:1789130964.772111:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789130964.772220:0:6502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91dde19aae00/0xf3fe2838e1fc239a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130964.772234:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dde19aae00/0xf3fe2838e1fc239a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130964.772245:0:6502:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dde19aae00/0xf3fe2838e1fc239a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130964.774314:0:6502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91dde19abc00/0xf3fe2838e1fc23a1 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130964.774335:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dde19abc00/0xf3fe2838e1fc23a1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130964.774349:0:6502:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dde19abc00/0xf3fe2838e1fc23a1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130964.774956:0:6502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91dde19aba00/0xf3fe2838e1fc23a8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130964.774966:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dde19aba00/0xf3fe2838e1fc23a8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130964.774984:0:6502:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dde19aba00/0xf3fe2838e1fc23a8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789130964.775003:0:6502:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000008f6975cc reply state 00000000162422e6 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff91dde19aba00/0xf3fe2838e1fc23a8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130964.775014:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dde19aba00/0xf3fe2838e1fc23a8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130964.775021:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff91ddff605f00) 00010000:00010000:1.0:1789130964.775024:0:6502:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789130964.775028:0:6502:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1789130964.775034:0:6502:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1789130964.775042:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91dde19aae00/0xf3fe2838e1fc239a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130964.775048:0:6502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dde19aae00/0xf3fe2838e1fc239a lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130964.775055:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91dde19aae00/0xf3fe2838e1fc239a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130964.775061:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dde19aae00 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:1.0:1789130964.775067:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dde19aae00/0xf3fe2838e1fc239a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130964.775074:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dde19aae00/0xf3fe2838e1fc239a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130964.775085:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91ddff605900) 00010000:00010000:1.0:1789130964.775088:0:6502:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130964.775100:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91dde19aae00/0xf3fe2838e1fc239a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130964.775108:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dde19aae00/0xf3fe2838e1fc239a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789130964.775127:0:6502:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000008f6975cc reply state 00000000162422e6 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff91dde19abc00/0xf3fe2838e1fc23a1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130964.775137:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dde19abc00/0xf3fe2838e1fc23a1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130964.775144:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff91ddff605700) 00010000:00010000:1.0:1789130964.775147:0:6502:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789130964.775149:0:6502:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1789130964.775283:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8609680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+7:10751:x1876039498229504:12345-192.168.203.11@tcp:36:mkdir.0 Request processed in 3512us (6498us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1789130964.775298:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 23 00000100:00100000:0.0:1789130964.785310:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789130964.787799:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498229632 00000100:00100000:1.0:1789130964.787818:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498229632 00000100:00100000:1.0:1789130964.787904:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 24 00000100:00100000:1.0:1789130964.787918:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8608b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+7:10752:x1876039498229632:12345-192.168.203.11@tcp:101:chmod.0 00010000:00010000:1.0:1789130964.787948:0:9769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130964.787980:0:9769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dde19aae00/0xf3fe2838e1fc23af lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269909 expref: -99 pid: 9769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130964.788084:0:9769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cae00/0xf3fe2838e1fc23b6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130964.788103:0:9769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cae00/0xf3fe2838e1fc23b6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130964.788130:0:9769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cae00/0xf3fe2838e1fc23b6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789130964.788188:0:9769:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789130964.788193:0:9769:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789130964.788265:0:9769:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cae00/0xf3fe2838e1fc23b6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130964.788303:0:9769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dde19aae00/0xf3fe2838e1fc23af lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269909 expref: 9 pid: 9769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130964.788322:0:9769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cae00/0xf3fe2838e1fc23b6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269909 expref: 8 pid: 9769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130964.788332:0:9769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91ddff605900) 00010000:00010000:1.0:1789130964.788336:0:9769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789130964.788341:0:9769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dcc85cae00, rc 0) 00000100:00100000:1.0:1789130964.788731:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8608b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+8:10752:x1876039498229632:12345-192.168.203.11@tcp:101:chmod.0 Request processed in 814us (3440us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130964.788740:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 24 00000100:00100000:2.0:1789130964.795914:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789130964.796318:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498229888 00000100:00100000:0.0:1789130964.796333:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498229888 00000100:00100000:0.0:1789130964.796735:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 25 00000100:00100000:0.0:1789130964.796751:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01ad1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+8:10752:x1876039498229888:12345-192.168.203.11@tcp:36:chmod.0 00010000:00010000:0.0:1789130964.796820:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789130964.796859:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cae00/0xf3fe2838e1fc23b6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269909 expref: 8 pid: 9769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130964.796893:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91ddff605900) 00010000:00010000:0.0:1789130964.796906:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789130964.796952:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfa939c00/0xf3fe2838e1fc23bd lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130964.796967:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfa939c00/0xf3fe2838e1fc23bd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130964.796979:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfa939c00/0xf3fe2838e1fc23bd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789130964.797265:0:6500:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000cc5996c1 reply state 000000002529ab18 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfa939c00/0xf3fe2838e1fc23bd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130964.797280:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfa939c00/0xf3fe2838e1fc23bd lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130964.797287:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91ddcf5ff500) 00010000:00010000:0.0:1789130964.797290:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1789130964.797292:0:6500:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789130964.797301:0:6500:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1789130964.797425:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01ad1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+9:10752:x1876039498229888:12345-192.168.203.11@tcp:36:chmod.0 Request processed in 670us (1519us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1789130964.798132:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 25 00000100:00100000:2.0:1789130964.835213:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789130964.835499:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498230016 00000100:00100000:1.0:1789130964.835514:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498230016 00000100:00100000:1.0:1789130964.835593:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 26 00000100:00100000:1.0:1789130964.835606:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01ad0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+9:10753:x1876039498230016:12345-192.168.203.11@tcp:101:chown.0 00010000:00010000:1.0:1789130964.835638:0:6501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130964.835666:0:6501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca800/0xf3fe2838e1fc23c4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269910 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130964.835775:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca200/0xf3fe2838e1fc23cb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130964.835793:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca200/0xf3fe2838e1fc23cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130964.835808:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca200/0xf3fe2838e1fc23cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789130964.835865:0:6501:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789130964.835870:0:6501:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789130964.835922:0:6501:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca200/0xf3fe2838e1fc23cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130964.835957:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca800/0xf3fe2838e1fc23c4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269910 expref: 11 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130964.835982:0:6501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca200/0xf3fe2838e1fc23cb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269910 expref: 10 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130964.835993:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91ddcf5ff500) 00010000:00010000:1.0:1789130964.835998:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789130964.836004:0:6501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dcc85ca200, rc 0) 00000100:00100000:1.0:1789130964.836716:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01ad0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+10:10753:x1876039498230016:12345-192.168.203.11@tcp:101:chown.0 Request processed in 1109us (1583us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130964.836727:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 26 00000100:00100000:3.0:1789130964.839824:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789130964.840603:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498230144 00000100:00100000:1.0:1789130964.840616:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498230144 00000100:00100000:1.0:1789130964.840875:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 27 00000100:00100000:1.0:1789130964.840887:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8494f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+10:10753:x1876039498230144:12345-192.168.203.11@tcp:101:chown.0 00010000:00010000:1.0:1789130964.840916:0:6502:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130964.840942:0:6502:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb600/0xf3fe2838e1fc23d2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269917 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130964.842388:0:6502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca400/0xf3fe2838e1fc23d9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130964.842425:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca400/0xf3fe2838e1fc23d9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130964.842440:0:6502:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca400/0xf3fe2838e1fc23d9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130964.842453:0:6502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cbe00/0xf3fe2838e1fc23e0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130964.842475:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cbe00/0xf3fe2838e1fc23e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130964.843078:0:6502:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cbe00/0xf3fe2838e1fc23e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130964.843255:0:6502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cac00/0xf3fe2838e1fc23e7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130964.843267:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cac00/0xf3fe2838e1fc23e7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130964.843275:0:6502:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cac00/0xf3fe2838e1fc23e7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789130964.843349:0:6502:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789130964.843354:0:6502:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789130964.843380:0:6502:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cac00/0xf3fe2838e1fc23e7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130964.843395:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca400/0xf3fe2838e1fc23d9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130964.843403:0:6502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca400/0xf3fe2838e1fc23d9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130964.843410:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca400/0xf3fe2838e1fc23d9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130964.843832:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc85ca400 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:1.0:1789130964.843839:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca400/0xf3fe2838e1fc23d9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130964.843848:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca400/0xf3fe2838e1fc23d9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130964.843863:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91ddcf5ff500) 00010000:00010000:1.0:1789130964.843867:0:6502:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130964.843873:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca400/0xf3fe2838e1fc23d9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130964.843880:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca400/0xf3fe2838e1fc23d9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130964.843892:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cbe00/0xf3fe2838e1fc23e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130964.843910:0:6502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cbe00/0xf3fe2838e1fc23e0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130964.843916:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cbe00/0xf3fe2838e1fc23e0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130964.843921:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc85cbe00 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:1.0:1789130964.843924:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cbe00/0xf3fe2838e1fc23e0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130964.843931:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cbe00/0xf3fe2838e1fc23e0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130964.843939:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff91ddff605700) 00010000:00010000:1.0:1789130964.843941:0:6502:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130964.843944:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cbe00/0xf3fe2838e1fc23e0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130964.843950:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cbe00/0xf3fe2838e1fc23e0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130964.843996:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb600/0xf3fe2838e1fc23d2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269917 expref: 12 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130964.844076:0:6502:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cac00/0xf3fe2838e1fc23e7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269917 expref: 11 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130964.844085:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff91ddff605f00) 00010000:00010000:1.0:1789130964.844087:0:6502:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789130964.844096:0:6502:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dcc85cac00, rc 0) 00000100:00100000:1.0:1789130964.844270:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8494f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+11:10753:x1876039498230144:12345-192.168.203.11@tcp:101:chown.0 Request processed in 3383us (4458us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130964.844281:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 27 00000100:00100000:2.0:1789130964.846909:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789130964.847096:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498230272 00000100:00100000:3.0:1789130964.847107:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498230272 00000100:00100000:3.0:1789130964.847244:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 6 00000100:00100000:3.0:1789130964.847257:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01ad2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+11:10753:x1876039498230272:12345-192.168.203.11@tcp:900:chown.0 00000100:00100000:3.0:1789130964.847363:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01ad2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+11:10753:x1876039498230272:12345-192.168.203.11@tcp:900:chown.0 Request processed in 108us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130964.847371:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 6 00000100:00100000:2.0:1789130964.850370:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789130964.850450:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498230528 00000100:00100000:1.0:1789130964.850614:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498230528 00000100:00100000:1.0:1789130964.850725:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 28 00000100:00100000:1.0:1789130964.850737:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01ad2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+11:10753:x1876039498230528:12345-192.168.203.11@tcp:36:chown.0 00010000:00010000:1.0:1789130964.850812:0:9769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789130964.850848:0:9769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cac00/0xf3fe2838e1fc23e7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269917 expref: 11 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130964.850868:0:9769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff91ddff605f00) 00010000:00010000:1.0:1789130964.850874:0:9769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789130964.850906:0:9769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb600/0xf3fe2838e1fc23ee lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130964.850923:0:9769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb600/0xf3fe2838e1fc23ee lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130964.850935:0:9769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb600/0xf3fe2838e1fc23ee lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789130964.854633:0:6479:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967301 is committed 00010000:00010000:2.0:1789130964.854963:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91dde19abc00/0xf3fe2838e1fc23a1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130964.854981:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dde19abc00/0xf3fe2838e1fc23a1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130964.854989:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91dde19abc00/0xf3fe2838e1fc23a1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130964.854997:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dde19abc00 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:2.0:1789130964.855078:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dde19abc00/0xf3fe2838e1fc23a1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130964.855088:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dde19abc00/0xf3fe2838e1fc23a1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130964.855108:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff91ddff605700) 00010000:00010000:2.0:1789130964.855112:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130964.855118:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91dde19abc00/0xf3fe2838e1fc23a1 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130964.855125:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dde19abc00/0xf3fe2838e1fc23a1 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789130964.855280:0:9769:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000004bffeae6 reply state 0000000025e076c6 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb600/0xf3fe2838e1fc23ee lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130964.855301:0:9769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb600/0xf3fe2838e1fc23ee lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130964.855310:0:9769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff91ddff605f00) 00010000:00010000:3.0:1789130964.855312:0:9769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1789130964.855317:0:9769:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789130964.855333:0:9769:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1789130964.856376:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91dde19aba00/0xf3fe2838e1fc23a8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130964.856389:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dde19aba00/0xf3fe2838e1fc23a8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130964.856396:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91dde19aba00/0xf3fe2838e1fc23a8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130964.856403:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dde19aba00 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:2.0:1789130964.856407:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dde19aba00/0xf3fe2838e1fc23a8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130964.856426:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dde19aba00/0xf3fe2838e1fc23a8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130964.856441:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff91ddff605f00) 00010000:00010000:2.0:1789130964.856443:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130964.856454:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91dde19aba00/0xf3fe2838e1fc23a8 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00080000:3.0:1789130964.856726:0:9769:0:(ldlm_lib.c:3520:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1789130964.856750:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01ad2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+9:10753:x1876039498230528:12345-192.168.203.11@tcp:36:chown.0 Request processed in 6008us (6389us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1789130964.856762:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 28 00010000:00010000:2.0:1789130964.856827:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dde19aba00/0xf3fe2838e1fc23a8 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130964.856847:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfa939c00/0xf3fe2838e1fc23bd lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130964.856854:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfa939c00/0xf3fe2838e1fc23bd lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130964.856860:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfa939c00/0xf3fe2838e1fc23bd lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130964.856867:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddfa939c00 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:2.0:1789130964.856870:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfa939c00/0xf3fe2838e1fc23bd lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130964.856876:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfa939c00/0xf3fe2838e1fc23bd lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130964.856886:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91ddcf5ff500) 00010000:00010000:2.0:1789130964.856889:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789130964.856892:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfa939c00/0xf3fe2838e1fc23bd lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130964.856898:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfa939c00/0xf3fe2838e1fc23bd lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130964.857366:0:3612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb600/0xf3fe2838e1fc23ee lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130964.857377:0:3612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb600/0xf3fe2838e1fc23ee lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130964.857396:0:3612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb600/0xf3fe2838e1fc23ee lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130964.857402:0:3612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc85cb600 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:1.0:1789130964.857405:0:3612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb600/0xf3fe2838e1fc23ee lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130964.857421:0:3612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb600/0xf3fe2838e1fc23ee lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130964.857432:0:3612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff91ddff605f00) 00010000:00010000:1.0:1789130964.857435:0:3612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789130964.857438:0:3612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb600/0xf3fe2838e1fc23ee lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130964.857444:0:3612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb600/0xf3fe2838e1fc23ee lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130964.881676:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789130964.882050:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789130964.882213:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498230656 00000100:00100000:2.0:1789130964.882226:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498230656 00000100:00100000:2.0:1789130964.882385:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 29 00000100:00100000:2.0:1789130964.882416:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8496580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+6:10754:x1876039498230656:12345-192.168.203.11@tcp:101:touch.500 00010000:00010000:2.0:1789130964.882452:0:6502:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130964.882514:0:6502:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7ec00/0xf3fe2838e1fc23f5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d26991e expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789130964.884922:0:6502:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 2334us 00010000:00010000:0.0:1789130964.906056:0:6502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfa939c00/0xf3fe2838e1fc23fc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130964.906085:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfa939c00/0xf3fe2838e1fc23fc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130964.906109:0:6502:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfa939c00/0xf3fe2838e1fc23fc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130964.906125:0:6502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfa939e00/0xf3fe2838e1fc2403 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130964.906132:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfa939e00/0xf3fe2838e1fc2403 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130964.906137:0:6502:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfa939e00/0xf3fe2838e1fc2403 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130964.906318:0:6502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6c00/0xf3fe2838e1fc240a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130964.906327:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6c00/0xf3fe2838e1fc240a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130964.906334:0:6502:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6c00/0xf3fe2838e1fc240a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130964.906379:0:6502:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789130964.906383:0:6502:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789130964.906430:0:6502:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6c00/0xf3fe2838e1fc240a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130964.906444:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfa939c00/0xf3fe2838e1fc23fc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130964.906450:0:6502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfa939c00/0xf3fe2838e1fc23fc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130964.906488:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfa939c00/0xf3fe2838e1fc23fc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130964.906495:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddfa939c00 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:0.0:1789130964.906499:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfa939c00/0xf3fe2838e1fc23fc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130964.906508:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfa939c00/0xf3fe2838e1fc23fc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130964.906522:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91ddcf5ff500) 00010000:00010000:0.0:1789130964.906525:0:6502:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130964.906531:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfa939c00/0xf3fe2838e1fc23fc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130964.906536:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfa939c00/0xf3fe2838e1fc23fc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130964.906547:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfa939e00/0xf3fe2838e1fc2403 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130964.906553:0:6502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfa939e00/0xf3fe2838e1fc2403 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130964.906558:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfa939e00/0xf3fe2838e1fc2403 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130964.906563:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddfa939e00 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:0.0:1789130964.906565:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfa939e00/0xf3fe2838e1fc2403 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130964.906579:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfa939e00/0xf3fe2838e1fc2403 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130964.906586:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff91ddcf5ffa00) 00010000:00010000:0.0:1789130964.906588:0:6502:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130964.906591:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfa939e00/0xf3fe2838e1fc2403 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130964.906595:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfa939e00/0xf3fe2838e1fc2403 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130964.906640:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7ec00/0xf3fe2838e1fc23f5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d26991e expref: 8 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130964.906658:0:6502:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6c00/0xf3fe2838e1fc240a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d26991e expref: 7 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130964.906667:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff91ddcf5ff700) 00010000:00010000:0.0:1789130964.906669:0:6502:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789130964.906672:0:6502:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91de01ad6c00, rc 0) 00000100:00100000:0.0:1789130964.906758:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8496580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+7:10754:x1876039498230656:12345-192.168.203.11@tcp:101:touch.500 Request processed in 24343us (24715us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130964.906769:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 29 00000100:00100000:2.0:1789130964.911232:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789130964.913526:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498230912 00000100:00100000:1.0:1789130964.913550:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498230912 00000100:00100000:1.0:1789130964.913780:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 30 00000100:00100000:1.0:1789130964.913795:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01ad03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+7:10754:x1876039498230912:12345-192.168.203.11@tcp:101:touch.500 00010000:00010000:1.0:1789130964.913833:0:6501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130964.913860:0:6501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb600/0xf3fe2838e1fc2411 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269925 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130964.914005:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cac00/0xf3fe2838e1fc2418 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130964.914048:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cac00/0xf3fe2838e1fc2418 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130964.914063:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cac00/0xf3fe2838e1fc2418 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130964.915485:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cbe00/0xf3fe2838e1fc241f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0xaadd030a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130964.915511:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cbe00/0xf3fe2838e1fc241f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xaadd030a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130964.915528:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cbe00/0xf3fe2838e1fc241f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xaadd030a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789130964.916030:0:6501:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2:0x0], index 1: 0 00010000:00010000:1.0:1789130964.916189:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca400/0xf3fe2838e1fc2426 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130964.916213:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca400/0xf3fe2838e1fc2426 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130964.916223:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca400/0xf3fe2838e1fc2426 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130964.916257:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cac00/0xf3fe2838e1fc2418 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130964.916263:0:6501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cac00/0xf3fe2838e1fc2418 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130964.916269:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cac00/0xf3fe2838e1fc2418 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130964.916294:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc85cac00 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:1.0:1789130964.916299:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cac00/0xf3fe2838e1fc2418 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130964.916307:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cac00/0xf3fe2838e1fc2418 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130964.916319:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff91ddcf5ff700) 00010000:00010000:1.0:1789130964.916322:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130964.916327:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cac00/0xf3fe2838e1fc2418 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130964.916332:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cac00/0xf3fe2838e1fc2418 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789130964.916349:0:6501:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000ebe7e175 reply state 00000000e508fe53 transno 4294967302 ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cbe00/0xf3fe2838e1fc241f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xaadd030a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130964.916361:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cbe00/0xf3fe2838e1fc241f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xaadd030a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130964.916366:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xaadd030a (ffff91ddff605f00) 00010000:00010000:1.0:1789130964.916369:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789130964.916372:0:6501:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789130964.916406:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb600/0xf3fe2838e1fc2411 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269925 expref: 10 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130964.916421:0:6501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca400/0xf3fe2838e1fc2426 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269925 expref: 9 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130964.916440:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff91ddff605100) 00010000:00010000:1.0:1789130964.916442:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789130964.916445:0:6501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dcc85ca400, rc 0) 00000100:00100000:1.0:1789130964.916564:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01ad03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+10:10754:x1876039498230912:12345-192.168.203.11@tcp:101:touch.500 Request processed in 2773us (5348us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1789130964.927380:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789130964.927610:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498231168 00000100:00100000:3.0:1789130964.927625:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498231168 00000100:00100000:3.0:1789130964.928637:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 31 00000100:00100000:3.0:1789130964.928670:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc860b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+11:10754:x1876039498231168:12345-192.168.203.11@tcp:36:touch.500 00010000:00010000:3.0:1789130964.928766:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789130964.928801:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca400/0xf3fe2838e1fc2426 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269925 expref: 11 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130964.928845:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff91ddff605100) 00010000:00010000:3.0:1789130964.928859:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789130964.928933:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4c00/0xf3fe2838e1fc2434 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130964.928950:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4c00/0xf3fe2838e1fc2434 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130964.928963:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4c00/0xf3fe2838e1fc2434 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130964.928988:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 30 00000004:00010000:3.0:1789130964.929478:0:6500:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000e6deefb8 reply state 00000000f8d31aaf transno 4294967303 ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4c00/0xf3fe2838e1fc2434 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130964.929496:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4c00/0xf3fe2838e1fc2434 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130964.929503:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff91dded3a2500) 00010000:00010000:3.0:1789130964.929506:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789130964.929509:0:6500:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789130964.929658:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc860b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+11:10754:x1876039498231168:12345-192.168.203.11@tcp:36:touch.500 Request processed in 994us (2411us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1789130964.929667:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 31 00000100:00100000:2.0:1789130964.939447:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789130964.940411:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498231296 00000100:00100000:1.0:1789130964.940423:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498231296 00000100:00100000:1.0:1789130964.940511:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 32 00000100:00100000:1.0:1789130964.940521:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01ad1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+11:10754:x1876039498231296:12345-192.168.203.11@tcp:101:touch.500 00010000:00010000:1.0:1789130964.940545:0:9769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130964.940565:0:9769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca800/0xf3fe2838e1fc243b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d26992c expref: -99 pid: 9769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130964.940621:0:9769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca800/0xf3fe2838e1fc243b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d26992c expref: 12 pid: 9769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130964.940634:0:9769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca800/0xf3fe2838e1fc243b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d26992c expref: 12 pid: 9769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130964.940665:0:9769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff91dded3a2500) 00010000:00010000:1.0:1789130964.940668:0:9769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789130964.940672:0:9769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dcc85ca800, rc 0) 00000100:00100000:1.0:1789130964.940741:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01ad1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+12:10754:x1876039498231296:12345-192.168.203.11@tcp:101:touch.500 Request processed in 221us (1303us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130964.940764:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 32 00000100:00100000:0.0:1789130964.946283:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789130964.946514:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498231424 00000100:00100000:1.0:1789130964.946528:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498231424 00000100:00100000:1.0:1789130964.946590:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 24 00000100:00100000:1.0:1789130964.946599:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddffc0e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2384:x1876039498231424:12345-192.168.203.11@tcp:8:touch.500 00010000:00080000:1.0:1789130964.946648:0:8417:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from b99c111d-b9b6-4590-88e4-9fefd4d4c3a4@192.168.203.11@tcp t0 exp 0000000000000000 cur 320 last 0 00000020:00000080:0.0:1789130964.946747:0:8417:0:(genops.c:1385:class_connect()) connect: client b99c111d-b9b6-4590-88e4-9fefd4d4c3a4, cookie 0xf3fe2838e1fc2442 00002000:00100000:0.0:1789130964.946767:0:8417:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli b99c111d-b9b6-4590-88e4-9fefd4d4c3a4/ffff91dcc78a2800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113984 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789130964.946823:0:8417:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type 37, return 37 00002000:00080000:0.0:1789130964.946932:0:8417:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789130964.946979:0:8417:0:(import.c:65:import_set_state_nolock()) ffff91dcc78a4800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789130964.947082:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddffc0e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+6:2384:x1876039498231424:12345-192.168.203.11@tcp:8:touch.500 Request processed in 481us (820us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130964.947095:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 24 00000100:00100000:2.0:1789130964.955427:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789130964.955731:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498231552 00000100:00100000:0.0:1789130964.955744:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498231552 00000100:00100000:0.0:1789130964.955880:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 25 00000100:00100000:0.0:1789130964.955892:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01ad3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+6:0:x1876039498231552:12345-192.168.203.11@tcp:2:touch.500 00000100:00080000:2.0:1789130964.958060:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:0.0:1789130964.977224:0:9493:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000001:00100000:0.0:1789130964.977304:0:9493:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of b99c111d-b9b6-4590-88e4-9fefd4d4c3a4 00000100:00100000:2.0:1789130964.978829:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01ad3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+5:0:x1876039498231552:12345-192.168.203.11@tcp:2:touch.500 Request processed in 22915us (23741us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1789130964.978847:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 25 00000100:00100000:2.0:1789130964.982810:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789130964.983013:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498231808 00000100:00100000:3.0:1789130964.983027:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498231808 00000100:00100000:3.0:1789130964.983236:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2 00000100:00100000:3.0:1789130964.983331:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01ad12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+12:10754:x1876039498231808:12345-192.168.203.11@tcp:35:touch.500 00000100:00100000:3.0:1789130964.984136:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01ad12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+13:10754:x1876039498231808:12345-192.168.203.11@tcp:35:touch.500 Request processed in 806us (1336us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1789130964.984324:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2 00000100:00100000:0.0:1789130964.994044:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789130964.996196:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498231936 00000100:00100000:1.0:1789130964.996229:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498231936 00000100:00100000:3.0:1789130964.996514:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 33 00000100:00100000:3.0:1789130964.996531:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8609e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+13:10755:x1876039498231936:12345-192.168.203.11@tcp:101:rm.0 00010000:00010000:3.0:1789130964.996567:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789130964.996594:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5200/0xf3fe2838e1fc2449 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269933 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130964.996695:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5400/0xf3fe2838e1fc2450 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130964.996713:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5400/0xf3fe2838e1fc2450 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130964.997384:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5400/0xf3fe2838e1fc2450 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789130964.997603:0:6500:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789130964.997610:0:6500:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789130964.997671:0:6500:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5400/0xf3fe2838e1fc2450 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130964.997712:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5200/0xf3fe2838e1fc2449 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269933 expref: 15 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130964.997737:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5400/0xf3fe2838e1fc2450 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269933 expref: 14 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130964.997772:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff91ddcf5ff700) 00010000:00010000:3.0:1789130964.997775:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789130964.997780:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ddfd0b5400, rc 0) 00000100:00100000:3.0:1789130964.998136:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8609e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+14:10755:x1876039498231936:12345-192.168.203.11@tcp:101:rm.0 Request processed in 1609us (4106us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130964.998150:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 33 00000100:00100000:2.0:1789130965.004074:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789130965.004491:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498232192 00000100:00100000:1.0:1789130965.004505:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498232192 00000100:00100000:1.0:1789130965.004577:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 34 00000100:00100000:1.0:1789130965.004589:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01ad0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+14:10755:x1876039498232192:12345-192.168.203.11@tcp:101:rm.0 00010000:00010000:1.0:1789130965.004617:0:9769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130965.004643:0:9769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb600/0xf3fe2838e1fc2457 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d26993a expref: -99 pid: 9769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789130965.004786:0:9769:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1789130965.005388:0:9769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb600/0xf3fe2838e1fc2457 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d26993a expref: 16 pid: 9769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130965.005407:0:9769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91ddcf5ff500) 00010000:00010000:1.0:1789130965.005411:0:9769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789130965.005418:0:9769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb600/0xf3fe2838e1fc2457 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d26993a expref: 16 pid: 9769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130965.005435:0:9769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dcc85cb600, rc 0) 00000100:00100000:1.0:1789130965.005569:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01ad0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+15:10755:x1876039498232192:12345-192.168.203.11@tcp:101:rm.0 Request processed in 981us (1508us total) trans 4294967305 rc 301/301 00000100:00100000:1.0:1789130965.005578:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 34 00000100:00100000:2.0:1789130965.014718:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789130965.015994:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498232320 00000100:00100000:0.0:1789130965.016011:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498232320 00000100:00100000:0.0:1789130965.016128:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 3 00000100:00100000:0.0:1789130965.016139:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01ad1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+15:10755:x1876039498232320:12345-192.168.203.11@tcp:37:rm.0 00000100:00100000:1.0:1789130965.025652:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01ad1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+15:10755:x1876039498232320:12345-192.168.203.11@tcp:37:rm.0 Request processed in 9492us (10927us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130965.025668:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 3 00000100:00100000:2.0:1789130965.035664:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789130965.035774:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498232576 00000100:00100000:3.0:1789130965.035791:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498232576 00000100:00100000:3.0:1789130965.035865:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 4 00000100:00100000:3.0:1789130965.035881:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dded1d7c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+15:10755:x1876039498232576:12345-192.168.203.11@tcp:35:rm.0 00000100:00100000:3.0:1789130965.037564:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dded1d7c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+16:10755:x1876039498232576:12345-192.168.203.11@tcp:35:rm.0 Request processed in 1672us (1900us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1789130965.037582:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 4 00000100:00100000:2.0:1789130965.046145:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789130965.047997:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498232832 00000100:00100000:1.0:1789130965.048017:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498232832 00000100:00100000:1.0:1789130965.048109:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 35 00000100:00100000:1.0:1789130965.048120:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01ad3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+16:10755:x1876039498232832:12345-192.168.203.11@tcp:101:rm.0 00010000:00010000:1.0:1789130965.048152:0:6501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130965.048177:0:6501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb600/0xf3fe2838e1fc2465 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269941 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130965.048340:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cac00/0xf3fe2838e1fc246c lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130965.048359:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cac00/0xf3fe2838e1fc246c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130965.048373:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cac00/0xf3fe2838e1fc246c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789130965.048387:0:6501:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1789130965.048627:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb600/0xf3fe2838e1fc2465 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269941 expref: 19 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130965.048650:0:6501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cac00/0xf3fe2838e1fc246c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269941 expref: 18 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130965.048671:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff91ddcf5ff700) 00010000:00010000:1.0:1789130965.048674:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789130965.048679:0:6501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dcc85cac00, rc 0) 00000100:00100000:1.0:1789130965.048770:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01ad3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+18:10755:x1876039498232832:12345-192.168.203.11@tcp:101:rm.0 Request processed in 649us (2639us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1789130965.048777:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 35 00000100:00100000:2.0:1789130965.054261:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789130965.054400:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498232960 00000100:00100000:0.0:1789130965.054415:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498232960 00000100:00100000:0.0:1789130965.054666:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 36 00000100:00100000:0.0:1789130965.054678:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01ad12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+18:10755:x1876039498232960:12345-192.168.203.11@tcp:41:rm.0 00000004:00000024:0.0:1789130965.054768:0:6502:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7847059456 avail 7384014848 00000100:00100000:0.0:1789130965.054863:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01ad12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+18:10755:x1876039498232960:12345-192.168.203.11@tcp:41:rm.0 Request processed in 187us (619us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130965.054872:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 36 00000100:00100000:2.0:1789130965.061624:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789130965.061771:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498233088 00000100:00100000:1.0:1789130965.061851:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498233088 00000100:00100000:1.0:1789130965.061975:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 37 00000100:00100000:1.0:1789130965.061989:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01ad1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+18:10755:x1876039498233088:12345-192.168.203.11@tcp:101:rm.0 00010000:00010000:1.0:1789130965.062019:0:6501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130965.062049:0:6501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb600/0xf3fe2838e1fc247a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269948 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130965.062143:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb200/0xf3fe2838e1fc2481 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130965.062162:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb200/0xf3fe2838e1fc2481 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130965.062178:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb200/0xf3fe2838e1fc2481 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130965.062191:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb000/0xf3fe2838e1fc2488 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0xaadd030a bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130965.062210:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb000/0xf3fe2838e1fc2488 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xaadd030a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130965.062241:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb000/0xf3fe2838e1fc2488 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xaadd030a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130965.062351:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb400/0xf3fe2838e1fc248f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130965.062360:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb400/0xf3fe2838e1fc248f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130965.062367:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb400/0xf3fe2838e1fc248f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789130965.062412:0:6501:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2:0x0]: returning size 0 00000004:00200000:1.0:1789130965.062419:0:6501:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789130965.062444:0:6501:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb400/0xf3fe2838e1fc248f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130965.062481:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb400/0xf3fe2838e1fc248f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130965.062493:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb200/0xf3fe2838e1fc2481 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130965.062500:0:6501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb200/0xf3fe2838e1fc2481 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130965.062508:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb200/0xf3fe2838e1fc2481 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130965.062516:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc85cb200 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:1.0:1789130965.062521:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb200/0xf3fe2838e1fc2481 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130965.062536:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb200/0xf3fe2838e1fc2481 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130965.062551:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff91ddcf5ff700) 00010000:00010000:1.0:1789130965.062554:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130965.062560:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb200/0xf3fe2838e1fc2481 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130965.062567:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb200/0xf3fe2838e1fc2481 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130965.062583:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb000/0xf3fe2838e1fc2488 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xaadd030a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130965.062589:0:6501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb000/0xf3fe2838e1fc2488 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xaadd030a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130965.062595:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb000/0xf3fe2838e1fc2488 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xaadd030a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130965.062601:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc85cb000 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:1.0:1789130965.062603:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb000/0xf3fe2838e1fc2488 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xaadd030a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130965.062610:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb000/0xf3fe2838e1fc2488 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xaadd030a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130965.062618:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xaadd030a (ffff91ddff605f00) 00010000:00010000:1.0:1789130965.062621:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130965.062624:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb000/0xf3fe2838e1fc2488 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xaadd030a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130965.062658:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb000/0xf3fe2838e1fc2488 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xaadd030a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130965.062690:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb600/0xf3fe2838e1fc247a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269948 expref: 20 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130965.062704:0:6501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb400/0xf3fe2838e1fc248f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269948 expref: 19 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130965.062712:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff91dded3a2500) 00010000:00010000:1.0:1789130965.062714:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789130965.062718:0:6501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dcc85cb400, rc 0) 00000100:00100000:1.0:1789130965.062814:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01ad1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+19:10755:x1876039498233088:12345-192.168.203.11@tcp:101:rm.0 Request processed in 828us (1209us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130965.062823:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 37 00000100:00100000:2.0:1789130965.073877:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789130965.074182:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498233344 00000100:00100000:1.0:1789130965.074196:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498233344 00000100:00100000:1.0:1789130965.074332:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 38 00000100:00100000:1.0:1789130965.074345:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01ad30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+19:10755:x1876039498233344:12345-192.168.203.11@tcp:36:rm.0 00010000:00010000:1.0:1789130965.074498:0:9769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1789130965.074536:0:9769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb400/0xf3fe2838e1fc248f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269948 expref: 19 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130965.074565:0:9769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca800/0xf3fe2838e1fc243b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d26992c expref: 18 pid: 9769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130965.074594:0:9769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff91dded3a2500) 00010000:00010000:1.0:1789130965.074609:0:9769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5400/0xf3fe2838e1fc2450 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269933 expref: 17 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130965.074618:0:9769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff91ddcf5ff700) 00010000:00010000:1.0:1789130965.074622:0:9769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789130965.074651:0:9769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb600/0xf3fe2838e1fc2496 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130965.074666:0:9769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb600/0xf3fe2838e1fc2496 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130965.074676:0:9769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb600/0xf3fe2838e1fc2496 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130965.074686:0:9769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb000/0xf3fe2838e1fc249d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0xaadd030a bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130965.074693:0:9769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb000/0xf3fe2838e1fc249d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xaadd030a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130965.074711:0:9769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb000/0xf3fe2838e1fc249d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xaadd030a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130965.074832:0:9769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb200/0xf3fe2838e1fc24a4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130965.074842:0:9769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb200/0xf3fe2838e1fc24a4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130965.074859:0:9769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb200/0xf3fe2838e1fc24a4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789130965.075326:0:9769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:1.0:1789130965.075337:0:9769:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 320992877477ns, next at 321992874676ns, rc = 0 00010000:00010000:1.0:1789130965.075403:0:9769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb800/0xf3fe2838e1fc24ab lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130965.075413:0:9769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb800/0xf3fe2838e1fc24ab lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130965.075422:0:9769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb800/0xf3fe2838e1fc24ab lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130965.075430:0:9769:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb800/0xf3fe2838e1fc24ab lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130965.075436:0:9769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb800/0xf3fe2838e1fc24ab lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130965.075442:0:9769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb800/0xf3fe2838e1fc24ab lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130965.075594:0:6489:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789130965.075603:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb800/0xf3fe2838e1fc24ab lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130965.075612:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc85cb800 already unused, calling callback (ffffffffc0c4e550) 00010000:00010000:2.0:1789130965.075616:0:6489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb800/0xf3fe2838e1fc24ab lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130965.075635:0:6489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb800/0xf3fe2838e1fc24ab lrc: 5/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130965.075647:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff91dded3a2500) 00010000:00010000:2.0:1789130965.075650:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789130965.075654:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb800/0xf3fe2838e1fc24ab lrc: 3/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130965.075663:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130965.075665:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130965.075667:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130965.076091:0:9769:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789130965.076099:0:9769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb800/0xf3fe2838e1fc24ab lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130965.076269:0:9769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb200/0xf3fe2838e1fc24a4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130965.076277:0:9769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb200/0xf3fe2838e1fc24a4 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130965.076354:0:9769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb200/0xf3fe2838e1fc24a4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130965.076363:0:9769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc85cb200 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:1.0:1789130965.076367:0:9769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb200/0xf3fe2838e1fc24a4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130965.076431:0:9769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb200/0xf3fe2838e1fc24a4 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130965.076441:0:9769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff91dded3a2500) 00010000:00010000:1.0:1789130965.076444:0:9769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789130965.076448:0:9769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb200/0xf3fe2838e1fc24a4 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130965.076454:0:9769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb200/0xf3fe2838e1fc24a4 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130965.076506:0:9769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb600/0xf3fe2838e1fc2496 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130965.076512:0:9769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb600/0xf3fe2838e1fc2496 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130965.076518:0:9769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb600/0xf3fe2838e1fc2496 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130965.076524:0:9769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc85cb600 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:1.0:1789130965.076527:0:9769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb600/0xf3fe2838e1fc2496 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130965.076544:0:9769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb600/0xf3fe2838e1fc2496 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130965.076554:0:9769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff91ddcf5ff700) 00010000:00010000:1.0:1789130965.076556:0:9769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130965.076560:0:9769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb600/0xf3fe2838e1fc2496 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130965.076566:0:9769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb600/0xf3fe2838e1fc2496 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789130965.076577:0:9769:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000021122f02 reply state 00000000402921bf transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb000/0xf3fe2838e1fc249d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xaadd030a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130965.076591:0:9769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb000/0xf3fe2838e1fc249d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xaadd030a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130965.076598:0:9769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xaadd030a (ffff91ddff605f00) 00010000:00010000:1.0:1789130965.076601:0:9769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789130965.076604:0:9769:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789130965.076887:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01ad30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+18:10755:x1876039498233344:12345-192.168.203.11@tcp:36:rm.0 Request processed in 2538us (3018us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1789130965.076898:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 38 00000100:00100000:2.0:1789130965.083047:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789130965.083541:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498233600 00000100:00100000:1.0:1789130965.083556:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498233600 00000100:00100000:1.0:1789130965.083633:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 5 00000100:00100000:1.0:1789130965.083645:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01ad2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+18:10755:x1876039498233600:12345-192.168.203.11@tcp:35:rm.0 00000100:00100000:1.0:1789130965.084299:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01ad2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+19:10755:x1876039498233600:12345-192.168.203.11@tcp:35:rm.0 Request processed in 651us (1262us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1789130965.085528:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 5 00000100:00100000:2.0:1789130965.092395:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789130965.092624:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498233856 00000100:00100000:3.0:1789130965.092638:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498233856 00000100:00100000:3.0:1789130965.092718:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 39 00000100:00100000:3.0:1789130965.092731:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddca0fb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+19:10755:x1876039498233856:12345-192.168.203.11@tcp:36:rm.0 00010000:00010000:3.0:1789130965.092814:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1789130965.092853:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cac00/0xf3fe2838e1fc246c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269941 expref: 19 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130965.092886:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6c00/0xf3fe2838e1fc240a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d26991e expref: 18 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130965.092900:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff91ddcf5ff700) 00010000:00010000:3.0:1789130965.092940:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca200/0xf3fe2838e1fc23cb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269910 expref: 17 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130965.092951:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91ddcf5ff500) 00010000:00010000:3.0:1789130965.092957:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789130965.092988:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5200/0xf3fe2838e1fc24b2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130965.093003:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5200/0xf3fe2838e1fc24b2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130965.093013:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5200/0xf3fe2838e1fc24b2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130965.093026:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5000/0xf3fe2838e1fc24b9 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130965.093032:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5000/0xf3fe2838e1fc24b9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130965.093038:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5000/0xf3fe2838e1fc24b9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130965.093144:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5400/0xf3fe2838e1fc24c0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130965.093152:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5400/0xf3fe2838e1fc24c0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130965.093159:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5400/0xf3fe2838e1fc24c0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789130965.093655:0:6500:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1789130965.093683:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5400/0xf3fe2838e1fc24c0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130965.093692:0:6500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5400/0xf3fe2838e1fc24c0 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130965.093699:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5400/0xf3fe2838e1fc24c0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130965.093707:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddfd0b5400 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:3.0:1789130965.093711:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5400/0xf3fe2838e1fc24c0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130965.093720:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5400/0xf3fe2838e1fc24c0 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130965.093730:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff91dded3a2300) 00010000:00010000:3.0:1789130965.093733:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789130965.093737:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5400/0xf3fe2838e1fc24c0 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130965.093744:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5400/0xf3fe2838e1fc24c0 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130965.093765:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5200/0xf3fe2838e1fc24b2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130965.093771:0:6500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5200/0xf3fe2838e1fc24b2 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130965.093778:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5200/0xf3fe2838e1fc24b2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130965.093782:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddfd0b5200 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:3.0:1789130965.093791:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5200/0xf3fe2838e1fc24b2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130965.093799:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5200/0xf3fe2838e1fc24b2 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130965.093807:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91dded3a2200) 00010000:00010000:3.0:1789130965.093810:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789130965.093813:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5200/0xf3fe2838e1fc24b2 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130965.093819:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5200/0xf3fe2838e1fc24b2 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789130965.093833:0:6500:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000000cb1c895 reply state 0000000012cc9835 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5000/0xf3fe2838e1fc24b9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130965.093846:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5000/0xf3fe2838e1fc24b9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130965.093855:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff91dded3a2700) 00010000:00010000:3.0:1789130965.093857:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789130965.093860:0:6500:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789130965.093961:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddca0fb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+18:10755:x1876039498233856:12345-192.168.203.11@tcp:36:rm.0 Request processed in 1230us (1578us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1789130965.093970:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 39 00000100:00100000:1.0:1789130965.585748:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789130965.585786:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc860b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508813568:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789130965.585902:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130965.586078:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508813568 00000100:00100000:3.0:1789130965.586089:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508813568 00000100:00100000:3.0:1789130965.586156:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1789130965.586171:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff752940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508813568:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789130965.586234:0:6506:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446301696 avail 1300062208 00000100:00100000:3.0:1789130965.586328:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff752940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508813568:12345-0@lo:41:osp-pre-0-1.0 Request processed in 160us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130965.586336:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1789130965.586515:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddca0f8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508813696:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789130965.586555:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130965.586647:0:11069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508813696 00000100:00100000:2.0:1789130965.586652:0:11069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508813696 00000100:00100000:2.0:1789130965.586684:0:11069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1789130965.586692:0:11069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8494780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1876039508813696:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789130965.586713:0:11069:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789130965.586825:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc860b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508813568:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789130965.591901:0:11069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8494780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1876039508813696:12345-0@lo:41:osp-pre-1-0.0 Request processed in 5193us (5329us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130965.592029:0:11069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1789130965.597034:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddca0f8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508813696:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789130965.907389:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789130966.879454:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789130966.879511:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789130966.879549:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789130966.879579:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789130966.879597:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789130966.879615:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498234240 00000100:00100000:2.0:1789130966.879621:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789130966.879625:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498234240 00000100:00100000:2.0:1789130966.879641:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498234368 00000100:00100000:2.0:1789130966.879657:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498234368 00000100:00100000:3.0:1789130966.879675:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498234496 00000100:00100000:3.0:1789130966.879677:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498234496 00000100:00100000:2.0:1789130966.879686:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 94 00000100:00100000:3.0:1789130966.879689:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498234112 00000100:00100000:3.0:1789130966.879691:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498234112 00000100:00100000:2.0:1789130966.879695:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7ad1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+5:2387:x1876039498234368:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1789130966.879701:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498234624 00000100:00100000:3.0:1789130966.879703:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498234624 00000100:00100000:3.0:1789130966.879716:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 245 00000100:00100000:3.0:1789130966.879722:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddca0f8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+5:2387:x1876039498234240:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1789130966.879793:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498233984 00000100:00100000:0.0:1789130966.879797:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498233984 00000100:00100000:0.0:1789130966.879826:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 402 00000100:00100000:0.0:1789130966.879834:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8605c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+13:2387:x1876039498233984:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1789130966.879904:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 246 00000100:00100000:1.0:1789130966.879914:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7ad3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fde8d4a8-44db-4e6b-8249-c1c295e4901d+5:2387:x1876039498234496:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1789130966.879966:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7ad1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+5:2387:x1876039498234368:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 271us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130966.879974:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 94 00000100:00100000:2.0:1789130966.880560:0:6500:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:2.0:1789130966.880570:0:6500:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:2.0:1789130966.880662:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 247 00000100:00100000:2.0:1789130966.880671:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7ad2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+18:2387:x1876039498234112:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1789130966.886622:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddca0f8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+5:2387:x1876039498234240:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 6888us (7099us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130966.886637:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 245 00000100:00100000:3.0:1789130966.886673:0:9769:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1789130966.886685:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 248 00000100:00100000:3.0:1789130966.886698:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7ad21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fde8d4a8-44db-4e6b-8249-c1c295e4901d+5:2387:x1876039498234624:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1789130966.886746:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7ad21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fde8d4a8-44db-4e6b-8249-c1c295e4901d+5:2387:x1876039498234624:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 54us (7123us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130966.886752:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 248 00000100:00080000:3.0:1789130966.886776:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789130966.886782:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789130966.886799:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789130966.890724:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8605c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+13:2387:x1876039498233984:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 10878us (11267us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130966.890737:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 402 00000100:00100000:1.0:1789130966.892599:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7ad3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fde8d4a8-44db-4e6b-8249-c1c295e4901d+5:2387:x1876039498234496:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 12675us (13036us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130966.892614:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 246 00000100:00100000:2.0:1789130966.892896:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7ad2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+18:2387:x1876039498234112:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 12223us (13312us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130966.892904:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 247 00010000:00010000:1.0:1789130966.929790:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1789130967.633643:0:9826:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 323551181619ns, next at 324551179091ns, rc = 0 00000100:00100000:3.0:1789130967.634015:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789130967.634209:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7c7bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508813952:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789130967.634282:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130967.634432:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc86083c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508813824:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789130967.634492:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130967.634832:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508813952 00000100:00100000:1.0:1789130967.634840:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508813952 00000100:00100000:1.0:1789130967.634883:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508813824 00000100:00100000:1.0:1789130967.634886:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508813824 00000100:00100000:1.0:1789130967.634905:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789130967.634913:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff750f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508813952:12345-0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1789130967.638031:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:1.0:1789130967.642063:0:8419:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789130967.642163:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff750f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508813952:12345-0@lo:13:osp-pre-1-1.0 Request processed in 7246us (7876us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130967.642173:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789130967.642217:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789130967.642230:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7c7a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1876039508813824:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789130967.642252:0:8419:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789130967.642286:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7c7a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1876039508813824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (7794us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130967.642293:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789130967.644659:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7ffed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1876039508814336:0@lo:400:kworker.0 00000100:00100000:1.0:1789130967.644738:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130967.644783:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddca228000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3626:1876039508814848:0@lo:400:kworker.0 00000100:00100000:1.0:1789130967.644811:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130967.644832:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc6d66940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3626:1876039508815360:0@lo:400:kworker.0 00000100:00100000:1.0:1789130967.644856:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130967.644880:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1789130967.644888:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc845cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3626:1876039508814208:0@lo:400:kworker.0 00000100:00100000:1.0:1789130967.644910:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130967.645520:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508814336 00000100:00100000:3.0:1789130967.645529:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508814336 00000100:00100000:3.0:1789130967.645580:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1789130967.645590:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff7503c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1876039508814336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130967.645648:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff7503c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1876039508814336:12345-0@lo:400:kworker.0 Request processed in 60us (910us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130967.645655:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1789130967.645733:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddca22ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3626:1876039508814720:0@lo:400:kworker.0 00000100:00100000:1.0:1789130967.645762:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130967.645844:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7ffc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3627:1876039508814464:0@lo:400:kworker.0 00010000:00080000:0.0:1789130967.649960:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc86083c0 x1876039508813824/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789130983 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789130967.649988:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc86083c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508813824:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789130967.659536:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc5fe83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3626:1876039508815232:0@lo:400:kworker.0 00000100:00100000:1.0:1789130967.659599:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130967.661489:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508814848 00000100:00100000:3.0:1789130967.661502:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508814848 00000100:00080000:3.0:1789130967.661578:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789130967.661620:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508815360 00000100:00100000:3.0:1789130967.661625:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508815360 00000100:00080000:3.0:1789130967.661639:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789130967.661651:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508814208 00000100:00100000:3.0:1789130967.661654:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508814208 00000100:00100000:3.0:1789130967.661663:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508814720 00000100:00100000:3.0:1789130967.661666:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508814720 00000100:00080000:3.0:1789130967.661676:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789130967.661692:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1789130967.661701:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc843f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1876039508814848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130967.661785:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc843f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1876039508814848:12345-0@lo:400:kworker.0 Request processed in 84us (16972us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130967.661792:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1789130967.661811:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1789130967.661818:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc843d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1876039508815360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130967.661861:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc843d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1876039508815360:12345-0@lo:400:kworker.0 Request processed in 44us (17004us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130967.661868:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1789130967.661879:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1789130967.661886:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc843c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1876039508814208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130967.661915:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc843c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1876039508814208:12345-0@lo:400:kworker.0 Request processed in 30us (17004us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130967.661933:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1789130967.661944:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1789130967.661950:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc843cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1876039508814720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130967.661977:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc843cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1876039508814720:12345-0@lo:400:kworker.0 Request processed in 28us (16215us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130967.661983:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1789130967.664542:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc845f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3628:1876039508814080:0@lo:400:kworker.0 00000100:00100000:3.0:1789130967.664613:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130967.664671:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7ffcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1876039508814592:0@lo:400:kworker.0 00000100:00100000:3.0:1789130967.664702:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130967.664728:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddca229a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1876039508815104:0@lo:400:kworker.0 00000100:00100000:3.0:1789130967.664752:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130967.664907:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508814080 00000100:00100000:1.0:1789130967.664915:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508814080 00000100:00100000:1.0:1789130967.665106:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 403 00000100:00100000:1.0:1789130967.665117:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8603850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+24:3628:x1876039508814080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130967.665168:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8603850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+24:3628:x1876039508814080:12345-0@lo:400:kworker.0 Request processed in 53us (554us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130967.665176:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 403 00000100:00100000:1.0:1789130967.665223:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508815232 00000100:00100000:1.0:1789130967.665236:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508815232 00000100:00100000:1.0:1789130967.665272:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1789130967.665279:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddfd0670c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1876039508815232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130967.665313:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddfd0670c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1876039508815232:12345-0@lo:400:kworker.0 Request processed in 35us (5715us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130967.665319:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1789130967.665346:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130967.665374:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddca229680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508814976:0@lo:400:kworker.0 00000100:00100000:1.0:1789130967.666091:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1789130967.666139:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc7c7bc00 x1876039508813952/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789130983 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789130967.666160:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7c7bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508813952:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789130967.666209:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508815104 00000100:00100000:1.0:1789130967.666213:0:9827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508815104 00000100:00100000:1.0:1789130967.666242:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508814976 00000100:00100000:1.0:1789130967.666245:0:9827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508814976 00000100:00100000:1.0:1789130967.666265:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1789130967.666270:0:9827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7c783c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3628:x1876039508815104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130967.666305:0:9827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7c783c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3628:x1876039508815104:12345-0@lo:400:kworker.0 Request processed in 35us (1553us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130967.666312:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1789130967.666323:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1789130967.666329:0:9827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddfd067840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508814976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130967.666359:0:9827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddfd067840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508814976:12345-0@lo:400:kworker.0 Request processed in 31us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130967.666365:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789130967.666600:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508814592 00000100:00100000:3.0:1789130967.666604:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508814592 00000100:00100000:3.0:1789130967.666630:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1789130967.666636:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7c792c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3628:x1876039508814592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130967.666678:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7c792c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3628:x1876039508814592:12345-0@lo:400:kworker.0 Request processed in 42us (1976us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130967.666691:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1789130967.666745:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508814464 00000100:00100000:1.0:1789130967.666750:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508814464 00000100:00100000:1.0:1789130967.666823:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1789130967.666829:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddfd067480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1876039508814464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130967.666863:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddfd067480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1876039508814464:12345-0@lo:400:kworker.0 Request processed in 34us (1515us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130967.666869:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1789130967.671895:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7ffc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3627:1876039508814464:0@lo:400:kworker.0 00010000:00080000:1.0:1789130967.671915:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91ddca229680 x1876039508814976/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789130983 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789130967.671995:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddca229680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508814976:0@lo:400:kworker.0 00000100:00100000:1.0:1789130967.672171:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc845f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3628:1876039508814080:0@lo:400:kworker.0 00000100:00100000:1.0:1789130967.672194:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7ffcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1876039508814592:0@lo:400:kworker.0 00010000:00080000:1.0:1789130967.672208:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91ddca229a40 x1876039508815104/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789130983 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789130967.672217:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddca229a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1876039508815104:0@lo:400:kworker.0 00000100:00080000:1.0:1789130967.672239:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789130967.672245:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789130967.672269:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc5fe83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3626:1876039508815232:0@lo:400:kworker.0 00000100:00100000:1.0:1789130967.672281:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7ffed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1876039508814336:0@lo:400:kworker.0 00010000:00080000:1.0:1789130967.672292:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91ddca228000 x1876039508814848/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130983 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789130967.672301:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddca228000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3626:1876039508814848:0@lo:400:kworker.0 00010000:00080000:1.0:1789130967.672325:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc6d66940 x1876039508815360/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130983 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789130967.672334:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc6d66940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3626:1876039508815360:0@lo:400:kworker.0 00000100:00100000:1.0:1789130967.672360:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc845cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3626:1876039508814208:0@lo:400:kworker.0 00000100:00100000:1.0:1789130967.672370:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddca22ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3626:1876039508814720:0@lo:400:kworker.0 00010000:00010000:2.0:1789130967.953835:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789130968.145761:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc86083c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1876039508815488:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789130968.145833:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130968.145990:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508815488 00000100:00100000:0.0:1789130968.145998:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508815488 00000100:00100000:0.0:1789130968.146045:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789130968.146054:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddfd066d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1876039508815488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789130968.146083:0:8419:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789130968.146138:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddfd066d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1876039508815488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130968.146146:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00010000:00080000:1.0:1789130968.146226:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc86083c0 x1876039508815488/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789130984 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789130968.146246:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc86083c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1876039508815488:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789130968.664119:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7c7bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1876039508815616:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789130968.664198:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130968.664304:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508815616 00000100:00100000:0.0:1789130968.664312:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508815616 00000100:00100000:0.0:1789130968.664364:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789130968.664373:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddfd066580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1876039508815616:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789130968.664393:0:8419:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789130968.665088:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddfd066580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1876039508815616:12345-0@lo:13:osp-pre-0-1.0 Request processed in 713us (888us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130968.665097:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00010000:00080000:1.0:1789130968.665172:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc7c7bc00 x1876039508815616/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789130984 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789130968.665198:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7c7bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1876039508815616:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1789130968.980615:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789130969.256998:0:14359:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:3.0:1789130970.001911:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789130970.263713:0:14408:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe7d674360 20000000:00000080:1.0:1789130970.263737:0:14408:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff91dcc85b8400 uarg=0000000000000000 20000000:01000000:1.0:1789130970.263796:0:14408:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1789130970.263805:0:14408:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1789130970.263812:0:14408:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:0.0:1789130970.265044:0:14409:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 20000000:02000000:1.0:1789130970.265267:0:14408:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:1.0:1789130970.272160:0:14408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].13, 224 off10720 00000040:00080000:1.0:1789130970.272229:0:14408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].14, 128 off10848 00000040:00080000:1.0:1789130970.274613:0:14408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].15, 224 off11072 10000000:01000000:1.0:1789130970.274769:0:14408:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1789130970.274798:0:14408:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91dcc85ca600/0xf3fe2838e1fc24c7 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130970.274824:0:14408:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91dde19aa800/0xf3fe2838e1fc2354 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d2698fb expref: 12 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130970.274834:0:14408:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91ddfd0b4200/0xf3fe2838e1fc235b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269902 expref: 12 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130970.274843:0:14408:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91ddfd0b4600/0xf3fe2838e1fc2369 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc2362 expref: 23 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130970.274850:0:14408:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91dcc7f7f200/0xf3fe2838e1fc2377 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc2370 expref: 23 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130970.274857:0:14408:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91dcc7f7f400/0xf3fe2838e1fc2385 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc237e expref: 23 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130970.274862:0:14408:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91dde19ab000/0xf3fe2838e1fc2393 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc238c expref: 23 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130970.274869:0:14408:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91dcc85ca600/0xf3fe2838e1fc24c7 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130970.274919:0:14408:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91dde19ab000/0xf3fe2838e1fc2393 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf3fe2838e1fc238c expref: 23 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130970.274935:0:14408:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91dde19ab000/0xf3fe2838e1fc2393 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf3fe2838e1fc238c expref: 23 pid: 6493 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130970.274964:0:14408:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddfd0643c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14408:1876039508815744:0@lo:104: 00000100:00100000:1.0:1789130970.275049:0:14408:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789130970.275182:0:14408:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91dcc7f7f400/0xf3fe2838e1fc2385 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf3fe2838e1fc237e expref: 23 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130970.275191:0:14408:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91dcc7f7f400/0xf3fe2838e1fc2385 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf3fe2838e1fc237e expref: 23 pid: 6494 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130970.275200:0:14408:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddfd066940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14408:1876039508815872:0@lo:104: 00000100:00100000:1.0:1789130970.275225:0:14408:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789130970.275311:0:14408:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91dcc7f7f200/0xf3fe2838e1fc2377 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf3fe2838e1fc2370 expref: 23 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130970.275320:0:14408:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91dcc7f7f200/0xf3fe2838e1fc2377 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf3fe2838e1fc2370 expref: 23 pid: 6494 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130970.275329:0:14408:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddfd064000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14408:1876039508816000:0@lo:104: 00000100:00100000:1.0:1789130970.275353:0:14408:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130970.275539:0:9504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508815744 00000100:00100000:2.0:1789130970.275550:0:9504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508815744 00010000:00010000:1.0:1789130970.275860:0:14408:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91ddfd0b4600/0xf3fe2838e1fc2369 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf3fe2838e1fc2362 expref: 23 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130970.275870:0:14408:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91ddfd0b4600/0xf3fe2838e1fc2369 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf3fe2838e1fc2362 expref: 23 pid: 6493 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130970.275880:0:14408:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddfd065a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14408:1876039508816128:0@lo:104: 00000100:00100000:1.0:1789130970.275910:0:14408:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789130970.275940:0:14408:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91ddfd0b4200/0xf3fe2838e1fc235b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269902 expref: 12 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130970.275967:0:14408:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91ddfd0b4200/0xf3fe2838e1fc235b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269902 expref: 12 pid: 6493 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130970.275978:0:14408:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc5fe83c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14408:1876039508816256:192.168.203.11@tcp:104: 00010000:00010000:1.0:1789130970.276049:0:14408:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91dde19aa800/0xf3fe2838e1fc2354 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d2698fb expref: 12 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130970.276057:0:14408:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91dde19aa800/0xf3fe2838e1fc2354 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d2698fb expref: 12 pid: 6492 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130970.276066:0:14408:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc845cf00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14408:1876039508816384:192.168.203.11@tcp:104: 00000100:00100000:1.0:1789130970.276089:0:14408:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddd2f37840 going to sleep for 11 seconds 00000100:00100000:2.0:1789130970.276152:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508815872 00000100:00100000:2.0:1789130970.276157:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508815872 00000100:00100000:2.0:1789130970.276210:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508816000 00000100:00100000:2.0:1789130970.276214:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508816000 00000100:00100000:2.0:1789130970.276226:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508816128 00000100:00100000:2.0:1789130970.276229:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508816128 00000100:00100000:2.0:1789130970.276244:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789130970.276253:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddfd067c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+6:14408:x1876039508815872:12345-0@lo:104: 00010000:00010000:2.0:1789130970.276269:0:6484:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7f000/0xf3fe2838e1fc237e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3fe2838e1fc2385 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130970.276341:0:6484:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789130970.276354:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddfd067c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+6:14408:x1876039508815872:12345-0@lo:104: Request processed in 102us (1128us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130970.276362:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789130970.276393:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789130970.276399:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddfd0652c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+5:14408:x1876039508816000:12345-0@lo:104: 00010000:00010000:2.0:1789130970.276407:0:6484:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff91dde19aa600/0xf3fe2838e1fc2370 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3fe2838e1fc2377 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130970.276443:0:6484:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789130970.276448:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddfd0652c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+5:14408:x1876039508816000:12345-0@lo:104: Request processed in 49us (1094us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130970.276454:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789130970.276499:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789130970.276506:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddfd064780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+4:14408:x1876039508816128:12345-0@lo:104: 00010000:00010000:2.0:1789130970.276514:0:6484:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff91ddfa939600/0xf3fe2838e1fc2362 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3fe2838e1fc2369 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130970.276547:0:6484:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1789130970.276552:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddfd064780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+4:14408:x1876039508816128:12345-0@lo:104: Request processed in 47us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130970.276558:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00010000:2.0:1789130970.276576:0:6489:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789130970.276582:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7f000/0xf3fe2838e1fc237e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3fe2838e1fc2385 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130970.276590:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc7f7f000 already unused, calling callback (ffffffffc124bc20) 10000000:00010000:2.0:1789130970.276595:0:6489:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7f000/0xf3fe2838e1fc237e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xf3fe2838e1fc2385 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130970.276616:0:6489:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7f000/0xf3fe2838e1fc237e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xf3fe2838e1fc2385 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789130970.276624:0:6489:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7f000/0xf3fe2838e1fc237e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xf3fe2838e1fc2385 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789130970.276630:0:6489:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:3.0:1789130970.276754:0:9504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789130970.276763:0:9504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddfd065e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+3:14408:x1876039508815744:12345-0@lo:104: 00010000:00010000:3.0:1789130970.276773:0:9504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff91ddfa938c00/0xf3fe2838e1fc238c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3fe2838e1fc2393 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130970.276813:0:9504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1789130970.276819:0:9504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddfd065e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+3:14408:x1876039508815744:12345-0@lo:104: Request processed in 58us (1771us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130970.276826:0:9504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00010000:2.0:1789130970.276843:0:6489:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7f000/0xf3fe2838e1fc237e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc2385 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130970.276852:0:6489:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789130970.276881:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7f000/0xf3fe2838e1fc237e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc2385 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130970.276888:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7f000/0xf3fe2838e1fc237e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc2385 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130970.276905:0:6489:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789130970.276908:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff91dde19aa600/0xf3fe2838e1fc2370 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3fe2838e1fc2377 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130970.276914:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dde19aa600 already unused, calling callback (ffffffffc124bc20) 10000000:00010000:2.0:1789130970.276917:0:6489:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff91dde19aa600/0xf3fe2838e1fc2370 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf3fe2838e1fc2377 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130970.276924:0:6489:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff91dde19aa600/0xf3fe2838e1fc2370 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf3fe2838e1fc2377 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789130970.276931:0:6489:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff91dde19aa600/0xf3fe2838e1fc2370 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf3fe2838e1fc2377 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789130970.276943:0:6489:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789130970.276964:0:6489:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff91dde19aa600/0xf3fe2838e1fc2370 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc2377 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130970.276970:0:6489:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000004:00080000:3.0:1789130970.276974:0:6479:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00010000:00010000:2.0:1789130970.276978:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff91dde19aa600/0xf3fe2838e1fc2370 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc2377 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130970.276986:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff91dde19aa600/0xf3fe2838e1fc2370 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc2377 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130970.276996:0:6489:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789130970.276999:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff91ddfa939600/0xf3fe2838e1fc2362 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3fe2838e1fc2369 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130970.277005:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddfa939600 already unused, calling callback (ffffffffc124bc20) 10000000:00010000:2.0:1789130970.277009:0:6489:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff91ddfa939600/0xf3fe2838e1fc2362 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf3fe2838e1fc2369 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789130970.277010:0:6479:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00010000:00010000:2.0:1789130970.277020:0:6489:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff91ddfa939600/0xf3fe2838e1fc2362 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf3fe2838e1fc2369 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789130970.277025:0:6479:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 10000000:00010000:2.0:1789130970.277027:0:6489:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff91ddfa939600/0xf3fe2838e1fc2362 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf3fe2838e1fc2369 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789130970.277035:0:6489:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789130970.277052:0:6489:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff91ddfa939600/0xf3fe2838e1fc2362 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc2369 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130970.277059:0:6489:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789130970.277086:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff91ddfa939600/0xf3fe2838e1fc2362 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc2369 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130970.277093:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff91ddfa939600/0xf3fe2838e1fc2362 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc2369 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130970.277107:0:6489:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1789130970.277109:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc6d66940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3627:1876039508816768:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789130970.277112:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff91ddfa938c00/0xf3fe2838e1fc238c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3fe2838e1fc2393 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130970.277122:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddfa938c00 already unused, calling callback (ffffffffc124bc20) 10000000:00010000:2.0:1789130970.277126:0:6489:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff91ddfa938c00/0xf3fe2838e1fc238c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf3fe2838e1fc2393 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130970.277133:0:6489:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff91ddfa938c00/0xf3fe2838e1fc238c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf3fe2838e1fc2393 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789130970.277140:0:6489:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff91ddfa938c00/0xf3fe2838e1fc238c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf3fe2838e1fc2393 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789130970.277145:0:6489:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:3.0:1789130970.277153:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789130970.277178:0:6489:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff91ddfa938c00/0xf3fe2838e1fc238c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc2393 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130970.277186:0:6489:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789130970.277195:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff91ddfa938c00/0xf3fe2838e1fc238c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc2393 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130970.277201:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff91ddfa938c00/0xf3fe2838e1fc238c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc2393 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130970.277206:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789130970.277217:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7b25e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3627:1876039508816896:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789130970.277222:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130970.277232:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130970.277234:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130970.277243:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789130970.277251:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130970.277257:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc6d64f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3626:1876039508816640:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789130970.277290:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508816768 00000100:00100000:2.0:1789130970.277296:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130970.277298:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508816768 00000100:00100000:2.0:1789130970.277324:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:3.0:1789130970.277326:0:6486:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91ddfd0b4600/0xf3fe2838e1fc2369 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3fe2838e1fc2362 expref: 24 pid: 6493 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130970.277332:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc6d67840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3626:1876039508816512:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789130970.277361:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130970.277362:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508816896 00000100:00100000:3.0:1789130970.277367:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508816896 00010000:00010000:3.0:1789130970.277384:0:6486:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91dde19ab000/0xf3fe2838e1fc2393 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3fe2838e1fc238c expref: 25 pid: 6493 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130970.277388:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cbe00/0xf3fe2838e1fc241f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xaadd030a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130970.277405:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cbe00/0xf3fe2838e1fc241f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xaadd030a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130970.277414:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cbe00/0xf3fe2838e1fc241f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xaadd030a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130970.277418:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508816640 00010000:00010000:2.0:1789130970.277421:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc85cbe00 already unused, calling callback (ffffffffc185c4f0) 00000100:00100000:3.0:1789130970.277424:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508816640 00010000:00010000:2.0:1789130970.277429:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cbe00/0xf3fe2838e1fc241f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xaadd030a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130970.277440:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cbe00/0xf3fe2838e1fc241f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xaadd030a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130970.277441:0:6486:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91dcc7f7f200/0xf3fe2838e1fc2377 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3fe2838e1fc2370 expref: 26 pid: 6494 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130970.277490:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508816512 00000100:00100000:3.0:1789130970.277493:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508816512 00010000:00010000:3.0:1789130970.277505:0:6486:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91dcc7f7f400/0xf3fe2838e1fc2385 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3fe2838e1fc237e expref: 27 pid: 6494 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130970.277518:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789130970.277525:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc850a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+27:3627:x1876039508816768:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789130970.277537:0:6486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789130970.277542:0:6486:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91ddfd0b4600/0xf3fe2838e1fc2369 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3fe2838e1fc2362 expref: 27 pid: 6493 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130970.277552:0:6486:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91ddfd0b4600/0xf3fe2838e1fc2369 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf3fe2838e1fc2362 expref: 27 pid: 6493 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130970.277570:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xaadd030a (ffff91ddff605f00) 00010000:00010000:3.0:1789130970.277574:0:6486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789130970.277575:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130970.277582:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cbe00/0xf3fe2838e1fc241f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xaadd030a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130970.277588:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cbe00/0xf3fe2838e1fc241f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xaadd030a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130970.277614:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc850a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+27:3627:x1876039508816768:12345-0@lo:103:ldlm_bl.0 Request processed in 88us (461us total) trans 0 rc 0/0 00010000:00010000:2.0:1789130970.277620:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4c00/0xf3fe2838e1fc2434 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130970.277635:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00010000:2.0:1789130970.277635:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4c00/0xf3fe2838e1fc2434 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130970.277653:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4c00/0xf3fe2838e1fc2434 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130970.277655:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00010000:00010000:2.0:1789130970.277665:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddfd0b4c00 already unused, calling callback (ffffffffc185c4f0) 00000100:00100000:3.0:1789130970.277666:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc33aec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+26:3627:x1876039508816896:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789130970.277676:0:6486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789130970.277680:0:6486:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91dde19ab000/0xf3fe2838e1fc2393 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3fe2838e1fc238c expref: 26 pid: 6493 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130970.277700:0:6486:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91dde19ab000/0xf3fe2838e1fc2393 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf3fe2838e1fc238c expref: 26 pid: 6493 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130970.277710:0:6486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789130970.277732:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc33aec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+26:3627:x1876039508816896:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130970.277738:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789130970.277781:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789130970.277787:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7b24b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+25:3626:x1876039508816640:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789130970.277795:0:6486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789130970.277800:0:6486:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91dcc7f7f200/0xf3fe2838e1fc2377 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3fe2838e1fc2370 expref: 25 pid: 6494 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130970.277807:0:6486:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91dcc7f7f200/0xf3fe2838e1fc2377 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf3fe2838e1fc2370 expref: 25 pid: 6494 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130970.277817:0:6486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789130970.277849:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7b24b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+25:3626:x1876039508816640:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130970.277856:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789130970.277872:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789130970.277879:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7b27c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+24:3626:x1876039508816512:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789130970.277887:0:6486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789130970.277893:0:6486:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91dcc7f7f400/0xf3fe2838e1fc2385 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3fe2838e1fc237e expref: 24 pid: 6494 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130970.277905:0:6486:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91dcc7f7f400/0xf3fe2838e1fc2385 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf3fe2838e1fc237e expref: 24 pid: 6494 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130970.277923:0:6486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789130970.277952:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7b27c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+24:3626:x1876039508816512:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130970.277961:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789130970.278006:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7b25e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3627:1876039508816896:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789130970.278021:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc6d66940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3627:1876039508816768:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789130970.278047:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789130970.278056:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91dde19ab000/0xf3fe2838e1fc2393 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf3fe2838e1fc238c expref: 23 pid: 6493 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130970.278065:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc845f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508817024:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789130970.278074:0:14408:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddfd0643c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14408:1876039508815744:0@lo:104: 00010000:00010000:1.0:1789130970.278090:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91dcc7f7f400/0xf3fe2838e1fc2385 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf3fe2838e1fc237e expref: 22 pid: 6494 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130970.278099:0:14408:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddfd066940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14408:1876039508815872:0@lo:104: 00000100:00100000:0.0:1789130970.278105:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789130970.278113:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91dcc7f7f200/0xf3fe2838e1fc2377 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf3fe2838e1fc2370 expref: 21 pid: 6494 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130970.278122:0:14408:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddfd064000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14408:1876039508816000:0@lo:104: 00010000:00010000:2.0:1789130970.278143:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4c00/0xf3fe2838e1fc2434 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130970.278153:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4c00/0xf3fe2838e1fc2434 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130970.278171:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff91dded3a2500) 00010000:00010000:2.0:1789130970.278174:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130970.278178:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4c00/0xf3fe2838e1fc2434 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130970.278185:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4c00/0xf3fe2838e1fc2434 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130970.278205:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb000/0xf3fe2838e1fc249d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xaadd030a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130970.278211:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb000/0xf3fe2838e1fc249d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xaadd030a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130970.278217:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb000/0xf3fe2838e1fc249d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xaadd030a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130970.278229:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc85cb000 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:2.0:1789130970.278233:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb000/0xf3fe2838e1fc249d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xaadd030a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130970.278239:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb000/0xf3fe2838e1fc249d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xaadd030a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130970.278249:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xaadd030a (ffff91ddff605f00) 00010000:00010000:2.0:1789130970.278252:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130970.278255:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb000/0xf3fe2838e1fc249d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xaadd030a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130970.278261:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb000/0xf3fe2838e1fc249d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xaadd030a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130970.278277:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5000/0xf3fe2838e1fc24b9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130970.278289:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5000/0xf3fe2838e1fc24b9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130970.278295:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5000/0xf3fe2838e1fc24b9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130970.278300:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddfd0b5000 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:2.0:1789130970.278303:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5000/0xf3fe2838e1fc24b9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130970.278309:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5000/0xf3fe2838e1fc24b9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130970.278328:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff91dded3a2700) 00010000:00010000:2.0:1789130970.278330:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789130970.278333:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5000/0xf3fe2838e1fc24b9 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130970.278339:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5000/0xf3fe2838e1fc24b9 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130970.278652:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91ddfd0b4600/0xf3fe2838e1fc2369 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf3fe2838e1fc2362 expref: 20 pid: 6493 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130970.278682:0:14408:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddfd065a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14408:1876039508816128:0@lo:104: 00000100:00100000:3.0:1789130970.278723:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508817024 00000100:00100000:3.0:1789130970.278730:0:9827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508817024 00000100:00100000:3.0:1789130970.278789:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789130970.278797:0:9827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc860a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3625:x1876039508817024:12345-0@lo:6:osp-syn-1-0.0 00000100:00080000:1.0:1789130970.278822:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00080000:3.0:1789130970.278827:0:9827:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2 count 1 00000100:00100000:2.0:1789130970.278861:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc6d67840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3626:1876039508816512:0@lo:103:ldlm_bl.0 00002000:00010000:3.0:1789130970.278867:0:9827:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 0, mtime: 0x6aa3f8d4, atime: 0x6aa3f8d4, ctime: 0x6aa3f8d4, blocks: 0x0 00000100:00100000:2.0:1789130970.278873:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc6d64f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3626:1876039508816640:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789130970.278878:0:9827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4c05e0e/0xf3fe2838e1fc24ce lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130970.278896:0:9827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=326s v=(0 0) 00010000:00010000:3.0:1789130970.278901:0:9827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789130970.278910:0:9827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4c05e0e/0xf3fe2838e1fc24ce lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130970.278930:0:9827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b4c05e0e/0xf3fe2838e1fc24ce lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130970.278938:0:9827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4c05e0e/0xf3fe2838e1fc24ce lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130970.278959:0:9827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b4c05e0e/0xf3fe2838e1fc24ce lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130970.278985:0:9827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789130970.279189:0:9827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc860a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3625:x1876039508817024:12345-0@lo:6:osp-syn-1-0.0 Request processed in 391us (1084us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1789130970.279198:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:2.0:1789130970.279330:0:6489:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789130970.279339:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b4c05e0e/0xf3fe2838e1fc24ce lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130970.279348:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddfd0b5400 already unused, calling callback (ffffffffc0c4e550) 00010000:00010000:2.0:1789130970.279353:0:6489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4c05e0e/0xf3fe2838e1fc24ce lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130970.279361:0:6489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4c05e0e/0xf3fe2838e1fc24ce lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130970.279376:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b4c05e0e/0xf3fe2838e1fc24ce lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130970.279383:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4c05e0e/0xf3fe2838e1fc24ce lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130970.279412:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130970.279414:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130970.279415:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1789130970.279511:0:3625:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff91dcc845f0c0/2, rc 0, transno 4294967301 00000100:00100000:0.0:1789130970.279518:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc845f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508817024:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789130970.280510:0:14408:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc5fe83c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14408:1876039508816256:192.168.203.11@tcp:104: 00000100:00100000:1.0:1789130970.280647:0:14408:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc845cf00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14408:1876039508816384:192.168.203.11@tcp:104: 00000100:00100000:3.0:1789130970.280788:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00010000:00010000:1.0:1789130970.280843:0:14408:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91dcc85ca600/0xf3fe2838e1fc24c7 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130970.280883:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498234752 00000100:00100000:2.0:1789130970.280892:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498234752 00010000:00010000:2.0:1789130970.280929:0:6486:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91ddfd0b4200/0xf3fe2838e1fc235b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269902 expref: 13 pid: 6493 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130970.281004:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 62 00000100:00100000:2.0:1789130970.281014:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc850a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+13:2387:x1876039498234752:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789130970.281030:0:6486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789130970.281036:0:6486:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91ddfd0b4200/0xf3fe2838e1fc235b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269902 expref: 13 pid: 6493 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130970.281047:0:6486:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91ddfd0b4200/0xf3fe2838e1fc235b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269902 expref: 13 pid: 6493 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130970.281065:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91ddfd0b4200/0xf3fe2838e1fc235b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269902 expref: 13 pid: 6493 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130970.281080:0:6486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789130970.281142:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc850a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+12:2387:x1876039498234752:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 129us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130970.281150:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 62 00000100:00100000:0.0:1789130970.282988:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789130970.283060:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498234880 00000100:00100000:2.0:1789130970.283069:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498234880 00010000:00010000:2.0:1789130970.283105:0:6485:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91dde19aa800/0xf3fe2838e1fc2354 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d2698fb expref: 12 pid: 6492 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130970.283184:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 63 00000100:00100000:2.0:1789130970.283195:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8609a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+12:2387:x1876039498234880:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789130970.283210:0:6485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789130970.283216:0:6485:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91dde19aa800/0xf3fe2838e1fc2354 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d2698fb expref: 12 pid: 6492 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130970.283229:0:6485:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91dde19aa800/0xf3fe2838e1fc2354 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d2698fb expref: 12 pid: 6492 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130970.283248:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91dde19aa800/0xf3fe2838e1fc2354 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d2698fb expref: 12 pid: 6492 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130970.283375:0:6485:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91dcc85ca600/0xf3fe2838e1fc24c7 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130970.283386:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91dcc85ca600/0xf3fe2838e1fc24c7 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130970.283407:0:6485:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91dcc85ca600/0xf3fe2838e1fc24c7 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130970.283415:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91dcc85ca600/0xf3fe2838e1fc24c7 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130970.283421:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91dcc85ca600/0xf3fe2838e1fc24c7 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130970.283429:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91dcc85ca600/0xf3fe2838e1fc24c7 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130970.283445:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc85ca600 already unused, calling callback (ffffffffc0c4e550) 00010000:00010000:2.0:1789130970.283450:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91dcc85ca600/0xf3fe2838e1fc24c7 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130970.283665:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91dcc85ca600/0xf3fe2838e1fc24c7 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130970.283868:0:14408:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91dcc85ca600/0xf3fe2838e1fc24c7 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130970.283879:0:14408:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91dcc85ca600/0xf3fe2838e1fc24c7 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130970.284579:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91dcc85ca600/0xf3fe2838e1fc24c7 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130970.284603:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91dcc85ca600/0xf3fe2838e1fc24c7 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130970.284629:0:6485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789130970.284731:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8609a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+11:2387:x1876039498234880:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 1532us (1746us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130970.284746:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 63 00000100:00100000:2.0:1789130970.706001:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc860b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1876039508817152:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789130970.706114:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130970.706224:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789130970.706233:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc850b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1876039508817280:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789130970.706265:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130970.706300:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508817152 00000100:00100000:2.0:1789130970.706309:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508817152 00000100:00100000:2.0:1789130970.706367:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508817280 00000100:00100000:2.0:1789130970.706371:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508817280 00000100:00100000:2.0:1789130970.706391:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1789130970.706400:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7b25e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1876039508817152:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789130970.706484:0:6506:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789130970.706546:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7b25e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1876039508817152:12345-0@lo:41:osp-pre-0-1.0 Request processed in 146us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130970.706554:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1789130970.706574:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1789130970.706580:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7c78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3628:x1876039508817280:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789130970.706599:0:6506:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789130970.706632:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7c78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3628:x1876039508817280:12345-0@lo:41:osp-pre-1-0.0 Request processed in 52us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130970.706638:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1789130970.706690:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc850b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1876039508817280:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789130970.706726:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc860b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1876039508817152:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1789130971.026658:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789130971.250686:0:14457:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff96627250 20000000:00000080:0.0:1789130971.250715:0:14457:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff91ddff69f800 uarg=0000000000000000 20000000:01000000:0.0:1789130971.250843:0:14457:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:0.0:1789130971.250852:0:14457:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:0.0:1789130971.250859:0:14457:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0001.hsm_control=enabled del=0 00000040:00080000:1.0:1789130971.252709:0:14458:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 16 count 16 20000000:02000000:0.0:1789130971.253136:0:14457:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0001.hsm_control=enabled in log params 00000040:00080000:0.0:1789130971.253286:0:14457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].16, 224 off11296 00000040:00080000:0.0:1789130971.253324:0:14457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].17, 128 off11424 00000040:00080000:0.0:1789130971.253354:0:14457:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].18, 224 off11648 10000000:01000000:0.0:1789130971.253566:0:14457:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789130971.253603:0:14457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91de01ad7800/0xf3fe2838e1fc24d5 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130971.253625:0:14457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91de01ad7800/0xf3fe2838e1fc24d5 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130971.253638:0:14457:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91de01ad7800/0xf3fe2838e1fc24d5 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130971.253663:0:14457:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91de01ad7800/0xf3fe2838e1fc24d5 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130971.253671:0:14457:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91de01ad7800/0xf3fe2838e1fc24d5 lrc: 3/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130971.253678:0:14457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91de01ad7800/0xf3fe2838e1fc24d5 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130971.253685:0:14457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91de01ad7800 already unused, calling callback (ffffffffc0c4e550) 00010000:00010000:0.0:1789130971.253690:0:14457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91de01ad7800/0xf3fe2838e1fc24d5 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130971.253698:0:14457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91de01ad7800/0xf3fe2838e1fc24d5 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130971.253712:0:14457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91de01ad7800/0xf3fe2838e1fc24d5 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130971.253720:0:14457:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91de01ad7800/0xf3fe2838e1fc24d5 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130971.253727:0:14457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91de01ad7800/0xf3fe2838e1fc24d5 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130971.421813:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789130971.421887:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498235008 00000100:00100000:1.0:1789130971.421899:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498235008 00000100:00100000:1.0:1789130971.421971:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 404 00000100:00100000:1.0:1789130971.421982:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8602c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+11:6161:x1876039498235008:12345-192.168.203.11@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789130971.422005:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130971.422030:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91dcc85cb000/0xf3fe2838e1fc24dc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf8eae2996d26994f expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130971.422063:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91dcc85cb000/0xf3fe2838e1fc24dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d26994f expref: 12 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130971.422075:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91dcc85cb000/0xf3fe2838e1fc24dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d26994f expref: 12 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130971.422111:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dcc85cb000, rc 0) 00000100:00100000:1.0:1789130971.422200:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8602c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+12:6161:x1876039498235008:12345-192.168.203.11@tcp:101:ll_cfg_requeue.0 Request processed in 219us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130971.422207:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 404 00000100:00100000:3.0:1789130971.430360:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789130971.430515:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498235136 00000100:00100000:0.0:1789130971.430529:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498235136 00000100:00100000:0.0:1789130971.430597:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 405 00000100:00100000:0.0:1789130971.430610:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8601450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+12:6161:x1876039498235136:12345-192.168.203.11@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789130971.430821:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8601450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+12:6161:x1876039498235136:12345-192.168.203.11@tcp:501:ll_cfg_requeue.0 Request processed in 213us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130971.430830:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 405 00000100:00100000:0.0:1789130971.434193:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789130971.434390:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498235264 00000100:00100000:2.0:1789130971.434403:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498235264 00000100:00100000:2.0:1789130971.434522:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 406 00000100:00100000:2.0:1789130971.434533:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8600450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+12:6161:x1876039498235264:12345-192.168.203.11@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789130971.434711:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8600450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+12:6161:x1876039498235264:12345-192.168.203.11@tcp:503:ll_cfg_requeue.0 Request processed in 179us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130971.434721:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 406 00000100:00100000:0.0:1789130971.439325:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789130971.439488:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498235392 00000100:00100000:1.0:1789130971.439500:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498235392 00000100:00100000:0.0:1789130971.439803:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 407 00000100:00100000:0.0:1789130971.439819:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8603c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+12:11040:x1876039498235392:12345-192.168.203.11@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789130971.440021:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8603c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+12:11040:x1876039498235392:12345-192.168.203.11@tcp:502:llog_process_th.0 Request processed in 205us (709us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130971.440030:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 407 00000100:00100000:2.0:1789130971.449806:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789130971.449879:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498235520 00000100:00100000:0.0:1789130971.449892:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498235520 00000100:00100000:0.0:1789130971.450001:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 408 00000100:00100000:0.0:1789130971.450013:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8601850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+12:11040:x1876039498235520:12345-192.168.203.11@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789130971.450381:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8601850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+12:11040:x1876039498235520:12345-192.168.203.11@tcp:502:llog_process_th.0 Request processed in 370us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130971.450391:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 408 00000100:00100000:1.0:1789130971.458569:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789130971.459047:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498235648 00000100:00100000:0.0:1789130971.459060:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498235648 00000100:00100000:0.0:1789130971.459140:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 409 00000100:00100000:0.0:1789130971.459163:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8600850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+12:6161:x1876039498235648:12345-192.168.203.11@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789130971.459187:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130971.459212:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91de01ad6c00/0xf3fe2838e1fc24e3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269956 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130971.459268:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91de01ad6c00/0xf3fe2838e1fc24e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269956 expref: 13 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130971.459282:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91de01ad6c00/0xf3fe2838e1fc24e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269956 expref: 13 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130971.459307:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91de01ad6c00, rc 0) 00000100:00100000:0.0:1789130971.459398:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8600850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+13:6161:x1876039498235648:12345-192.168.203.11@tcp:101:ll_cfg_requeue.0 Request processed in 248us (842us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130971.459407:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 409 00000100:00100000:2.0:1789130971.463734:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789130971.463825:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498235776 00000100:00100000:1.0:1789130971.463839:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498235776 00000100:00100000:1.0:1789130971.463935:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 410 00000100:00100000:1.0:1789130971.463948:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8600050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+13:6161:x1876039498235776:12345-192.168.203.11@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789130971.464385:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8600050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+13:6161:x1876039498235776:12345-192.168.203.11@tcp:501:ll_cfg_requeue.0 Request processed in 438us (660us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130971.464395:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 410 00000100:00100000:3.0:1789130971.467419:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789130971.467824:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498235904 00000100:00100000:0.0:1789130971.467837:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498235904 00000100:00100000:0.0:1789130971.467944:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 411 00000100:00100000:0.0:1789130971.467956:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8602850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+13:6161:x1876039498235904:12345-192.168.203.11@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789130971.468150:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8602850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+13:6161:x1876039498235904:12345-192.168.203.11@tcp:503:ll_cfg_requeue.0 Request processed in 195us (744us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130971.468169:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 411 00000100:00100000:2.0:1789130971.473145:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789130971.473295:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498236032 00000100:00100000:1.0:1789130971.473309:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498236032 00000100:00100000:1.0:1789130971.473503:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 412 00000100:00100000:1.0:1789130971.473527:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8602450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+13:11044:x1876039498236032:12345-192.168.203.11@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789130971.473734:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8602450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+13:11044:x1876039498236032:12345-192.168.203.11@tcp:502:llog_process_th.0 Request processed in 210us (603us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130971.473743:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 412 00000100:00100000:1.0:1789130971.477836:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789130971.478026:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498236160 00000100:00100000:0.0:1789130971.478040:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498236160 00000100:00100000:0.0:1789130971.478152:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 413 00000100:00100000:0.0:1789130971.478175:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8603050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+13:11044:x1876039498236160:12345-192.168.203.11@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789130971.478376:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8603050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+13:11044:x1876039498236160:12345-192.168.203.11@tcp:502:llog_process_th.0 Request processed in 204us (916us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130971.478388:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 413 10000000:01000000:2.0:1789130971.601637:0:6497:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789130971.601648:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91ddff549800 from 13 10000000:01000000:2.0:1789130971.601656:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789130971.601747:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7ec00/0xf3fe2838e1fc24ea lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130971.601762:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7ec00/0xf3fe2838e1fc24ea lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130971.601776:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7ec00/0xf3fe2838e1fc24ea lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130971.601810:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7c7bc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508817408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789130971.601908:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130971.601997:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff91dcc7fab180 going to sleep for 11 seconds 00000100:00100000:1.0:1789130971.602254:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508817408 00000100:00100000:1.0:1789130971.602265:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508817408 00000100:00100000:1.0:1789130971.602331:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 414 00000100:00100000:1.0:1789130971.602350:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8601c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+20:6497:x1876039508817408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789130971.602370:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130971.602385:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91dcc85cbc00/0xf3fe2838e1fc24f1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3fe2838e1fc24ea expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130971.602415:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91dcc85cbc00/0xf3fe2838e1fc24f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3fe2838e1fc24ea expref: 21 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130971.602427:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91dcc85cbc00/0xf3fe2838e1fc24f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc24ea expref: 21 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130971.602567:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dcc85cbc00, rc 0) 00000100:00100000:1.0:1789130971.602672:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8601c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+21:6497:x1876039508817408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 323us (764us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130971.602681:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 414 00000100:00100000:2.0:1789130971.605744:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7c7bc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508817408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789130971.605785:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7ec00/0xf3fe2838e1fc24ea lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc24f1 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130971.605800:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7ec00/0xf3fe2838e1fc24ea lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3fe2838e1fc24f1 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130971.605913:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7c7bc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508817536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789130971.605996:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130971.606630:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff91dcc7fab180 going to sleep for 11 seconds 00000100:00100000:0.0:1789130971.606889:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508817536 00000100:00100000:0.0:1789130971.606916:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508817536 00000100:00100000:0.0:1789130971.607029:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 415 00000100:00100000:0.0:1789130971.607041:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8602050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+21:6497:x1876039508817536:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789130971.607390:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8602050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+21:6497:x1876039508817536:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 351us (1394us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130971.607400:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 415 00000100:00100000:3.0:1789130971.607508:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7c7bc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508817536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789130971.607560:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8509e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508817664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789130971.607615:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130971.607865:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddff6993c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789130971.607946:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508817664 00000100:00100000:2.0:1789130971.607952:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508817664 00000100:00100000:2.0:1789130971.607982:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 416 00000100:00100000:2.0:1789130971.607988:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8600c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+21:6497:x1876039508817664:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789130971.608139:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8600c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+21:6497:x1876039508817664:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 150us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130971.608166:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 416 00000100:00100000:3.0:1789130971.608530:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8509e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508817664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789130971.608983:0:14470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc845cf00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:14470:1876039508817792:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789130971.609106:0:14470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130971.609184:0:14470:0:(client.c:2715:ptlrpc_set_wait()) set ffff91dcc6aad540 going to sleep for 11 seconds 00000100:00100000:2.0:1789130971.609534:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508817792 00000100:00100000:2.0:1789130971.609541:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508817792 00000100:00100000:2.0:1789130971.609626:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 417 00000100:00100000:2.0:1789130971.609635:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8601050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+21:14470:x1876039508817792:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789130971.609773:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8601050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+21:14470:x1876039508817792:12345-0@lo:502:llog_process_th.0 Request processed in 139us (667us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130971.609781:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 417 00000100:00100000:1.0:1789130971.609862:0:14470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc845cf00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:14470:1876039508817792:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789130971.609892:0:14470:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789130971.609904:0:14470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789130971.609906:0:14470:0:(obd_config.c:1563:class_process_config()) marker 6 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789130971.609914:0:14470:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff91ddff549800 00000020:00000080:1.0:1789130971.609917:0:14470:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789130971.609988:0:14470:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789130971.609992:0:14470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789130971.609993:0:14470:0:(obd_config.c:1563:class_process_config()) marker 6 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789130971.609996:0:14470:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789130971.610006:0:14470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789130971.610007:0:14470:0:(obd_config.c:1563:class_process_config()) marker 7 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1789130971.610011:0:14470:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff91ddff549800 00000020:00000080:1.0:1789130971.610013:0:14470:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789130971.610063:0:14470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc845cf00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:14470:1876039508817920:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789130971.610102:0:14470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130971.616647:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508817920 00000100:00100000:0.0:1789130971.616667:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508817920 00000100:00100000:0.0:1789130971.616733:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 418 00000100:00100000:0.0:1789130971.616744:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8603450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+21:14470:x1876039508817920:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789130971.616942:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8603450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+21:14470:x1876039508817920:12345-0@lo:502:llog_process_th.0 Request processed in 199us (6839us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130971.616951:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 418 00000100:00100000:2.0:1789130971.619200:0:14470:0:(client.c:2715:ptlrpc_set_wait()) set ffff91dcc6aad540 going to sleep for 11 seconds 00000100:00100000:2.0:1789130971.619252:0:14470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc845cf00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:14470:1876039508817920:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789130971.619422:0:14470:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789130971.619432:0:14470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789130971.619435:0:14470:0:(obd_config.c:1563:class_process_config()) marker 7 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1789130971.619441:0:14470:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 19 count 19 00000020:01000000:0.0:1789130971.620633:0:6497:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-18 (rc=0) 10000000:01000000:0.0:1789130971.620673:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789130971.620688:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7ec00/0xf3fe2838e1fc24ea lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc24f1 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130971.620702:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7ec00/0xf3fe2838e1fc24ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc24f1 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789130971.620715:0:6497:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789130971.620718:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91ddff4f9000 from 13 10000000:01000000:0.0:1789130971.620722:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789130971.620771:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff91de01ad7000/0xf3fe2838e1fc24f8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130971.620780:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff91de01ad7000/0xf3fe2838e1fc24f8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130971.620803:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff91de01ad7000/0xf3fe2838e1fc24f8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130971.620832:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc860a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508818048:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789130971.620917:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130971.620969:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff91dcc8546e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789130971.621580:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508818048 00000100:00100000:2.0:1789130971.621590:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508818048 00000100:00100000:2.0:1789130971.621661:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 419 00000100:00100000:2.0:1789130971.621673:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddf5cc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+21:6497:x1876039508818048:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789130971.621689:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130971.621707:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91dcc7f7f000/0xf3fe2838e1fc24ff lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3fe2838e1fc24f8 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130971.621739:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91dcc7f7f000/0xf3fe2838e1fc24ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3fe2838e1fc24f8 expref: 22 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130971.621751:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91dcc7f7f000/0xf3fe2838e1fc24ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc24f8 expref: 22 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130971.621772:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dcc7f7f000, rc 0) 00000100:00100000:2.0:1789130971.621840:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddf5cc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+22:6497:x1876039508818048:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 169us (922us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130971.621847:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 419 00000100:00100000:3.0:1789130971.622223:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc860a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508818048:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789130971.622246:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff91de01ad7000/0xf3fe2838e1fc24f8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc24ff expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789130971.622256:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff91de01ad7000/0xf3fe2838e1fc24f8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3fe2838e1fc24ff expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789130971.622339:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8509e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508818176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789130971.622385:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130971.622428:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddff699180 going to sleep for 11 seconds 00000100:00100000:0.0:1789130971.622608:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508818176 00000100:00100000:0.0:1789130971.622613:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508818176 00000100:00100000:0.0:1789130971.622649:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 420 00000100:00100000:0.0:1789130971.622658:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddf5cc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+22:6497:x1876039508818176:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789130971.622801:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddf5cc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+22:6497:x1876039508818176:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 143us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130971.622809:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 420 00000100:00100000:0.0:1789130971.622844:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8509e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508818176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789130971.622881:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8608000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508818304:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789130971.622924:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130971.622944:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff91dcc8546300 going to sleep for 11 seconds 00000100:00100000:0.0:1789130971.622955:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508818304 00000100:00100000:0.0:1789130971.622964:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508818304 00000100:00100000:0.0:1789130971.622981:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 421 00000100:00100000:0.0:1789130971.622987:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddf5cc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+22:6497:x1876039508818304:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789130971.623069:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddf5cc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+22:6497:x1876039508818304:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 81us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130971.623076:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 421 00000100:00100000:0.0:1789130971.623125:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8608000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508818304:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789130971.623946:0:14473:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc845cf00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:14473:1876039508818432:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789130971.624240:0:14473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130971.624351:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508818432 00000100:00100000:0.0:1789130971.624359:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508818432 00000100:00100000:0.0:1789130971.624403:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 422 00000100:00100000:0.0:1789130971.624412:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddf5cc6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+22:14473:x1876039508818432:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789130971.624831:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddf5cc6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+22:14473:x1876039508818432:12345-0@lo:502:llog_process_th.0 Request processed in 419us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130971.624841:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 422 00000100:00100000:1.0:1789130971.624927:0:14473:0:(client.c:2715:ptlrpc_set_wait()) set ffff91dcc6aad900 going to sleep for 11 seconds 00000100:00100000:1.0:1789130971.624953:0:14473:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc845cf00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:14473:1876039508818432:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789130971.624993:0:14473:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789130971.625006:0:14473:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789130971.625008:0:14473:0:(obd_config.c:1563:class_process_config()) marker 6 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789130971.625248:0:14473:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff91ddff4f9000 00000020:00000080:1.0:1789130971.625252:0:14473:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789130971.625392:0:14473:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789130971.625396:0:14473:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789130971.625398:0:14473:0:(obd_config.c:1563:class_process_config()) marker 6 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789130971.625401:0:14473:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789130971.625404:0:14473:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789130971.625405:0:14473:0:(obd_config.c:1563:class_process_config()) marker 7 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1789130971.625409:0:14473:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff91ddff4f9000 00000020:00000080:1.0:1789130971.625412:0:14473:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789130971.625477:0:14473:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc845cf00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:14473:1876039508818560:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789130971.625526:0:14473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130971.625553:0:14473:0:(client.c:2715:ptlrpc_set_wait()) set ffff91dcc6aad900 going to sleep for 11 seconds 00000100:00100000:0.0:1789130971.625830:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508818560 00000100:00100000:0.0:1789130971.625846:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508818560 00000100:00100000:0.0:1789130971.625885:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 423 00000100:00100000:0.0:1789130971.625893:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddf5cc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+22:14473:x1876039508818560:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789130971.625989:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddf5cc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+22:14473:x1876039508818560:12345-0@lo:502:llog_process_th.0 Request processed in 97us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130971.625997:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 423 00000100:00100000:1.0:1789130971.626508:0:14473:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc845cf00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:14473:1876039508818560:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789130971.626536:0:14473:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789130971.626549:0:14473:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789130971.626551:0:14473:0:(obd_config.c:1563:class_process_config()) marker 7 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1789130971.626555:0:14473:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 19 count 19 00000020:01000000:0.0:1789130971.626921:0:6497:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-18 (rc=0) 10000000:01000000:0.0:1789130971.626949:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789130971.626961:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff91de01ad7000/0xf3fe2838e1fc24f8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc24ff expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130971.626974:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff91de01ad7000/0xf3fe2838e1fc24f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc24ff expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789130971.626986:0:6497:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789130971.626989:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91ddfce33000 from 13 10000000:01000000:0.0:1789130971.626992:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789130971.627023:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff91de01ad7200/0xf3fe2838e1fc2506 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130971.627043:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff91de01ad7200/0xf3fe2838e1fc2506 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130971.627054:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff91de01ad7200/0xf3fe2838e1fc2506 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789130971.627076:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8608000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508818688:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789130971.627124:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130971.627176:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddff9d6180 going to sleep for 11 seconds 00000100:00100000:1.0:1789130971.627595:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508818688 00000100:00100000:1.0:1789130971.627602:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508818688 00000100:00100000:1.0:1789130971.627698:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 424 00000100:00100000:1.0:1789130971.627707:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddf5cc4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+22:6497:x1876039508818688:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789130971.627722:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789130971.627737:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91dcc85cb400/0xf3fe2838e1fc250d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3fe2838e1fc2506 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130971.627762:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91dcc85cb400/0xf3fe2838e1fc250d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3fe2838e1fc2506 expref: 23 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130971.627774:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91dcc85cb400/0xf3fe2838e1fc250d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc2506 expref: 23 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130971.627784:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dcc85cb400, rc 0) 00000100:00100000:1.0:1789130971.627829:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddf5cc4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+23:6497:x1876039508818688:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (705us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130971.627836:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 424 00000100:00100000:1.0:1789130971.627879:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8608000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508818688:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789130971.627894:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff91de01ad7200/0xf3fe2838e1fc2506 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc250d expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130971.627903:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff91de01ad7200/0xf3fe2838e1fc2506 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3fe2838e1fc250d expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130971.627979:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc845cf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508818816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789130971.628012:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130971.628830:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff91dcc6aadcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789130971.629085:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508818816 00000100:00100000:3.0:1789130971.629094:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508818816 00000100:00100000:3.0:1789130971.629148:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 425 00000100:00100000:3.0:1789130971.629166:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddf5cc5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+23:6497:x1876039508818816:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789130971.629358:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddf5cc5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+23:6497:x1876039508818816:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 201us (1343us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130971.629376:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 425 00000100:00100000:2.0:1789130971.629668:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc845cf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508818816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789130971.629720:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7c7bc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508818944:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789130971.629771:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130971.629794:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff91dcc7fab300 going to sleep for 11 seconds 00000100:00100000:3.0:1789130971.629856:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508818944 00000100:00100000:3.0:1789130971.629861:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508818944 00000100:00100000:3.0:1789130971.629895:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 426 00000100:00100000:3.0:1789130971.629903:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddf5cc7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+23:6497:x1876039508818944:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789130971.629994:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddf5cc7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+23:6497:x1876039508818944:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 91us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130971.630001:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 426 00000100:00100000:2.0:1789130971.630129:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7c7bc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508818944:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789130971.630655:0:14474:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7c7bc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:14474:1876039508819072:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789130971.630698:0:14474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130971.630721:0:14474:0:(client.c:2715:ptlrpc_set_wait()) set ffff91dcc7fabe40 going to sleep for 11 seconds 00000100:00100000:3.0:1789130971.630772:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508819072 00000100:00100000:3.0:1789130971.630778:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508819072 00000100:00100000:3.0:1789130971.630811:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 427 00000100:00100000:3.0:1789130971.630819:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddf5cc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+23:14474:x1876039508819072:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789130971.631011:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddf5cc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+23:14474:x1876039508819072:12345-0@lo:502:llog_process_th.0 Request processed in 192us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130971.631019:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 427 00000100:00100000:2.0:1789130971.631109:0:14474:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7c7bc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:14474:1876039508819072:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789130971.631135:0:14474:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789130971.631148:0:14474:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789130971.631151:0:14474:0:(obd_config.c:1563:class_process_config()) marker 6 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789130971.631169:0:14474:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff91ddfce33000 00000020:00000080:2.0:1789130971.631172:0:14474:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789130971.631252:0:14474:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789130971.631256:0:14474:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789130971.631258:0:14474:0:(obd_config.c:1563:class_process_config()) marker 6 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789130971.631261:0:14474:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789130971.631263:0:14474:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789130971.631265:0:14474:0:(obd_config.c:1563:class_process_config()) marker 7 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1789130971.631269:0:14474:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff91ddfce33000 00000020:00000080:2.0:1789130971.631278:0:14474:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789130971.631312:0:14474:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7c7bc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:14474:1876039508819200:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789130971.631349:0:14474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130971.631383:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508819200 00000100:00100000:2.0:1789130971.631388:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508819200 00000100:00100000:2.0:1789130971.631411:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 428 00000100:00100000:2.0:1789130971.631417:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddf5cc6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+23:14474:x1876039508819200:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789130971.631718:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddf5cc6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+23:14474:x1876039508819200:12345-0@lo:502:llog_process_th.0 Request processed in 300us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130971.631726:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 428 00000100:00100000:2.0:1789130971.631762:0:14474:0:(client.c:2715:ptlrpc_set_wait()) set ffff91dcc7fabe40 going to sleep for 11 seconds 00000100:00100000:2.0:1789130971.631775:0:14474:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7c7bc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:14474:1876039508819200:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789130971.631795:0:14474:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789130971.631799:0:14474:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789130971.631801:0:14474:0:(obd_config.c:1563:class_process_config()) marker 7 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1789130971.631805:0:14474:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 19 count 19 00000020:01000000:2.0:1789130971.631945:0:6497:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-18 (rc=0) 10000000:01000000:2.0:1789130971.631972:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789130971.631983:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff91de01ad7200/0xf3fe2838e1fc2506 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc250d expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130971.631995:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff91de01ad7200/0xf3fe2838e1fc2506 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc250d expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789130971.632009:0:6497:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789130971.632012:0:6497:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91dded7b6800 from 13 10000000:01000000:2.0:1789130971.632015:0:6497:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789130971.632045:0:6497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7f200/0xf3fe2838e1fc2514 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130971.632064:0:6497:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7f200/0xf3fe2838e1fc2514 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130971.632076:0:6497:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7f200/0xf3fe2838e1fc2514 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789130971.632101:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7c7bc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508819328:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789130971.632131:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130971.632146:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff91dcc7fabe40 going to sleep for 11 seconds 00000100:00100000:2.0:1789130971.632168:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508819328 00000100:00100000:2.0:1789130971.632171:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508819328 00000100:00100000:2.0:1789130971.632192:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 429 00000100:00100000:2.0:1789130971.633012:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddf5cc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+23:6497:x1876039508819328:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789130971.633034:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789130971.633063:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91dcc7f7f400/0xf3fe2838e1fc251b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3fe2838e1fc2514 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130971.633095:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91dcc7f7f400/0xf3fe2838e1fc251b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3fe2838e1fc2514 expref: 24 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130971.633108:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91dcc7f7f400/0xf3fe2838e1fc251b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc2514 expref: 24 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789130971.633118:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dcc7f7f400, rc 0) 00000100:00100000:2.0:1789130971.633228:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddf5cc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+24:6497:x1876039508819328:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1029us (1095us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130971.633236:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 429 00000040:00080000:2.0:1789130971.636778:0:14475:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789130971.641665:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7c7bc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508819328:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789130971.641706:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7f200/0xf3fe2838e1fc2514 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc251b expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130971.641723:0:6497:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7f200/0xf3fe2838e1fc2514 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3fe2838e1fc251b expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789130971.641841:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc845cf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508819456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789130971.641922:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130971.642009:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff91dcc6aad3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789130971.642051:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508819456 00000100:00100000:2.0:1789130971.642058:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508819456 00000100:00100000:2.0:1789130971.642165:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 430 00000100:00100000:2.0:1789130971.642177:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddf5cc4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+24:6497:x1876039508819456:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789130971.642364:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddf5cc4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+24:6497:x1876039508819456:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 189us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130971.642382:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 430 00000100:00100000:0.0:1789130971.642453:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc845cf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508819456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789130971.642714:0:6497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8608780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508819584:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789130971.642769:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130971.642808:0:6497:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddff9d6780 going to sleep for 11 seconds 00000100:00100000:2.0:1789130971.642945:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508819584 00000100:00100000:2.0:1789130971.642950:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508819584 00000100:00100000:2.0:1789130971.643014:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 431 00000100:00100000:2.0:1789130971.643022:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddf5cc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+24:6497:x1876039508819584:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789130971.643124:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddf5cc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+24:6497:x1876039508819584:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 102us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130971.643141:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 431 00000100:00100000:0.0:1789130971.643228:0:6497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8608780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:6497:1876039508819584:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789130971.643511:0:14476:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8608780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:14476:1876039508819712:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789130971.643553:0:14476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130971.644111:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508819712 00000100:00100000:1.0:1789130971.644119:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508819712 00000100:00100000:1.0:1789130971.644275:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 432 00000100:00100000:1.0:1789130971.644283:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddf5cc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+24:14476:x1876039508819712:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789130971.644409:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddf5cc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+24:14476:x1876039508819712:12345-0@lo:502:llog_process_th.0 Request processed in 126us (854us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130971.644417:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 432 00000100:00100000:0.0:1789130971.644804:0:14476:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddff9d60c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789130971.644829:0:14476:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8608780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:14476:1876039508819712:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789130971.644863:0:14476:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789130971.644876:0:14476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789130971.644879:0:14476:0:(obd_config.c:1563:class_process_config()) marker 6 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789130971.644888:0:14476:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff91dded7b6800 00000020:00000080:0.0:1789130971.644891:0:14476:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789130971.644971:0:14476:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789130971.644976:0:14476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789130971.644985:0:14476:0:(obd_config.c:1563:class_process_config()) marker 6 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789130971.644989:0:14476:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789130971.644992:0:14476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789130971.644993:0:14476:0:(obd_config.c:1563:class_process_config()) marker 7 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1789130971.644997:0:14476:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff91dded7b6800 00000020:00000080:0.0:1789130971.644999:0:14476:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789130971.645044:0:14476:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8608780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:14476:1876039508819840:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789130971.645092:0:14476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130971.645123:0:14476:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddff9d60c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789130971.645587:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508819840 00000100:00100000:2.0:1789130971.645597:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508819840 00000100:00100000:2.0:1789130971.645648:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 433 00000100:00100000:2.0:1789130971.645657:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddf5cc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+24:14476:x1876039508819840:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789130971.645769:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddf5cc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+24:14476:x1876039508819840:12345-0@lo:502:llog_process_th.0 Request processed in 113us (677us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130971.645777:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 433 00000100:00100000:0.0:1789130971.646625:0:14476:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8608780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:14476:1876039508819840:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789130971.646661:0:14476:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789130971.646669:0:14476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789130971.646671:0:14476:0:(obd_config.c:1563:class_process_config()) marker 7 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1789130971.646675:0:14476:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 19 count 19 00000020:01000000:0.0:1789130971.646761:0:6497:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-18 (rc=0) 10000000:01000000:0.0:1789130971.646790:0:6497:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789130971.646803:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7f200/0xf3fe2838e1fc2514 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc251b expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130971.646816:0:6497:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7f200/0xf3fe2838e1fc2514 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc251b expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789130971.663705:0:14478:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789130971.997057:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789130971.997125:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789130971.997168:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789130971.997342:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789130971.997366:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789130971.997396:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789130971.997429:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498236416 00000100:00100000:3.0:1789130971.997442:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498236416 00000100:00100000:3.0:1789130971.997554:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498236928 00000100:00100000:3.0:1789130971.997557:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498236928 00000100:00100000:3.0:1789130971.997573:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498236544 00000100:00100000:3.0:1789130971.997575:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498236544 00000100:00100000:3.0:1789130971.997588:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498236800 00000100:00100000:3.0:1789130971.997590:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498236800 00000100:00100000:3.0:1789130971.997606:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 255 00000100:00100000:3.0:1789130971.997616:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc850b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+5:2388:x1876039498236416:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1789130971.997710:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc850b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+5:2388:x1876039498236416:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 95us (716us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130971.997718:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 255 00000100:00100000:3.0:1789130971.997738:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 256 00000100:00100000:3.0:1789130971.997744:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc6d64f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fde8d4a8-44db-4e6b-8249-c1c295e4901d+5:2388:x1876039498236928:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1789130971.997770:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc6d64f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fde8d4a8-44db-4e6b-8249-c1c295e4901d+5:2388:x1876039498236928:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 27us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130971.997777:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 256 00000100:00100000:3.0:1789130971.997788:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 257 00000100:00100000:3.0:1789130971.997794:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc6d67840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+5:2388:x1876039498236544:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1789130971.997818:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc6d67840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+5:2388:x1876039498236544:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 24us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130971.997824:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 257 00000100:00100000:3.0:1789130971.997847:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 258 00000100:00100000:3.0:1789130971.997854:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc6d66940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fde8d4a8-44db-4e6b-8249-c1c295e4901d+5:2388:x1876039498236800:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1789130971.997882:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc6d66940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fde8d4a8-44db-4e6b-8249-c1c295e4901d+5:2388:x1876039498236800:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 29us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130971.997888:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 258 00000100:00080000:3.0:1789130971.997907:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789130971.997912:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789130971.998426:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498236288 00000100:00100000:0.0:1789130971.998434:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498236288 00000100:00100000:0.0:1789130971.998502:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 434 00000100:00100000:0.0:1789130971.998511:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddf5cc4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+13:2388:x1876039498236288:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1789130971.998551:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddf5cc4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+13:2388:x1876039498236288:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 41us (1209us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130971.998557:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 434 00000100:00100000:2.0:1789130971.998878:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498236672 00000100:00100000:2.0:1789130971.998884:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498236672 00000100:00100000:2.0:1789130971.998942:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 97 00000100:00100000:2.0:1789130971.998950:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8509e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+5:2388:x1876039498236672:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1789130971.999008:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8509e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+5:2388:x1876039498236672:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 59us (1882us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130971.999023:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 97 00000100:00080000:3.0:1789130971.999610:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1789130972.049693:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789130972.690178:0:14475:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1789130972.691907:0:14478:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789130972.753817:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789130972.753852:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8608780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1876039508819968:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789130972.753949:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130972.754039:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508819968 00000100:00100000:2.0:1789130972.754051:0:8418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508819968 00000100:00100000:2.0:1789130972.754339:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789130972.754351:0:8418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddfd065a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3627:x1876039508819968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789130972.754392:0:8418:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789130972.754449:0:8418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddfd065a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3627:x1876039508819968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130972.754482:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00080000:3.0:1789130972.754920:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789130972.754966:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8608780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1876039508819968:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789130972.755600:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddca228000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3628:1876039508820480:0@lo:400:kworker.0 00000100:00100000:3.0:1789130972.755639:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddca22ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508820352:0@lo:400:kworker.0 00000100:00100000:2.0:1789130972.755722:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc845cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3625:1876039508820096:0@lo:400:kworker.0 00000100:00100000:0.0:1789130972.755740:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc5fe83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3626:1876039508820224:0@lo:400:kworker.0 00000100:00100000:1.0:1789130972.756167:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130972.756337:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7ffcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1876039508820992:0@lo:400:kworker.0 00000100:00100000:1.0:1789130972.756374:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130972.756397:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7c92940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1876039508821504:0@lo:400:kworker.0 00000100:00100000:1.0:1789130972.756420:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130972.756519:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508820992 00000100:00100000:1.0:1789130972.756527:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508820992 00000100:00100000:1.0:1789130972.756584:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508821504 00000100:00100000:1.0:1789130972.756588:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508821504 00000100:00100000:1.0:1789130972.756614:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789130972.756623:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7c921c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3628:x1876039508820992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130972.756980:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7c921c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3628:x1876039508820992:12345-0@lo:400:kworker.0 Request processed in 56us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130972.756990:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789130972.757011:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789130972.757017:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7c91680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3628:x1876039508821504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130972.757048:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7c91680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3628:x1876039508821504:12345-0@lo:400:kworker.0 Request processed in 31us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130972.757053:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00080000:1.0:1789130972.757078:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789130972.757082:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789130972.757114:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc7ffcb40 x1876039508820992/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789130988 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789130972.757130:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7ffcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1876039508820992:0@lo:400:kworker.0 00000100:00100000:1.0:1789130972.757142:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7c92940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1876039508821504:0@lo:400:kworker.0 00000100:00100000:1.0:1789130972.757222:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508820480 00000100:00100000:1.0:1789130972.757226:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508820480 00000100:00100000:1.0:1789130972.757257:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1789130972.757264:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7c90780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3628:x1876039508820480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130972.757303:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7c90780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3628:x1876039508820480:12345-0@lo:400:kworker.0 Request processed in 39us (1138us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130972.757311:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1789130972.757363:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddca228000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3628:1876039508820480:0@lo:400:kworker.0 00000100:00100000:3.0:1789130972.757765:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130972.757817:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7ffed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3627:1876039508820864:0@lo:400:kworker.0 00000100:00100000:2.0:1789130972.757845:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130972.757856:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130972.757889:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddca229a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508820608:0@lo:400:kworker.0 00000100:00100000:3.0:1789130972.757890:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7c93c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3627:1876039508821376:0@lo:400:kworker.0 00000100:00100000:3.0:1789130972.757931:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130972.757937:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130972.757964:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7ffc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508821120:0@lo:400:kworker.0 00000100:00100000:3.0:1789130972.757968:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508820864 00000100:00100000:3.0:1789130972.757974:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508820864 00000100:00100000:2.0:1789130972.757993:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130972.758014:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508821376 00000100:00100000:2.0:1789130972.758016:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddfd064000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508821632:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789130972.758019:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508821376 00000100:00100000:3.0:1789130972.758045:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1789130972.758052:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130972.758056:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddfd0643c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1876039508820864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130972.758094:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508820352 00000100:00100000:2.0:1789130972.758098:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508820352 00000100:00100000:3.0:1789130972.758104:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddfd0643c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1876039508820864:12345-0@lo:400:kworker.0 Request processed in 50us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130972.758120:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1789130972.758131:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508820608 00000100:00100000:2.0:1789130972.758135:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508820608 00000100:00100000:3.0:1789130972.758140:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1789130972.758160:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddfd0661c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3627:x1876039508821376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130972.758167:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1789130972.758177:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddfd066940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508820352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130972.758194:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddfd0661c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3627:x1876039508821376:12345-0@lo:400:kworker.0 Request processed in 46us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130972.758200:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00080000:3.0:1789130972.758222:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789130972.758236:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddfd066940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508820352:12345-0@lo:400:kworker.0 Request processed in 60us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130972.758250:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1789130972.758265:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1789130972.758270:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7c7bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1876039508820608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130972.758305:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7c7bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1876039508820608:12345-0@lo:400:kworker.0 Request processed in 35us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130972.758312:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1789130972.758335:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508821120 00000100:00100000:2.0:1789130972.758338:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508821120 00000100:00100000:2.0:1789130972.758363:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1789130972.758369:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc6bec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1876039508821120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130972.758401:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc6bec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1876039508821120:12345-0@lo:400:kworker.0 Request processed in 31us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130972.758407:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1789130972.758427:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508821632 00000100:00080000:3.0:1789130972.758429:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789130972.758432:0:8418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508821632 00000100:00100000:3.0:1789130972.758481:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddca22ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508820352:0@lo:400:kworker.0 00000100:00100000:2.0:1789130972.758485:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789130972.758497:0:8418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7890000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508821632:12345-0@lo:13:osp-pre-1-1.0 00010000:00080000:3.0:1789130972.758501:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc7ffed00 x1876039508820864/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130988 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130972.758513:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7ffed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3627:1876039508820864:0@lo:400:kworker.0 00002000:00000024:2.0:1789130972.758518:0:8418:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00010000:00080000:3.0:1789130972.758534:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc7c93c00 x1876039508821376/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130988 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130972.758545:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7c93c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3627:1876039508821376:0@lo:400:kworker.0 00000100:00100000:2.0:1789130972.758558:0:8418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7890000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508821632:12345-0@lo:13:osp-pre-1-1.0 Request processed in 62us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130972.758566:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1789130972.758599:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddca229a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508820608:0@lo:400:kworker.0 00010000:00080000:3.0:1789130972.758611:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc7ffc3c0 x1876039508821120/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789130988 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130972.758619:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7ffc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508821120:0@lo:400:kworker.0 00000100:00100000:3.0:1789130972.758636:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddfd064000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508821632:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789130972.758764:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508820096 00000100:00100000:3.0:1789130972.758768:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508820096 00000100:00100000:3.0:1789130972.758910:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 435 00000100:00100000:3.0:1789130972.758918:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddcf4fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+24:3625:x1876039508820096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130972.758961:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddcf4fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+24:3625:x1876039508820096:12345-0@lo:400:kworker.0 Request processed in 43us (1117us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130972.758967:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 435 00000100:00100000:3.0:1789130972.759002:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc845cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3625:1876039508820096:0@lo:400:kworker.0 00000100:00100000:0.0:1789130972.761844:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130972.762027:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddca229680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3626:1876039508820736:0@lo:400:kworker.0 00000100:00100000:0.0:1789130972.762071:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130972.772735:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7c90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3626:1876039508821248:0@lo:400:kworker.0 00000100:00100000:0.0:1789130972.772829:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130972.774580:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508820224 00000100:00100000:1.0:1789130972.774599:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508820224 00000100:00100000:1.0:1789130972.774693:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508820736 00000100:00100000:1.0:1789130972.774697:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508820736 00000100:00100000:1.0:1789130972.774756:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1789130972.774767:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc860ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1876039508820224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130972.774871:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc860ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1876039508820224:12345-0@lo:400:kworker.0 Request processed in 105us (13039us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130972.774880:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1789130972.774902:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1789130972.774909:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc860bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1876039508820736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130972.774943:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc860bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1876039508820736:12345-0@lo:400:kworker.0 Request processed in 35us (12871us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130972.774949:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00080000:2.0:1789130972.775062:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789130972.775263:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc5fe83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3626:1876039508820224:0@lo:400:kworker.0 00000100:00100000:0.0:1789130972.775277:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddca229680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3626:1876039508820736:0@lo:400:kworker.0 00000100:00100000:1.0:1789130972.775429:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508821248 00000100:00100000:1.0:1789130972.775434:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508821248 00000100:00100000:1.0:1789130972.775512:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1789130972.775521:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc860a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1876039508821248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130972.775563:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc860a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1876039508821248:12345-0@lo:400:kworker.0 Request processed in 43us (2734us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130972.775569:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1789130972.775644:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7c90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3626:1876039508821248:0@lo:400:kworker.0 00000100:00080000:2.0:1789130972.775816:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789130973.073807:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789130973.267514:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8608f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508821760:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789130973.267621:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130973.267826:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508821760 00000100:00100000:0.0:1789130973.267837:0:8418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508821760 00000100:00100000:0.0:1789130973.267911:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1789130973.267923:0:8418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc78930c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508821760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789130973.267977:0:8418:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789130973.268043:0:8418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc78930c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508821760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 122us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130973.268052:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00010000:00080000:1.0:1789130973.268235:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc8608f00 x1876039508821760/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789130989 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789130973.268259:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8608f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508821760:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789130973.780417:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789130973.780513:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddfd064000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1876039508821888:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789130973.780619:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130973.780779:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508821888 00000100:00100000:2.0:1789130973.780790:0:8418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508821888 00000100:00100000:2.0:1789130973.780863:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1789130973.780875:0:8418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7c92940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1876039508821888:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789130973.780907:0:8418:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789130973.780961:0:8418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7c92940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1876039508821888:12345-0@lo:13:osp-pre-0-1.0 Request processed in 88us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130973.780968:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00010000:00080000:1.0:1789130973.781711:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91ddfd064000 x1876039508821888/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789130989 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789130973.781738:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddfd064000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1876039508821888:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1789130974.099313:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789130975.122383:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789130975.825695:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789130975.825713:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddfd064f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508822144:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789130975.825719:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7890b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508822016:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789130975.828034:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130975.828150:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508822016 00000100:00100000:2.0:1789130975.828162:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508822016 00000100:00100000:2.0:1789130975.828229:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1789130975.828242:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7892d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508822016:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789130975.828294:0:6505:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789130975.828357:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7892d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508822016:12345-0@lo:41:osp-pre-0-1.0 Request processed in 117us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130975.828365:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1789130975.828441:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7890b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508822016:0@lo:41:osp-pre-0-1.0 00000001:00080000:1.0:1789130975.834964:0:9493:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000100:00100000:3.0:1789130975.835547:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130975.843209:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508822144 00000100:00100000:1.0:1789130975.843230:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508822144 00000100:00100000:1.0:1789130975.843324:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1789130975.843883:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddfd065680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1876039508822144:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789130975.843937:0:6506:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789130975.844194:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddfd065680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1876039508822144:12345-0@lo:41:osp-pre-1-0.0 Request processed in 858us (8655us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130975.844203:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1789130975.844446:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddfd064f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508822144:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789130976.146699:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789130977.117764:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789130977.117822:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789130977.117856:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789130977.117904:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789130977.117933:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789130977.117957:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789130977.117990:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498237056 00000100:00100000:1.0:1789130977.118003:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498237056 00000100:00100000:1.0:1789130977.118068:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 436 00000100:00100000:1.0:1789130977.118079:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddcf4fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+13:2385:x1876039498237056:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1789130977.118187:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddcf4fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+13:2385:x1876039498237056:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 109us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130977.118224:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 436 00000100:00100000:1.0:1789130977.118268:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498237184 00000100:00100000:1.0:1789130977.118272:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498237184 00000100:00100000:0.0:1789130977.118313:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498237696 00000100:00100000:0.0:1789130977.118319:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498237696 00000100:00100000:1.0:1789130977.118321:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498237312 00000100:00100000:1.0:1789130977.118337:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498237312 00000100:00100000:0.0:1789130977.118351:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498237568 00000100:00100000:0.0:1789130977.118356:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498237568 00000100:00100000:1.0:1789130977.118369:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 265 00000100:00100000:1.0:1789130977.118380:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7c93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+5:2385:x1876039498237184:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1789130977.118387:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 266 00000100:00100000:0.0:1789130977.118397:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7c92580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fde8d4a8-44db-4e6b-8249-c1c295e4901d+5:2385:x1876039498237696:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1789130977.118423:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7c93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+5:2385:x1876039498237184:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 45us (675us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130977.118431:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 265 00000100:00100000:0.0:1789130977.118447:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7c92580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fde8d4a8-44db-4e6b-8249-c1c295e4901d+5:2385:x1876039498237696:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 51us (588us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130977.118449:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 267 00000100:00100000:0.0:1789130977.118496:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 266 00000100:00100000:0.0:1789130977.118512:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 268 00000100:00100000:0.0:1789130977.118519:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7c91e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fde8d4a8-44db-4e6b-8249-c1c295e4901d+5:2385:x1876039498237568:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1789130977.118546:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7c91e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fde8d4a8-44db-4e6b-8249-c1c295e4901d+5:2385:x1876039498237568:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 28us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130977.118553:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 268 00000100:00080000:0.0:1789130977.118752:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789130977.118756:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498237440 00000100:00100000:3.0:1789130977.118762:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498237440 00000100:00100000:3.0:1789130977.118808:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 101 00000100:00100000:3.0:1789130977.118816:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7c903c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+5:2385:x1876039498237440:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1789130977.118857:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7c903c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+5:2385:x1876039498237440:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 43us (1035us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130977.118865:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 101 00000100:00100000:1.0:1789130977.118991:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7c912c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+5:2385:x1876039498237312:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1789130977.119026:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7c912c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+5:2385:x1876039498237312:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 567us (1092us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130977.119034:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 267 00000100:00080000:0.0:1789130977.125953:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789130977.125966:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789130977.169713:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789130977.874051:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789130977.874126:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddfd064f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508822272:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789130977.874224:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130977.874496:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508822272 00000100:00100000:2.0:1789130977.874524:0:8418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508822272 00000100:00100000:2.0:1789130977.874594:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1789130977.874606:0:8418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7890b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508822272:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789130977.874646:0:8418:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789130977.874695:0:8418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7890b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508822272:12345-0@lo:13:osp-pre-1-1.0 Request processed in 92us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130977.874704:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1789130977.874792:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddfd064f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508822272:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1789130977.875845:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789130977.876667:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8608f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1876039508822400:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789130977.876739:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130977.877228:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff8a52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3625:1876039508822656:0@lo:400:kworker.0 00000100:00100000:2.0:1789130977.878067:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130977.878137:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7fd12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3625:1876039508823168:0@lo:400:kworker.0 00000100:00100000:2.0:1789130977.878191:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130977.878218:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7fd2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3625:1876039508823680:0@lo:400:kworker.0 00000100:00100000:0.0:1789130977.878487:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508822656 00000100:00100000:0.0:1789130977.878496:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508822656 00000100:00100000:0.0:1789130977.878553:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508823168 00000100:00100000:0.0:1789130977.878557:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508823168 00000100:00100000:0.0:1789130977.878595:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1789130977.878605:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff7c03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1876039508822656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130977.878672:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff7c03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1876039508822656:12345-0@lo:400:kworker.0 Request processed in 69us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130977.878681:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1789130977.878699:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1789130977.878705:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01b3b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1876039508823168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130977.878731:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01b3b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1876039508823168:12345-0@lo:400:kworker.0 Request processed in 27us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130977.878738:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00080000:0.0:1789130977.878769:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789130977.879389:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff8a7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1876039508822784:0@lo:400:kworker.0 00000100:00100000:1.0:1789130977.879435:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130977.879494:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7fd2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3626:1876039508823296:0@lo:400:kworker.0 00000100:00100000:1.0:1789130977.879521:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130977.879544:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff7c2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3626:1876039508823808:0@lo:400:kworker.0 00000100:00100000:1.0:1789130977.879568:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130977.879614:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508823296 00000100:00100000:1.0:1789130977.879627:0:14273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508823296 00000100:00100000:1.0:1789130977.879667:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508823808 00000100:00100000:1.0:1789130977.879670:0:14273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508823808 00000100:00100000:1.0:1789130977.879689:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1789130977.879696:0:14273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7c90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1876039508823296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130977.879738:0:14273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7c90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1876039508823296:12345-0@lo:400:kworker.0 Request processed in 43us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130977.879745:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1789130977.879760:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:1.0:1789130977.879766:0:14273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7c93c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1876039508823808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130977.879796:0:14273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7c93c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1876039508823808:12345-0@lo:400:kworker.0 Request processed in 30us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130977.879802:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:1.0:1789130977.879822:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff8a4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3628:1876039508822528:0@lo:400:kworker.0 00000100:00100000:1.0:1789130977.879855:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130977.879883:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01a5ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1876039508823040:0@lo:400:kworker.0 00000100:00100000:1.0:1789130977.879908:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130977.880060:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508822400 00000100:00100000:3.0:1789130977.880066:0:8418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508822400 00000100:00100000:1.0:1789130977.880193:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7fd3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1876039508823552:0@lo:400:kworker.0 00000100:00100000:1.0:1789130977.880222:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130977.884757:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1789130977.884758:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130977.884792:0:8418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7c91a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1876039508822400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789130977.884829:0:8418:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789130977.884884:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508822784 00000100:00100000:0.0:1789130977.884896:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508822784 00000100:00100000:3.0:1789130977.884911:0:8418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7c91a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1876039508822400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 135us (8170us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130977.884920:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1789130977.884962:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508823040 00000100:00100000:0.0:1789130977.884966:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508823040 00000100:00100000:0.0:1789130977.884984:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1789130977.884992:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7c930c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1876039508822784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130977.885046:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7c930c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1876039508822784:12345-0@lo:400:kworker.0 Request processed in 55us (5610us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130977.885054:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1789130977.885070:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1789130977.885077:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddca229680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3628:x1876039508823040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130977.885138:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddca229680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3628:x1876039508823040:12345-0@lo:400:kworker.0 Request processed in 62us (5229us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130977.885143:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff8a52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3625:1876039508822656:0@lo:400:kworker.0 00000100:00100000:0.0:1789130977.885148:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1789130977.885184:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7fd12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3625:1876039508823168:0@lo:400:kworker.0 00000100:00100000:0.0:1789130977.885209:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01a5c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3627:1876039508822912:0@lo:400:kworker.0 00000100:00100000:3.0:1789130977.885261:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508823680 00000100:00100000:0.0:1789130977.885267:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130977.885268:0:14273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508823680 00000100:00100000:3.0:1789130977.885301:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508822912 00000100:00100000:3.0:1789130977.885304:0:14273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508822912 00000100:00100000:3.0:1789130977.885317:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1789130977.885323:0:14273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01b3a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1876039508823680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130977.885364:0:14273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01b3a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1876039508823680:12345-0@lo:400:kworker.0 Request processed in 41us (619us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130977.885371:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1789130977.885383:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1789130977.885389:0:14273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8608780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1876039508822912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130977.885417:0:14273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8608780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1876039508822912:12345-0@lo:400:kworker.0 Request processed in 29us (153us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130977.885423:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1789130977.885453:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7fd2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3625:1876039508823680:0@lo:400:kworker.0 00000100:00100000:3.0:1789130977.885508:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508822528 00000100:00100000:3.0:1789130977.885513:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508822528 00000100:00100000:3.0:1789130977.885546:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 437 00000100:00100000:3.0:1789130977.885554:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddcf4fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+24:3628:x1876039508822528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130977.885591:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddcf4fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+24:3628:x1876039508822528:12345-0@lo:400:kworker.0 Request processed in 38us (5735us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130977.885598:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 437 00000100:00080000:3.0:1789130977.885632:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789130977.885638:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789130977.885641:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789130977.885674:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff8a7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1876039508822784:0@lo:400:kworker.0 00010000:00080000:3.0:1789130977.885693:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc7fd2940 x1876039508823296/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130993 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130977.885705:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7fd2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3626:1876039508823296:0@lo:400:kworker.0 00010000:00080000:3.0:1789130977.885719:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91ddff7c2940 x1876039508823808/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130993 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130977.885730:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff7c2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3626:1876039508823808:0@lo:400:kworker.0 00000100:00100000:1.0:1789130977.889040:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff8a4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3628:1876039508822528:0@lo:400:kworker.0 00000100:00100000:1.0:1789130977.889067:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01a5ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1876039508823040:0@lo:400:kworker.0 00000100:00100000:0.0:1789130977.889674:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7fd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508823424:0@lo:400:kworker.0 00000100:00100000:0.0:1789130977.889762:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130977.889822:0:3627:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:0.0:1789130977.889830:0:3627:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff91dcc845f0c0, transno 4294967301 00000100:00100000:0.0:1789130977.889865:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8608f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1876039508822400:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789130977.889894:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01a5c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3627:1876039508822912:0@lo:400:kworker.0 00000100:00100000:0.0:1789130977.889951:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508823552 00000100:00100000:0.0:1789130977.889959:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508823552 00000100:00100000:0.0:1789130977.890020:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508823424 00000100:00100000:0.0:1789130977.890039:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508823424 00000100:00100000:0.0:1789130977.890068:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789130977.890077:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddca229a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3628:x1876039508823552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130977.892539:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddca229a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3628:x1876039508823552:12345-0@lo:400:kworker.0 Request processed in 2457us (12310us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130977.892555:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789130977.892598:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789130977.892611:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8608000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508823424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130977.892659:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8608000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508823424:12345-0@lo:400:kworker.0 Request processed in 54us (2898us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130977.892666:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00080000:0.0:1789130977.892705:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789130977.892748:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc7fd0000 x1876039508823424/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789130993 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789130977.892764:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7fd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508823424:0@lo:400:kworker.0 00010000:00080000:1.0:1789130977.895360:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc7fd3c00 x1876039508823552/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789130993 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789130977.895385:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7fd3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1876039508823552:0@lo:400:kworker.0 00010000:00010000:0.0:1789130978.195271:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789130978.385970:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8608f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1876039508823936:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789130978.386069:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130978.386295:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508823936 00000100:00100000:3.0:1789130978.386305:0:8418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508823936 00000100:00100000:3.0:1789130978.386383:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1789130978.386395:0:8418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01b38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1876039508823936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789130978.386624:0:8418:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789130978.386700:0:8418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01b38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1876039508823936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 306us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130978.386718:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00010000:00080000:2.0:1789130978.386905:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc8608f00 x1876039508823936/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789130994 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789130978.386927:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8608f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1876039508823936:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789130978.897780:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddfd064f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1876039508824064:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789130978.897874:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130978.898117:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508824064 00000100:00100000:3.0:1789130978.898128:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508824064 00000100:00100000:3.0:1789130978.898187:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1789130978.898197:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddca22ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1876039508824064:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789130978.898224:0:8419:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789130978.898278:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddca22ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1876039508824064:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130978.898287:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00010000:00080000:1.0:1789130978.898395:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91ddfd064f00 x1876039508824064/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789130994 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789130978.898417:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddfd064f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1876039508824064:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1789130979.217911:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130980.241788:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789130980.945876:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddca228000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508824192:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789130980.945976:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130980.946083:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508824192 00000100:00100000:0.0:1789130980.946104:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508824192 00000100:00100000:0.0:1789130980.946178:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1789130980.946200:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddfd064000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1876039508824192:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789130980.946248:0:6505:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789130980.946335:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddfd064000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1876039508824192:12345-0@lo:41:osp-pre-1-0.0 Request processed in 146us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130980.946344:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1789130980.946476:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddca228000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508824192:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789130980.947031:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddfd064f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1876039508824320:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789130980.947077:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130980.947192:0:11069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508824320 00000100:00100000:3.0:1789130980.947197:0:11069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508824320 00000100:00100000:3.0:1789130980.947243:0:11069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1789130980.947253:0:11069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01b38780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1876039508824320:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789130980.947279:0:11069:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789130980.947444:0:11069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01b38780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1876039508824320:12345-0@lo:41:osp-pre-0-1.0 Request processed in 183us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130980.947452:0:11069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1789130980.947510:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddfd064f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1876039508824320:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789130981.265672:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789130982.237443:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789130982.238046:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498237824 00000100:00100000:3.0:1789130982.238058:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498237824 00000100:00100000:3.0:1789130982.238255:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 438 00000100:00100000:3.0:1789130982.238268:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddcf4f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+13:2387:x1876039498237824:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1789130982.238560:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddcf4f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+13:2387:x1876039498237824:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 293us (1132us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130982.238570:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 438 00000100:00100000:2.0:1789130982.239034:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789130982.240588:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789130982.241307:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498238080 00000100:00100000:0.0:1789130982.241319:0:14273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498238080 00000100:00080000:3.0:1789130982.241454:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789130982.241645:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498238336 00000100:00100000:0.0:1789130982.241650:0:14273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498238336 00000100:00080000:3.0:1789130982.241708:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789130982.241908:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 275 00000100:00100000:1.0:1789130982.241924:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01b3ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+5:2387:x1876039498238080:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1789130982.242153:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01b3ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+5:2387:x1876039498238080:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 233us (3119us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130982.242162:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 275 00000100:00100000:1.0:1789130982.242184:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 276 00000100:00100000:1.0:1789130982.242192:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddfd064f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fde8d4a8-44db-4e6b-8249-c1c295e4901d+5:2387:x1876039498238336:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1789130982.242220:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddfd064f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fde8d4a8-44db-4e6b-8249-c1c295e4901d+5:2387:x1876039498238336:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 29us (1640us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130982.242228:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 276 00000100:00100000:2.0:1789130982.246721:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789130982.246779:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789130982.246814:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789130982.246927:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498238208 00000100:00100000:0.0:1789130982.246940:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498238208 00000100:00100000:0.0:1789130982.247031:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 104 00000100:00100000:0.0:1789130982.247043:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01b3a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+5:2388:x1876039498238208:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1789130982.247156:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01b3a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+5:2388:x1876039498238208:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 115us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130982.247165:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 104 00000100:00080000:2.0:1789130982.247493:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789130982.247644:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498237952 00000100:00100000:1.0:1789130982.247650:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498237952 00000100:00100000:1.0:1789130982.247702:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498238464 00000100:00100000:1.0:1789130982.247706:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498238464 00000100:00100000:1.0:1789130982.247728:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 277 00000100:00100000:1.0:1789130982.247736:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01b3bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+5:2388:x1876039498237952:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1789130982.247781:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01b3bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+5:2388:x1876039498237952:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 45us (1076us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130982.247789:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 277 00000100:00100000:1.0:1789130982.247821:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 278 00000100:00100000:1.0:1789130982.247827:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01b38f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fde8d4a8-44db-4e6b-8249-c1c295e4901d+5:2388:x1876039498238464:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1789130982.247854:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01b38f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fde8d4a8-44db-4e6b-8249-c1c295e4901d+5:2388:x1876039498238464:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 28us (1040us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130982.247860:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 278 00000100:00080000:2.0:1789130982.248029:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789130982.248032:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789130982.290219:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789130982.930238:0:14478:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1789130982.931039:0:14475:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789130982.994126:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789130982.994159:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc860a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1876039508824448:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789130982.994254:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130982.994438:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508824448 00000100:00100000:2.0:1789130982.994448:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508824448 00000100:00100000:2.0:1789130982.994531:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1789130982.994542:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddca228000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1876039508824448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789130982.994579:0:8419:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789130982.996243:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc860b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508824704:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789130982.996317:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130982.996396:0:8418:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:0.0:1789130982.996407:0:8418:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:0.0:1789130982.996563:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508824704 00000100:00100000:0.0:1789130982.996571:0:8418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508824704 00000100:00100000:0.0:1789130982.996708:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1789130982.996718:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc86083c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508824704:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789130982.996743:0:14495:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789130982.996794:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc86083c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508824704:12345-0@lo:13:osp-pre-1-1.0 Request processed in 78us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130982.996801:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1789130982.996854:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc860b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508824704:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1789130982.996908:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789130982.999558:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddca228000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1876039508824448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 5003us (5288us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130982.999577:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1789130982.999850:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7fd2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508825216:0@lo:400:kworker.0 00000100:00100000:3.0:1789130982.999923:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130982.999966:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff8a7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508825728:0@lo:400:kworker.0 00000100:00100000:3.0:1789130982.999996:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130983.000022:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1789130983.000028:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff7c2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3625:1876039508824832:0@lo:400:kworker.0 00000100:00100000:3.0:1789130983.000083:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130983.000103:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7fd2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3625:1876039508825344:0@lo:400:kworker.0 00000100:00100000:2.0:1789130983.000148:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7fd3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508824960:0@lo:400:kworker.0 00000100:00100000:2.0:1789130983.000178:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130983.000196:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130983.000196:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7fd12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3627:1876039508825472:0@lo:400:kworker.0 00000100:00100000:3.0:1789130983.000216:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff8a52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3625:1876039508825856:0@lo:400:kworker.0 00000100:00100000:2.0:1789130983.000217:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130983.000235:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc845f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3627:1876039508825984:0@lo:400:kworker.0 00000100:00100000:3.0:1789130983.000238:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130983.000255:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130983.000331:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508825216 00000100:00100000:3.0:1789130983.000333:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508824960 00000100:00100000:3.0:1789130983.000340:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508824960 00000100:00100000:1.0:1789130983.000340:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508825216 00000100:00100000:0.0:1789130983.000433:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddca182940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3628:1876039508824576:0@lo:400:kworker.0 00000100:00100000:0.0:1789130983.000492:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130983.000699:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508824832 00000100:00100000:2.0:1789130983.000704:0:14273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508824832 00000100:00100000:2.0:1789130983.000734:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508825344 00000100:00100000:2.0:1789130983.000736:0:14273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508825344 00000100:00100000:2.0:1789130983.000761:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508825472 00000100:00100000:2.0:1789130983.000770:0:14273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508825472 00000100:00100000:2.0:1789130983.000788:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508825856 00000100:00100000:2.0:1789130983.000790:0:14273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508825856 00000100:00100000:2.0:1789130983.000801:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508825984 00000100:00100000:2.0:1789130983.000803:0:14273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508825984 00000100:00100000:2.0:1789130983.000819:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:2.0:1789130983.000828:0:14273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff8e0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1876039508824832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130983.001426:0:14273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff8e0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1876039508824832:12345-0@lo:400:kworker.0 Request processed in 595us (1348us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130983.001436:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:2.0:1789130983.001482:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1789130983.001493:0:14273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff8e2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1876039508825344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130983.001532:0:14273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff8e2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1876039508825344:12345-0@lo:400:kworker.0 Request processed in 43us (1335us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130983.001538:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1789130983.001550:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1789130983.001556:0:14273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01b38b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1876039508825472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130983.001589:0:14273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01b38b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1876039508825472:12345-0@lo:400:kworker.0 Request processed in 33us (1370us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130983.001595:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1789130983.001606:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:2.0:1789130983.001612:0:14273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff8e3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1876039508825856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130983.001637:0:14273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff8e3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1876039508825856:12345-0@lo:400:kworker.0 Request processed in 27us (1399us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130983.001643:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:2.0:1789130983.001654:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:2.0:1789130983.001660:0:14273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01b3b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3627:x1876039508825984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130983.001699:0:14273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01b3b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3627:x1876039508825984:12345-0@lo:400:kworker.0 Request processed in 39us (1442us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130983.001705:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00010000:00080000:2.0:1789130983.001750:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc7fd12c0 x1876039508825472/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130998 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789130983.001767:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7fd12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3627:1876039508825472:0@lo:400:kworker.0 00010000:00080000:2.0:1789130983.001780:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc845f0c0 x1876039508825984/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789130998 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789130983.001788:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc845f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3627:1876039508825984:0@lo:400:kworker.0 00000100:00080000:2.0:1789130983.001818:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789130983.001823:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789130983.001857:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508825728 00000100:00100000:2.0:1789130983.001862:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508825728 00000100:00100000:3.0:1789130983.002399:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1789130983.002412:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01b39680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508824960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130983.002470:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1789130983.002480:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01b39680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508824960:12345-0@lo:400:kworker.0 Request processed in 73us (2302us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130983.002480:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc845cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1876039508825216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130983.002487:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1789130983.002521:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc845cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1876039508825216:12345-0@lo:400:kworker.0 Request processed in 44us (2598us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130983.002524:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7fd3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508824960:0@lo:400:kworker.0 00000100:00100000:1.0:1789130983.002527:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1789130983.002547:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508824576 00000100:00100000:1.0:1789130983.002552:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508824576 00000100:00100000:3.0:1789130983.002557:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff7c2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3625:1876039508824832:0@lo:400:kworker.0 00000100:00100000:3.0:1789130983.002569:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7fd2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3625:1876039508825344:0@lo:400:kworker.0 00000100:00100000:1.0:1789130983.002578:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 439 00000100:00100000:3.0:1789130983.002581:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff8a52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3625:1876039508825856:0@lo:400:kworker.0 00000100:00100000:1.0:1789130983.002584:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddcf4fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+24:3628:x1876039508824576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130983.002591:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7fd2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508825216:0@lo:400:kworker.0 00000100:00100000:1.0:1789130983.002614:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddcf4fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+24:3628:x1876039508824576:12345-0@lo:400:kworker.0 Request processed in 30us (2122us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130983.002619:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 439 00000100:00080000:3.0:1789130983.002644:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789130983.002760:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddca182940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3628:1876039508824576:0@lo:400:kworker.0 00000100:00100000:0.0:1789130983.002772:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7fd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3628:1876039508825088:0@lo:400:kworker.0 00000100:00100000:0.0:1789130983.002809:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130983.002841:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff8a4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1876039508825600:0@lo:400:kworker.0 00000100:00100000:0.0:1789130983.002865:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130983.002971:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508825600 00000100:00100000:1.0:1789130983.002975:0:9827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508825600 00000100:00100000:1.0:1789130983.003009:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789130983.003104:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc860a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1876039508824448:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1789130983.003141:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789130983.003330:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508825088 00000100:00100000:3.0:1789130983.003335:0:14273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508825088 00000100:00100000:1.0:1789130983.003344:0:9827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc86092c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3628:x1876039508825600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130983.003371:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1789130983.003377:0:14273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc860b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3628:x1876039508825088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130983.003420:0:14273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc860b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3628:x1876039508825088:12345-0@lo:400:kworker.0 Request processed in 43us (610us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130983.003435:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1789130983.003482:0:9827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc86092c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3628:x1876039508825600:12345-0@lo:400:kworker.0 Request processed in 444us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130983.003484:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7fd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3628:1876039508825088:0@lo:400:kworker.0 00000100:00100000:1.0:1789130983.003489:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00010000:00080000:3.0:1789130983.003498:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91ddff8a4f00 x1876039508825600/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789130999 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130983.003508:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff8a4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1876039508825600:0@lo:400:kworker.0 00000100:00100000:2.0:1789130983.003580:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789130983.003589:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff8e03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1876039508825728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130983.003637:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff8e03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1876039508825728:12345-0@lo:400:kworker.0 Request processed in 50us (3640us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130983.003643:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00010000:00080000:3.0:1789130983.006579:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91ddff8a7840 x1876039508825728/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789130998 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130983.006601:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff8a7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508825728:0@lo:400:kworker.0 00010000:00010000:2.0:1789130983.313873:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789130983.507867:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc860a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1876039508826112:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789130983.507976:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130983.511883:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508826112 00000100:00100000:0.0:1789130983.511901:0:8418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508826112 00000100:00100000:0.0:1789130983.512002:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1789130983.512015:0:8418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff8e1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1876039508826112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789130983.512067:0:8418:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789130983.512207:0:8418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff8e1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1876039508826112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 194us (4230us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130983.512216:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00010000:00080000:3.0:1789130983.515440:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc860a940 x1876039508826112/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789130999 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130983.515507:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc860a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1876039508826112:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789130984.020063:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789130984.020105:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01b39e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1876039508826240:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789130984.020197:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130984.020336:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508826240 00000100:00100000:3.0:1789130984.020346:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508826240 00000100:00100000:3.0:1789130984.020423:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1789130984.020435:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01b3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1876039508826240:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789130984.020482:0:8419:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789130984.020536:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01b3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1876039508826240:12345-0@lo:13:osp-pre-0-1.0 Request processed in 104us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130984.020543:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00010000:00080000:3.0:1789130984.020588:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91de01b39e00 x1876039508826240/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789131000 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130984.020628:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01b39e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1876039508826240:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1789130984.337998:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130985.362029:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789130986.066427:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789130986.066472:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff8e2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508826368:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789130986.066565:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130986.066849:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01a5c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1876039508826496:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789130986.066870:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508826368 00000100:00100000:1.0:1789130986.066881:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508826368 00000100:00100000:3.0:1789130986.066887:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130986.066937:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508826496 00000100:00100000:1.0:1789130986.066941:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508826496 00000100:00100000:1.0:1789130986.066966:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1789130986.067024:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc860b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508826368:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789130986.067077:0:6505:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789130986.067149:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc860b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508826368:12345-0@lo:41:osp-pre-0-1.0 Request processed in 127us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130986.067248:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff8e2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508826368:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789130986.072045:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1789130986.072092:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff8e0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3627:x1876039508826496:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789130986.073008:0:6506:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789130986.073398:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff8e0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3627:x1876039508826496:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1325us (6507us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130986.073410:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1789130986.076314:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01a5c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1876039508826496:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789130986.077651:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00010000:00010000:2.0:1789130986.386119:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789130987.358128:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789130987.358174:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789130987.358202:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789130987.358387:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498238592 00000100:00100000:0.0:1789130987.358399:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498238592 00000100:00100000:0.0:1789130987.358501:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 440 00000100:00100000:0.0:1789130987.358512:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddcf4f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+13:2386:x1876039498238592:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1789130987.358594:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddcf4f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+13:2386:x1876039498238592:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 84us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130987.358602:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 440 00000100:00100000:3.0:1789130987.358825:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498238848 00000100:00100000:3.0:1789130987.358830:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498238848 00000100:00100000:3.0:1789130987.358872:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498238720 00000100:00100000:3.0:1789130987.358875:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498238720 00000100:00100000:3.0:1789130987.358894:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 285 00000100:00100000:3.0:1789130987.358900:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01b392c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+5:2386:x1876039498238848:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1789130987.358934:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01b392c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+5:2386:x1876039498238848:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 36us (760us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130987.358940:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 285 00000100:00100000:3.0:1789130987.358963:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 286 00000100:00100000:3.0:1789130987.358969:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01b383c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+5:2386:x1876039498238720:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1789130987.358988:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01b383c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+5:2386:x1876039498238720:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 20us (786us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130987.358993:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 286 00000100:00080000:0.0:1789130987.359211:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789130987.359216:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789130987.362955:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789130987.363001:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789130987.363030:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789130987.363078:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498239104 00000100:00100000:3.0:1789130987.363108:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498239104 00000100:00100000:1.0:1789130987.363109:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498239232 00000100:00100000:1.0:1789130987.363115:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498239232 00000100:00100000:3.0:1789130987.363264:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 287 00000100:00100000:3.0:1789130987.363276:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01b39a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fde8d4a8-44db-4e6b-8249-c1c295e4901d+5:2385:x1876039498239104:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1789130987.363367:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01b39a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fde8d4a8-44db-4e6b-8249-c1c295e4901d+5:2385:x1876039498239104:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 92us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130987.363375:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 287 00000100:00100000:0.0:1789130987.363959:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498238976 00000100:00100000:0.0:1789130987.363965:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498238976 00000100:00100000:1.0:1789130987.365445:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 288 00000100:00080000:2.0:1789130987.365454:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789130987.365472:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789130987.365475:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789130987.365480:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01b39e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fde8d4a8-44db-4e6b-8249-c1c295e4901d+5:2385:x1876039498239232:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1789130987.365553:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01b39e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fde8d4a8-44db-4e6b-8249-c1c295e4901d+5:2385:x1876039498239232:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 96us (2522us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130987.365561:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 288 00000100:00100000:0.0:1789130987.367324:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 27 00000100:00100000:0.0:1789130987.367338:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01b3a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+5:2384:x1876039498238976:12345-192.168.203.11@tcp:9:kworker.0 00000020:00000080:0.0:1789130987.367371:0:8416:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf3fe2838e1fc2442 00000100:00080000:0.0:1789130987.367382:0:8416:0:(import.c:65:import_set_state_nolock()) ffff91dcc78a4800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789130987.367448:0:8416:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00100000:0.0:1789130987.367639:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01b3a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+2:2384:x1876039498238976:12345-192.168.203.11@tcp:9:kworker.0 Request processed in 303us (4695us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130987.367649:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 27 00010000:00010000:3.0:1789130987.367694:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130987.411318:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789130988.114126:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01a5ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1876039508826624:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789130988.114230:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130988.115193:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508826624 00000100:00100000:1.0:1789130988.115205:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508826624 00000100:00100000:1.0:1789130988.115350:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1789130988.115364:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc860a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1876039508826624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789130988.115407:0:14495:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789130988.115510:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc860a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1876039508826624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 149us (1280us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130988.115536:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1789130988.115617:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01a5ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1876039508826624:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789130988.116489:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff8e21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508826752:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789130988.116536:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc845f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3626:1876039508826880:0@lo:400:kworker.0 00000100:00100000:2.0:1789130988.116557:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130988.116585:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130988.116611:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7fd2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3625:1876039508827264:0@lo:400:kworker.0 00000100:00100000:2.0:1789130988.116643:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130988.116654:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7fd3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508827392:0@lo:400:kworker.0 00000100:00100000:2.0:1789130988.116664:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddc12abc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508827776:0@lo:400:kworker.0 00000100:00100000:1.0:1789130988.116693:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130988.116701:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130988.116714:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddc12aa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508827904:0@lo:400:kworker.0 00000100:00100000:2.0:1789130988.116728:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddc12a8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508828288:0@lo:400:kworker.0 00000100:00100000:1.0:1789130988.116735:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130988.116761:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130988.116801:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508826752 00000100:00100000:2.0:1789130988.116809:0:8418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508826752 00000100:00100000:1.0:1789130988.116826:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508826880 00000100:00100000:1.0:1789130988.116831:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508826880 00000100:00100000:1.0:1789130988.116864:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 441 00000100:00100000:1.0:1789130988.116869:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddcf4f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+24:3626:x1876039508826880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130988.116915:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508827264 00000100:00100000:1.0:1789130988.116921:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddcf4f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+24:3626:x1876039508826880:12345-0@lo:400:kworker.0 Request processed in 50us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130988.116922:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508827264 00000100:00100000:1.0:1789130988.116933:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 441 00000100:00100000:3.0:1789130988.116965:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1789130988.116971:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508827776 00000100:00100000:3.0:1789130988.116978:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc12a9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1876039508827264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130988.116978:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508827776 00000100:00100000:3.0:1789130988.117073:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc12a9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1876039508827264:12345-0@lo:400:kworker.0 Request processed in 99us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130988.117080:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:3.0:1789130988.117201:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508827392 00000100:00100000:3.0:1789130988.117206:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508827392 00000100:00100000:3.0:1789130988.117234:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1789130988.117241:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01a5ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508827392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130988.117325:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01a5ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508827392:12345-0@lo:400:kworker.0 Request processed in 38us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130988.117333:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1789130988.117373:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7fd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3627:1876039508827008:0@lo:400:kworker.0 00000100:00100000:3.0:1789130988.117404:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130988.117425:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7fd12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3627:1876039508827520:0@lo:400:kworker.0 00000100:00100000:3.0:1789130988.117449:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130988.117573:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddc12a8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3627:1876039508828032:0@lo:400:kworker.0 00000100:00100000:3.0:1789130988.117627:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130988.117804:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1789130988.117813:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7fd2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508827136:0@lo:400:kworker.0 00000100:00100000:3.0:1789130988.117853:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130988.117875:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddc12aad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3627:1876039508827648:0@lo:400:kworker.0 00000100:00100000:3.0:1789130988.117901:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130988.117919:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddc12a9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3627:1876039508828160:0@lo:400:kworker.0 00000100:00100000:3.0:1789130988.117942:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130988.117970:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508827008 00000100:00100000:3.0:1789130988.117975:0:14273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508827008 00000100:00100000:3.0:1789130988.117997:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508827520 00000100:00100000:3.0:1789130988.118000:0:14273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508827520 00000100:00080000:0.0:1789130988.119779:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789130988.119794:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789130988.119798:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789130988.119833:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508827904 00000100:00100000:0.0:1789130988.120570:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508827904 00000100:00100000:0.0:1789130988.120693:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508828288 00000100:00100000:0.0:1789130988.120698:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508828288 00000100:00100000:0.0:1789130988.120724:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789130988.120736:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01a5c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508827904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130988.120868:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01a5c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508827904:12345-0@lo:400:kworker.0 Request processed in 134us (4131us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130988.120877:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789130988.120897:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789130988.120910:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc12a92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3625:x1876039508828288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130988.120964:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508828032 00000100:00100000:0.0:1789130988.120970:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc12a92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3625:x1876039508828288:12345-0@lo:400:kworker.0 Request processed in 61us (4209us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130988.120972:0:14273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508828032 00000100:00100000:0.0:1789130988.120981:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1789130988.121001:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508827648 00000100:00100000:3.0:1789130988.121006:0:14273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508827648 00000100:00100000:0.0:1789130988.121014:0:11069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508827136 00000100:00100000:0.0:1789130988.121020:0:11069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508827136 00000100:00100000:3.0:1789130988.121032:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508828160 00000100:00100000:3.0:1789130988.121046:0:14273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508828160 00000100:00100000:0.0:1789130988.121068:0:11069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1789130988.121081:0:11069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff8a52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508827136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130988.121082:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:3.0:1789130988.121093:0:14273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff8e2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1876039508827008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130988.121145:0:14273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff8e2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1876039508827008:12345-0@lo:400:kworker.0 Request processed in 54us (3741us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130988.121156:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:3.0:1789130988.121173:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:3.0:1789130988.121180:0:14273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff8a7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1876039508827520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130988.121196:0:11069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff8a52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508827136:12345-0@lo:400:kworker.0 Request processed in 120us (3341us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130988.121204:0:11069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1789130988.121222:0:14273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff8a7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1876039508827520:12345-0@lo:400:kworker.0 Request processed in 42us (3771us total) trans 0 rc 0/0 00000100:00080000:0.0:1789130988.121228:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789130988.121232:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789130988.121235:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789130988.121245:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:3.0:1789130988.121259:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:3.0:1789130988.121266:0:14273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff8a4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3627:x1876039508828032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130988.121280:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1789130988.121291:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff7c2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1876039508827648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130988.121302:0:14273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff8a4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3627:x1876039508828032:12345-0@lo:400:kworker.0 Request processed in 35us (3674us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130988.121309:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:3.0:1789130988.121321:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:3.0:1789130988.121327:0:14273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8417c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3627:x1876039508828160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130988.121339:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff7c2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1876039508827648:12345-0@lo:400:kworker.0 Request processed in 49us (3435us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130988.121347:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:3.0:1789130988.121359:0:14273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8417c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3627:x1876039508828160:12345-0@lo:400:kworker.0 Request processed in 33us (3416us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130988.121364:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:3.0:1789130988.121420:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7fd2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508827136:0@lo:400:kworker.0 00000100:00100000:0.0:1789130988.121421:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc845f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3626:1876039508826880:0@lo:400:kworker.0 00010000:00080000:3.0:1789130988.121439:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91ddc12aad00 x1876039508827648/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789131004 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789130988.121446:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7fd3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508827392:0@lo:400:kworker.0 00000100:00100000:3.0:1789130988.121450:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddc12aad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3627:1876039508827648:0@lo:400:kworker.0 00010000:00080000:3.0:1789130988.121480:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91ddc12a9680 x1876039508828160/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789131004 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130988.121488:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddc12a9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3627:1876039508828160:0@lo:400:kworker.0 00010000:00080000:0.0:1789130988.121491:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91ddc12aa1c0 x1876039508827904/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789131004 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130988.121500:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7fd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3627:1876039508827008:0@lo:400:kworker.0 00000100:00100000:0.0:1789130988.121506:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddc12aa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508827904:0@lo:400:kworker.0 00000100:00100000:3.0:1789130988.121511:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7fd12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3627:1876039508827520:0@lo:400:kworker.0 00000100:00100000:3.0:1789130988.121520:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddc12a8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3627:1876039508828032:0@lo:400:kworker.0 00000100:00100000:3.0:1789130988.121592:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7fd2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3625:1876039508827264:0@lo:400:kworker.0 00000100:00100000:3.0:1789130988.121610:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddc12a8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508828288:0@lo:400:kworker.0 00000100:00100000:1.0:1789130988.121987:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789130988.121998:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc12ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508827776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130988.122091:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc12ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508827776:12345-0@lo:400:kworker.0 Request processed in 95us (5389us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130988.122098:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00010000:00080000:3.0:1789130988.122109:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91ddc12abc00 x1876039508827776/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789131004 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130988.122121:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddc12abc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508827776:0@lo:400:kworker.0 00000100:00100000:2.0:1789130988.122236:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1789130988.122246:0:8418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc12ab840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508826752:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789130988.122267:0:8418:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789130988.122316:0:8418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc12ab840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508826752:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (5760us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130988.122334:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1789130988.122394:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff8e21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508826752:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1789130988.433798:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789130988.625839:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789130988.625871:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8608f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508828416:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789130988.625959:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130988.626175:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508828416 00000100:00100000:0.0:1789130988.626186:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508828416 00000100:00100000:0.0:1789130988.626273:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1789130988.626285:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8416d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1876039508828416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789130988.626328:0:8419:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789130988.626404:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8416d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1876039508828416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 120us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130988.626411:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00010000:00080000:3.0:1789130988.626504:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc8608f00 x1876039508828416/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789131004 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130988.626536:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8608f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508828416:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789130989.140283:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddc12a83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508828544:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789130989.140384:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130989.140690:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508828544 00000100:00100000:0.0:1789130989.140702:0:8418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508828544 00000100:00100000:0.0:1789130989.140783:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1789130989.140794:0:8418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc84161c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508828544:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789130989.140865:0:8418:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789130989.140952:0:8418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc84161c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508828544:12345-0@lo:13:osp-pre-0-1.0 Request processed in 159us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130989.140961:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00010000:00080000:2.0:1789130989.141101:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91ddc12a83c0 x1876039508828544/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789131005 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789130989.141123:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddc12a83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508828544:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1789130989.459977:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130990.482229:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789130991.185775:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789130991.185806:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddc12a83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1876039508828672:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789130991.185903:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130991.186453:0:11069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508828672 00000100:00100000:0.0:1789130991.186524:0:11069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508828672 00000100:00100000:0.0:1789130991.186591:0:11069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1789130991.186602:0:11069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc12aa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3627:x1876039508828672:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789130991.186650:0:11069:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789130991.186888:0:11069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc12aa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3627:x1876039508828672:12345-0@lo:41:osp-pre-1-0.0 Request processed in 287us (985us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130991.186898:0:11069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1789130991.186942:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8416940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508828800:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789130991.186979:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130991.187038:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508828800 00000100:00100000:0.0:1789130991.187042:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508828800 00000100:00100000:0.0:1789130991.187069:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1789130991.187334:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8608f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508828800:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789130991.187360:0:6505:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789130991.187581:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddc12a83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1876039508828672:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789130991.191664:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8608f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508828800:12345-0@lo:41:osp-pre-0-1.0 Request processed in 4316us (4667us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130991.191828:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8416940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508828800:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789130991.195332:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00010000:00010000:2.0:1789130991.506165:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789130992.146196:0:14478:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1789130992.148274:0:14475:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789130992.478311:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789130992.479370:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498239360 00000100:00100000:3.0:1789130992.479384:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498239360 00000100:00100000:3.0:1789130992.479839:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 442 00000100:00100000:3.0:1789130992.480205:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddcf4fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+13:2387:x1876039498239360:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1789130992.480348:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddcf4fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+13:2387:x1876039498239360:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 148us (2047us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130992.482192:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789130992.482602:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789130992.484360:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498239488 00000100:00100000:0.0:1789130992.484377:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498239488 00000100:00100000:0.0:1789130992.484453:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498239616 00000100:00100000:0.0:1789130992.484456:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498239616 00000100:00100000:0.0:1789130992.484503:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 295 00000100:00100000:0.0:1789130992.484515:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc12aa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+5:2387:x1876039498239488:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1789130992.484613:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc12aa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+5:2387:x1876039498239488:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 101us (2429us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130992.484621:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 295 00000100:00100000:0.0:1789130992.484642:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 296 00000100:00100000:0.0:1789130992.484650:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc12a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+5:2388:x1876039498239616:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1789130992.485112:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc12a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+5:2388:x1876039498239616:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 460us (2508us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130992.485119:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 296 00000100:00080000:0.0:1789130992.485146:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789130992.485151:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789130992.485789:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 442 00000100:00100000:3.0:1789130992.490393:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789130992.490434:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789130992.490855:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498239744 00000100:00100000:3.0:1789130992.490866:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498239744 00000100:00080000:1.0:1789130992.490926:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789130992.490953:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498239872 00000100:00100000:3.0:1789130992.490957:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498239872 00000100:00100000:3.0:1789130992.490995:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 297 00000100:00100000:3.0:1789130992.491017:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8416940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fde8d4a8-44db-4e6b-8249-c1c295e4901d+5:2388:x1876039498239744:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1789130992.491120:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8416940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fde8d4a8-44db-4e6b-8249-c1c295e4901d+5:2388:x1876039498239744:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 115us (735us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130992.491128:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 297 00000100:00100000:3.0:1789130992.491149:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 298 00000100:00100000:3.0:1789130992.491155:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8414b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fde8d4a8-44db-4e6b-8249-c1c295e4901d+5:2388:x1876039498239872:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1789130992.491181:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8414b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fde8d4a8-44db-4e6b-8249-c1c295e4901d+5:2388:x1876039498239872:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 26us (748us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130992.491188:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 298 00000100:00080000:1.0:1789130992.491402:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1789130992.532205:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789130993.234237:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7ffed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3627:1876039508829056:0@lo:400:kworker.0 00000100:00100000:1.0:1789130993.234342:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130993.234413:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc86a4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3627:1876039508829568:0@lo:400:kworker.0 00000100:00100000:1.0:1789130993.234440:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130993.234493:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc86a52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3627:1876039508830080:0@lo:400:kworker.0 00000100:00100000:2.0:1789130993.234498:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7ffcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3626:1876039508828928:0@lo:400:kworker.0 00000100:00100000:1.0:1789130993.234523:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130993.234576:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1789130993.234583:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7ffc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508829184:0@lo:400:kworker.0 00000100:00100000:3.0:1789130993.234629:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc86a4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3625:1876039508829312:0@lo:400:kworker.0 00000100:00100000:0.0:1789130993.235265:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508829056 00000100:00100000:0.0:1789130993.235285:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508829056 00000100:00100000:0.0:1789130993.235340:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508829568 00000100:00100000:0.0:1789130993.235344:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508829568 00000100:00100000:0.0:1789130993.235390:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508830080 00000100:00100000:0.0:1789130993.235394:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508830080 00000100:00100000:0.0:1789130993.235413:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:0.0:1789130993.235422:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc86a70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1876039508829056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130993.236755:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130993.236779:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130993.236831:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc86a7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3627:1876039508829696:0@lo:400:kworker.0 00000100:00100000:2.0:1789130993.236832:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc86a5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508829440:0@lo:400:kworker.0 00000100:00100000:2.0:1789130993.236878:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130993.236899:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc86a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508829952:0@lo:400:kworker.0 00000100:00100000:2.0:1789130993.236935:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130993.236948:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130993.236969:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc86a5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508830464:0@lo:400:kworker.0 00000100:00100000:1.0:1789130993.236974:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc86a43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3627:1876039508830208:0@lo:400:kworker.0 00000100:00100000:2.0:1789130993.237018:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130993.237025:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130993.237058:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc845f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1876039508830592:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789130993.237086:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789130993.237145:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789130993.237165:0:11069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508829184 00000100:00100000:1.0:1789130993.237171:0:11069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508829184 00000100:00100000:1.0:1789130993.237341:0:11069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508829440 00000100:00100000:1.0:1789130993.237346:0:11069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508829440 00000100:00100000:1.0:1789130993.237367:0:11069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1789130993.237377:0:11069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc86a4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508829184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130993.238288:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508829952 00000100:00100000:2.0:1789130993.238298:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508829952 00000100:00100000:2.0:1789130993.238349:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508830464 00000100:00100000:2.0:1789130993.238353:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508830464 00000100:00100000:1.0:1789130993.238373:0:11069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc86a4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508829184:12345-0@lo:400:kworker.0 Request processed in 993us (1592us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130993.238386:0:11069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1789130993.238401:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789130993.238411:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc12a8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508829952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130993.238417:0:11069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1789130993.238437:0:11069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc12a9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508829440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130993.239395:0:11069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc12a9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508829440:12345-0@lo:400:kworker.0 Request processed in 957us (2512us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130993.239407:0:11069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1789130993.239449:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508830592 00000100:00100000:1.0:1789130993.239455:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508830592 00000100:00100000:1.0:1789130993.239510:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1789130993.239518:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc86a61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3627:x1876039508830592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789130993.239614:0:14495:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789130993.239656:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc86a61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3627:x1876039508830592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 139us (2569us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130993.239664:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1789130993.239688:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789130993.239696:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc12a83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508830464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130993.239729:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc12a83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508830464:12345-0@lo:400:kworker.0 Request processed in 35us (2712us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130993.239735:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00080000:1.0:1789130993.239758:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789130993.239763:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:1.0:1789130993.240764:0:9493:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of b99c111d-b9b6-4590-88e4-9fefd4d4c3a4 00000020:00000080:1.0:1789130993.240771:0:9493:0:(genops.c:885:class_export_put()) final put ffff91dcc78a2800/b99c111d-b9b6-4590-88e4-9fefd4d4c3a4 00000100:00100000:1.0:1789130993.240914:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc86a5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508829440:0@lo:400:kworker.0 00000100:00100000:1.0:1789130993.240937:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc86a5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508830464:0@lo:400:kworker.0 00000020:00000080:1.0:1789130993.241152:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff91dcc78a2800/b99c111d-b9b6-4590-88e4-9fefd4d4c3a4 for lustre-OST0001 00000020:00000080:1.0:1789130993.241201:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff91dcc78a4800 for lustre-OST0001 00000100:00100000:1.0:1789130993.241486:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc845f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1876039508830592:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789130993.241503:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7ffc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508829184:0@lo:400:kworker.0 00000100:00100000:1.0:1789130993.241523:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789130993.241541:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddc12abc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508830720:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789130993.241589:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130993.241635:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc86a5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508829824:0@lo:400:kworker.0 00000100:00100000:1.0:1789130993.241667:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130993.241679:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130993.241720:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508830720 00000100:00100000:3.0:1789130993.241727:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508830720 00000100:00100000:1.0:1789130993.241754:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508829696 00000100:00100000:1.0:1789130993.241760:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508829696 00000100:00100000:3.0:1789130993.241792:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1789130993.241794:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508830208 00000100:00100000:1.0:1789130993.241799:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508830208 00000100:00100000:3.0:1789130993.241803:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc86a5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508830720:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789130993.241817:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508829312 00000100:00100000:1.0:1789130993.241821:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508829312 00002000:00000024:3.0:1789130993.241853:0:8419:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789130993.241910:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc86a5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508830720:12345-0@lo:13:osp-pre-1-1.0 Request processed in 110us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130993.241918:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00080000:3.0:1789130993.241944:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789130993.241950:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789130993.241960:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508829824 00000100:00100000:3.0:1789130993.241964:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508829824 00000100:00100000:0.0:1789130993.241968:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc86a70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1876039508829056:12345-0@lo:400:kworker.0 Request processed in 6543us (7623us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130993.241995:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:3.0:1789130993.241996:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1789130993.242020:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc86a6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1876039508829568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130993.242021:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7fd12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508829824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130993.242070:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7fd12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508829824:12345-0@lo:400:kworker.0 Request processed in 53us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130993.242077:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1789130993.242086:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc86a6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1876039508829568:12345-0@lo:400:kworker.0 Request processed in 70us (7644us total) trans 0 rc 0/0 00000100:00080000:3.0:1789130993.242095:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789130993.242202:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddc12abc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508830720:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789130993.242218:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7ffed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3627:1876039508829056:0@lo:400:kworker.0 00000100:00100000:3.0:1789130993.242229:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc86a4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3627:1876039508829568:0@lo:400:kworker.0 00010000:00080000:3.0:1789130993.242266:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc86a5e00 x1876039508829824/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789131009 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130993.242277:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc86a5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508829824:0@lo:400:kworker.0 00000100:00100000:3.0:1789130993.242284:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc86a6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508830336:0@lo:400:kworker.0 00000100:00100000:3.0:1789130993.242307:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130993.242325:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508830336 00000100:00100000:3.0:1789130993.242328:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508830336 00000100:00100000:3.0:1789130993.242345:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789130993.242358:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7fd0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508830336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130993.242390:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7fd0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508830336:12345-0@lo:400:kworker.0 Request processed in 33us (82us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130993.242397:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789130993.242420:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc86a6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508830336:0@lo:400:kworker.0 00000100:00100000:3.0:1789130993.242654:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508828928 00000100:00100000:3.0:1789130993.242660:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508828928 00000100:00100000:3.0:1789130993.242691:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 443 00000100:00100000:3.0:1789130993.242699:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddcf4fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+24:3626:x1876039508828928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130993.242741:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddcf4fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+24:3626:x1876039508828928:12345-0@lo:400:kworker.0 Request processed in 44us (5995us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130993.242748:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 443 00000100:00100000:3.0:1789130993.242790:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7ffcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3626:1876039508828928:0@lo:400:kworker.0 00000100:00100000:2.0:1789130993.243221:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc12a8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508829952:12345-0@lo:400:kworker.0 Request processed in 4809us (6282us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130993.243231:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00010000:00080000:3.0:1789130993.243343:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc86a7480 x1876039508829952/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789131009 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130993.243354:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc86a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508829952:0@lo:400:kworker.0 00000100:00100000:0.0:1789130993.243821:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:0.0:1789130993.243981:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:0.0:1789130993.243997:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc86a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3627:x1876039508830080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130993.244083:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc86a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3627:x1876039508830080:12345-0@lo:400:kworker.0 Request processed in 92us (9560us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130993.244090:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:0.0:1789130993.244105:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:0.0:1789130993.244114:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc86a6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1876039508829696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130993.244145:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc86a6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1876039508829696:12345-0@lo:400:kworker.0 Request processed in 33us (7198us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130993.244152:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:0.0:1789130993.244168:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:0.0:1789130993.244174:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc86a7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3627:x1876039508830208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130993.244205:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc86a7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3627:x1876039508830208:12345-0@lo:400:kworker.0 Request processed in 31us (7182us total) trans 0 rc 0/0 00010000:00080000:3.0:1789130993.244372:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc86a7840 x1876039508829696/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789131009 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130993.244386:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc86a7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3627:1876039508829696:0@lo:400:kworker.0 00010000:00080000:3.0:1789130993.244399:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc86a43c0 x1876039508830208/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789131009 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130993.244408:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc86a43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3627:1876039508830208:0@lo:400:kworker.0 00000100:00100000:3.0:1789130993.244420:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc86a52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3627:1876039508830080:0@lo:400:kworker.0 00000100:00100000:0.0:1789130993.245398:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:0.0:1789130993.245441:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:0.0:1789130993.245453:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7fd2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1876039508829312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130993.245615:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7fd2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1876039508829312:12345-0@lo:400:kworker.0 Request processed in 165us (4027us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130993.245634:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:3.0:1789130993.245775:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc86a4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3625:1876039508829312:0@lo:400:kworker.0 00000100:00100000:1.0:1789130993.246196:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00010000:00010000:2.0:1789130993.554113:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789130993.747763:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789130993.747792:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7fd3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508830848:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789130993.747882:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130993.747957:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508830848 00000100:00100000:3.0:1789130993.747968:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508830848 00000100:00100000:3.0:1789130993.748035:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1789130993.748046:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7fd2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508830848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789130993.748086:0:8419:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789130993.748146:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7fd2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508830848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130993.748154:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00010000:00080000:3.0:1789130993.748200:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc7fd3c00 x1876039508830848/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789131009 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789130993.748233:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7fd3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508830848:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789130994.262789:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789130994.262821:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddc12a8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508830976:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789130994.262916:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789130994.263056:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508830976 00000100:00100000:2.0:1789130994.263067:0:8418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508830976 00000100:00100000:2.0:1789130994.263131:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1789130994.263143:0:8418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc86a5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508830976:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789130994.263173:0:8418:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789130994.263239:0:8418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc86a5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508830976:12345-0@lo:13:osp-pre-0-1.0 Request processed in 98us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130994.263247:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00010000:00080000:1.0:1789130994.263385:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91ddc12a8f00 x1876039508830976/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789131010 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789130994.263417:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddc12a8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508830976:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1789130994.579508:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789130995.601952:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789130996.307642:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789130996.307674:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7fd3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1876039508831104:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789130996.307767:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130996.308046:0:11069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508831104 00000100:00100000:3.0:1789130996.308057:0:11069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508831104 00000100:00100000:3.0:1789130996.308124:0:11069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1789130996.308136:0:11069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc845f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3628:x1876039508831104:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789130996.308185:0:11069:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789130996.308362:0:11069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc845f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3628:x1876039508831104:12345-0@lo:41:osp-pre-0-1.0 Request processed in 228us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130996.308370:0:11069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1789130996.308564:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789130996.308578:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddc12a9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1876039508831232:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789130996.308614:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130996.308792:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7fd3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1876039508831104:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789130996.315567:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508831232 00000100:00100000:3.0:1789130996.315586:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508831232 00000100:00100000:3.0:1789130996.315673:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1789130996.315685:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc86a52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1876039508831232:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789130996.315740:0:6505:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789130996.315827:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc86a52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1876039508831232:12345-0@lo:41:osp-pre-1-0.0 Request processed in 144us (7210us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130996.315835:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1789130996.317337:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddc12a9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1876039508831232:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789130996.625944:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789130997.598101:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789130997.598149:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789130997.598232:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789130997.598262:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498240128 00000100:00100000:0.0:1789130997.598271:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498240128 00000100:00100000:0.0:1789130997.598328:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498240256 00000100:00100000:0.0:1789130997.598332:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498240256 00000100:00100000:0.0:1789130997.598351:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 305 00000100:00100000:0.0:1789130997.598360:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddca182940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+5:2386:x1876039498240128:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1789130997.598433:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddca182940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+5:2386:x1876039498240128:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 74us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130997.598441:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 305 00000100:00100000:0.0:1789130997.598492:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 306 00000100:00100000:0.0:1789130997.598500:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc5fe83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+5:2385:x1876039498240256:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1789130997.598526:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc5fe83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+5:2385:x1876039498240256:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 28us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130997.598532:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 306 00000100:00100000:3.0:1789130997.598807:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498240000 00000100:00100000:3.0:1789130997.598812:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498240000 00000100:00100000:3.0:1789130997.598911:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 444 00000100:00100000:3.0:1789130997.598919:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddcf4f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+13:2385:x1876039498240000:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1789130997.598947:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddcf4f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+13:2385:x1876039498240000:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 30us (856us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130997.598952:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 444 00000100:00080000:3.0:1789130997.598989:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789130997.598993:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789130997.599020:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789130997.599074:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789130997.599134:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498240384 00000100:00100000:3.0:1789130997.599137:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498240384 00000100:00100000:3.0:1789130997.599164:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498240512 00000100:00100000:3.0:1789130997.599168:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498240512 00000100:00100000:3.0:1789130997.599195:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 307 00000100:00100000:3.0:1789130997.599203:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7fd3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fde8d4a8-44db-4e6b-8249-c1c295e4901d+5:2386:x1876039498240384:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1789130997.599237:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7fd3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fde8d4a8-44db-4e6b-8249-c1c295e4901d+5:2386:x1876039498240384:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 35us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130997.599244:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 307 00000100:00100000:3.0:1789130997.599257:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 308 00000100:00100000:3.0:1789130997.599277:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff8e21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fde8d4a8-44db-4e6b-8249-c1c295e4901d+5:2385:x1876039498240512:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1789130997.599304:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff8e21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fde8d4a8-44db-4e6b-8249-c1c295e4901d+5:2385:x1876039498240512:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 29us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130997.599310:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 308 00000100:00080000:3.0:1789130997.599326:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789130997.599329:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789130997.650816:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789130998.095611:0:14739:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 08:49:55 (1789130995) 00000100:00100000:0.0:1789130998.356977:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc86a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3626:1876039508831488:0@lo:400:kworker.0 00000100:00100000:0.0:1789130998.357041:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130998.357096:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc86a4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508832000:0@lo:400:kworker.0 00000100:00100000:0.0:1789130998.357121:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130998.357160:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7ffed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508832512:0@lo:400:kworker.0 00000100:00100000:0.0:1789130998.357185:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130998.357202:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd1df9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508833024:0@lo:400:kworker.0 00000100:00100000:0.0:1789130998.357223:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130998.357247:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:0.0:1789130998.357252:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc86a7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3626:1876039508831360:0@lo:400:kworker.0 00000100:00100000:0.0:1789130998.357280:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789130998.357298:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508831488 00000100:00100000:3.0:1789130998.357307:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508831488 00000100:00100000:0.0:1789130998.357310:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff752580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508831872:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789130998.357332:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130998.357349:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7ffcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1876039508832384:0@lo:400:kworker.0 00000100:00100000:0.0:1789130998.357368:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130998.357383:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd1dfb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1876039508832896:0@lo:400:kworker.0 00000100:00100000:3.0:1789130998.357414:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:3.0:1789130998.357425:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff753c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1876039508831488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789130998.358037:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508831360 00000100:00100000:2.0:1789130998.358044:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508831360 00000100:00100000:2.0:1789130998.358085:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 445 00000100:00100000:2.0:1789130998.358094:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddcf4f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+24:3626:x1876039508831360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130998.365683:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff753c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1876039508831488:12345-0@lo:400:kworker.0 Request processed in 8251us (8633us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130998.365697:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:3.0:1789130998.365746:0:11069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508832000 00000100:00100000:3.0:1789130998.365754:0:11069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508832000 00000100:00100000:3.0:1789130998.365797:0:11069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1789130998.365804:0:11069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddca0c4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508832000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130998.365855:0:11069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddca0c4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508832000:12345-0@lo:400:kworker.0 Request processed in 51us (8734us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130998.365861:0:11069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1789130998.365878:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508832512 00000100:00100000:3.0:1789130998.365881:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508832512 00000100:00100000:2.0:1789130998.366444:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddcf4f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+24:3626:x1876039508831360:12345-0@lo:400:kworker.0 Request processed in 8254us (9066us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130998.366470:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 445 00000100:00100000:3.0:1789130998.367629:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508833024 00000100:00100000:3.0:1789130998.367636:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508833024 00000100:00100000:3.0:1789130998.367656:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508832384 00000100:00100000:3.0:1789130998.367659:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508832384 00000100:00100000:3.0:1789130998.367675:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1789130998.367682:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7c6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508832512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130998.367744:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7c6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508832512:12345-0@lo:400:kworker.0 Request processed in 62us (10557us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130998.367752:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1789130998.367767:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1789130998.367773:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7c692c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508833024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130998.367800:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7c692c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508833024:12345-0@lo:400:kworker.0 Request processed in 27us (10576us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130998.367805:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1789130998.367816:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1789130998.367822:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7c6bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1876039508832384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789130998.367846:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7c6bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1876039508832384:12345-0@lo:400:kworker.0 Request processed in 25us (10478us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130998.367852:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1789130998.367926:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508831872 00000100:00100000:3.0:1789130998.367929:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508831872 00000100:00100000:3.0:1789130998.367952:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1789130998.367959:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7c6ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508831872:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789130998.367989:0:14495:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789130998.368023:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7c6ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508831872:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (10690us total) trans 0 rc 0/0 00000100:00100000:3.0:1789130998.368029:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00080000:3.0:1789130998.368330:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789130998.368334:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789130998.368871:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1789130998.368929:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc7ffed00 x1876039508832512/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789131014 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789130998.368944:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7ffed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508832512:0@lo:400:kworker.0 00000100:00100000:0.0:1789130998.368957:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd1df9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508833024:0@lo:400:kworker.0 00000100:00100000:0.0:1789130998.368980:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc86a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3626:1876039508831488:0@lo:400:kworker.0 00000100:00100000:0.0:1789130998.369002:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc86a4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508832000:0@lo:400:kworker.0 00000100:00100000:0.0:1789130998.369028:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc86a7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3626:1876039508831360:0@lo:400:kworker.0 00000100:00100000:0.0:1789130998.369043:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff752580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508831872:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1789130998.369051:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc7ffcb40 x1876039508832384/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789131014 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789130998.369060:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7ffcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1876039508832384:0@lo:400:kworker.0 00000100:00100000:0.0:1789130998.369082:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc86a6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508831616:0@lo:400:kworker.0 00000100:00100000:0.0:1789130998.369115:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130998.369189:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc86a43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3627:1876039508832128:0@lo:400:kworker.0 00000100:00100000:0.0:1789130998.369212:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130998.369230:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7ffc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3627:1876039508832640:0@lo:400:kworker.0 00000100:00100000:0.0:1789130998.369247:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130998.369261:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddc2e86940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508833152:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789130998.369280:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130998.369301:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789130998.369306:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc86a5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3627:1876039508831744:0@lo:400:kworker.0 00000100:00100000:0.0:1789130998.369324:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130998.369339:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc86a4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3627:1876039508832256:0@lo:400:kworker.0 00000100:00100000:0.0:1789130998.369356:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130998.369369:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd1df8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3627:1876039508832768:0@lo:400:kworker.0 00000100:00100000:0.0:1789130998.369385:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789130998.369412:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508832128 00000100:00100000:0.0:1789130998.369423:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508832128 00000100:00100000:0.0:1789130998.369454:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508832640 00000100:00100000:0.0:1789130998.369472:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508832640 00000100:00100000:0.0:1789130998.369484:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508831744 00000100:00100000:0.0:1789130998.369487:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508831744 00000100:00100000:0.0:1789130998.369496:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508832256 00000100:00100000:0.0:1789130998.369498:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508832256 00000100:00100000:0.0:1789130998.369510:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508832768 00000100:00100000:0.0:1789130998.369512:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508832768 00000100:00100000:0.0:1789130998.369527:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:0.0:1789130998.369534:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc86a7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1876039508832128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130998.369578:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc86a7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1876039508832128:12345-0@lo:400:kworker.0 Request processed in 45us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130998.369591:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:0.0:1789130998.369605:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:0.0:1789130998.369610:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc86a4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3627:x1876039508832640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130998.369634:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc86a4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3627:x1876039508832640:12345-0@lo:400:kworker.0 Request processed in 23us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130998.369639:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:0.0:1789130998.369648:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:0.0:1789130998.369653:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7ffcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1876039508831744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130998.369673:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7ffcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1876039508831744:12345-0@lo:400:kworker.0 Request processed in 20us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130998.369678:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:0.0:1789130998.369688:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:0.0:1789130998.369694:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7ffed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1876039508832256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130998.369730:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7ffed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1876039508832256:12345-0@lo:400:kworker.0 Request processed in 37us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130998.369744:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:0.0:1789130998.369755:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:0.0:1789130998.369759:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7817840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3627:x1876039508832768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130998.369785:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7817840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3627:x1876039508832768:12345-0@lo:400:kworker.0 Request processed in 26us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130998.369791:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:0.0:1789130998.369816:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508833152 00000100:00100000:0.0:1789130998.369819:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508833152 00000100:00100000:0.0:1789130998.369840:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1789130998.369846:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc86a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508833152:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789130998.369856:0:8419:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789130998.369881:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc86a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508833152:12345-0@lo:13:osp-pre-1-1.0 Request processed in 35us (601us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130998.369886:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1789130998.369915:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc86a5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3627:1876039508831744:0@lo:400:kworker.0 00010000:00080000:0.0:1789130998.369924:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc86a4f00 x1876039508832256/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789131014 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789130998.369933:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc86a4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3627:1876039508832256:0@lo:400:kworker.0 00010000:00080000:0.0:1789130998.369941:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91ddd1df8b40 x1876039508832768/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789131014 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789130998.369948:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd1df8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3627:1876039508832768:0@lo:400:kworker.0 00000100:00100000:0.0:1789130998.369955:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc86a43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3627:1876039508832128:0@lo:400:kworker.0 00000100:00100000:0.0:1789130998.369962:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7ffc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3627:1876039508832640:0@lo:400:kworker.0 00000100:00100000:0.0:1789130998.370001:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddc2e86940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508833152:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1789130998.370033:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789130998.370037:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789130998.370038:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789130998.370047:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508832896 00000100:00100000:0.0:1789130998.370050:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508832896 00000100:00100000:0.0:1789130998.370073:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1789130998.370079:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7c6b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1876039508832896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789130998.370122:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7c6b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1876039508832896:12345-0@lo:400:kworker.0 Request processed in 43us (1254us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130998.370129:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1789130998.370134:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508831616 00000100:00100000:1.0:1789130998.370140:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508831616 00000100:00100000:0.0:1789130998.370174:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd1dfb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1876039508832896:0@lo:400:kworker.0 00000100:00100000:1.0:1789130998.370178:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1789130998.370189:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff752580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508831616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789130998.370231:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff752580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508831616:12345-0@lo:400:kworker.0 Request processed in 44us (1115us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130998.370239:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc86a6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508831616:0@lo:400:kworker.0 00000100:00100000:1.0:1789130998.370240:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00010000:00010000:2.0:1789130998.674058:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789130998.865682:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddc2e84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1876039508833280:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789130998.865753:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130998.865886:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508833280 00000100:00100000:1.0:1789130998.865908:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508833280 00000100:00100000:1.0:1789130998.865954:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1789130998.866103:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7816940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1876039508833280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789130998.866132:0:8419:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789130998.868755:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7816940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1876039508833280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2782us (2991us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130998.868769:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00010000:00080000:0.0:1789130998.871342:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91ddc2e84000 x1876039508833280/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789131014 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789130998.871370:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddc2e84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1876039508833280:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789130999.379975:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789130999.380000:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddc12aa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1876039508833408:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789130999.380078:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789130999.380273:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508833408 00000100:00100000:1.0:1789130999.380281:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508833408 00000100:00100000:1.0:1789130999.380328:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1789130999.380337:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7815a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1876039508833408:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789130999.380360:0:14495:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789130999.380413:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7815a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1876039508833408:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130999.380421:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00010000:00080000:0.0:1789130999.380912:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91ddc12aa1c0 x1876039508833408/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789131015 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789130999.380931:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddc12aa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1876039508833408:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1789130999.698727:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789130999.753646:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789130999.754173:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498240640 00000100:00100000:0.0:1789130999.754188:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498240640 00000100:00100000:0.0:1789130999.754283:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 40 00000100:00100000:0.0:1789130999.754296:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc2e84780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+5:11336:x1876039498240640:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789130999.754317:0:6502:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130999.754340:0:6502:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc2522 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d26995d expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130999.754402:0:6502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6200/0xf3fe2838e1fc2529 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130999.754415:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6200/0xf3fe2838e1fc2529 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130999.754430:0:6502:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6200/0xf3fe2838e1fc2529 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789130999.754447:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:0.0:1789130999.754516:0:6502:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789130999.754522:0:6502:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789130999.754562:0:6502:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6200/0xf3fe2838e1fc2529 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130999.754587:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc2522 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d26995d expref: 7 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130999.754605:0:6502:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6200/0xf3fe2838e1fc2529 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d26995d expref: 6 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130999.754614:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91ddcf5fff00) 00010000:00010000:0.0:1789130999.754630:0:6502:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789130999.754634:0:6502:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91de01ad6200, rc 0) 00000100:00100000:0.0:1789130999.754705:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc2e84780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+6:11336:x1876039498240640:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 413us (1074us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130999.754713:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 40 00000100:00100000:3.0:1789130999.769533:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789130999.772308:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498240768 00000100:00100000:0.0:1789130999.772322:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498240768 00000100:00100000:0.0:1789130999.772396:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 41 00000100:00100000:0.0:1789130999.772407:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc2e86d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+6:11337:x1876039498240768:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789130999.772425:0:9769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130999.772445:0:9769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc2530 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269964 expref: -99 pid: 9769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130999.772541:0:9769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6800/0xf3fe2838e1fc2537 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130999.772556:0:9769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6800/0xf3fe2838e1fc2537 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130999.772567:0:9769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6800/0xf3fe2838e1fc2537 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130999.772580:0:9769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6e00/0xf3fe2838e1fc253e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130999.772587:0:9769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6e00/0xf3fe2838e1fc253e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130999.772593:0:9769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6e00/0xf3fe2838e1fc253e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130999.772668:0:9769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7a00/0xf3fe2838e1fc2545 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130999.772677:0:9769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7a00/0xf3fe2838e1fc2545 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130999.772684:0:9769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7a00/0xf3fe2838e1fc2545 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130999.772721:0:9769:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789130999.772725:0:9769:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789130999.772743:0:9769:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7a00/0xf3fe2838e1fc2545 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130999.772755:0:9769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6800/0xf3fe2838e1fc2537 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130999.772761:0:9769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6800/0xf3fe2838e1fc2537 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130999.772767:0:9769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6800/0xf3fe2838e1fc2537 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130999.772773:0:9769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91de01ad6800 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:0.0:1789130999.772777:0:9769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6800/0xf3fe2838e1fc2537 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130999.772784:0:9769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6800/0xf3fe2838e1fc2537 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130999.772796:0:9769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91ddcf5fff00) 00010000:00010000:0.0:1789130999.772805:0:9769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130999.772811:0:9769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6800/0xf3fe2838e1fc2537 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130999.772816:0:9769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6800/0xf3fe2838e1fc2537 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130999.772830:0:9769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6e00/0xf3fe2838e1fc253e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130999.772835:0:9769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6e00/0xf3fe2838e1fc253e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130999.772840:0:9769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6e00/0xf3fe2838e1fc253e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130999.772844:0:9769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91de01ad6e00 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:0.0:1789130999.772846:0:9769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6e00/0xf3fe2838e1fc253e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130999.772851:0:9769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6e00/0xf3fe2838e1fc253e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130999.772858:0:9769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff91ddcf5ff500) 00010000:00010000:0.0:1789130999.772860:0:9769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130999.772862:0:9769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6e00/0xf3fe2838e1fc253e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130999.772867:0:9769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6e00/0xf3fe2838e1fc253e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130999.772897:0:9769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc2530 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269964 expref: 8 pid: 9769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130999.772922:0:9769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7a00/0xf3fe2838e1fc2545 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269964 expref: 7 pid: 9769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130999.772929:0:9769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff91ddcf5ff000) 00010000:00010000:0.0:1789130999.772932:0:9769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789130999.772936:0:9769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91de01ad7a00, rc 0) 00000100:00100000:0.0:1789130999.773018:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc2e86d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+7:11337:x1876039498240768:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 612us (3499us total) trans 0 rc 0/0 00000100:00100000:0.0:1789130999.773027:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 41 00000100:00100000:3.0:1789130999.793605:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789130999.793718:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498240896 00000100:00100000:2.0:1789130999.793732:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498240896 00000100:00100000:2.0:1789130999.793863:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 7 00000100:00100000:2.0:1789130999.793890:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc2e87c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+7:11337:x1876039498240896:12345-192.168.203.11@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1789130999.794009:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc2e87c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+7:11337:x1876039498240896:12345-192.168.203.11@tcp:900:lhsmtool_posix.0 Request processed in 121us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1789130999.794018:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 7 00000100:00100000:3.0:1789130999.809184:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789130999.813372:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498241152 00000100:00100000:0.0:1789130999.813387:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498241152 00000100:00100000:0.0:1789130999.813507:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 42 00000100:00100000:0.0:1789130999.813519:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc2e861c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+7:11337:x1876039498241152:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789130999.813539:0:6501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789130999.813559:0:6501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc254c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d26996b expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130999.813626:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6e00/0xf3fe2838e1fc2553 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130999.813639:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6e00/0xf3fe2838e1fc2553 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130999.813651:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6e00/0xf3fe2838e1fc2553 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130999.813706:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6800/0xf3fe2838e1fc255a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130999.813727:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6800/0xf3fe2838e1fc255a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130999.813735:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6800/0xf3fe2838e1fc255a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130999.813830:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6000/0xf3fe2838e1fc2561 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130999.813839:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6000/0xf3fe2838e1fc2561 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130999.813846:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6000/0xf3fe2838e1fc2561 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789130999.813856:0:6501:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1789130999.813935:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6e00/0xf3fe2838e1fc2553 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130999.813943:0:6501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6e00/0xf3fe2838e1fc2553 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130999.813950:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6e00/0xf3fe2838e1fc2553 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130999.813973:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91de01ad6e00 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:0.0:1789130999.813977:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6e00/0xf3fe2838e1fc2553 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130999.813986:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6e00/0xf3fe2838e1fc2553 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130999.814008:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff91ddcf5ff000) 00010000:00010000:0.0:1789130999.814011:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130999.814016:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6e00/0xf3fe2838e1fc2553 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130999.814022:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6e00/0xf3fe2838e1fc2553 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130999.814146:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6800/0xf3fe2838e1fc255a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130999.814154:0:6501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6800/0xf3fe2838e1fc255a lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130999.814160:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6800/0xf3fe2838e1fc255a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130999.814165:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91de01ad6800 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:0.0:1789130999.814167:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6800/0xf3fe2838e1fc255a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130999.814174:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6800/0xf3fe2838e1fc255a lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130999.814183:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff91ddcf5ff500) 00010000:00010000:0.0:1789130999.814185:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789130999.814189:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6800/0xf3fe2838e1fc255a lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789130999.814195:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6800/0xf3fe2838e1fc255a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130999.817623:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc254c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d26996b expref: 10 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130999.817651:0:6501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6000/0xf3fe2838e1fc2561 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d26996b expref: 9 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789130999.817672:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff91ddcf5ffa00) 00010000:00010000:1.0:1789130999.817675:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789130999.817678:0:6501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91de01ad6000, rc 0) 00000100:00100000:1.0:1789130999.817756:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc2e861c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+9:11337:x1876039498241152:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 4238us (8592us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1789130999.817765:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 42 00000100:00100000:3.0:1789130999.823345:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789130999.823428:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498241280 00000100:00100000:1.0:1789130999.823441:0:14273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498241280 00000100:00100000:1.0:1789130999.823545:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 43 00000100:00100000:1.0:1789130999.823556:0:14273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc2e84f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+9:11337:x1876039498241280:12345-192.168.203.11@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1789130999.823682:0:14273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc2e84f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+9:11337:x1876039498241280:12345-192.168.203.11@tcp:59:lhsmtool_posix.0 Request processed in 127us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130999.823701:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 43 00000100:00100000:3.0:1789130999.826359:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789130999.826445:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498241408 00000100:00100000:0.0:1789130999.826507:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498241408 00000100:00080000:3.0:1789130999.826586:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789130999.826599:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 44 00000100:00100000:0.0:1789130999.826612:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc2e85680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+5:11337:x1876039498241408:12345-192.168.203.11@tcp:59:lhsmtool_posix.0 00000004:00080000:3.0:1789130999.830355:0:9769:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 3702us 00000100:00100000:1.0:1789130999.870722:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc2e85680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+5:11337:x1876039498241408:12345-192.168.203.11@tcp:59:lhsmtool_posix.0 Request processed in 44101us (44363us total) trans 0 rc 0/0 00000100:00100000:1.0:1789130999.870736:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 44 00000040:00080000:3.0:1789131000.338719:0:14475:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1789131000.339109:0:14478:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789131000.732798:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789131001.425728:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789131001.425759:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc86a6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508833536:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789131001.425856:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131001.426045:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508833536 00000100:00100000:3.0:1789131001.426054:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508833536 00000100:00100000:3.0:1789131001.426112:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1789131001.426124:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc86a43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1876039508833536:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789131001.426174:0:6505:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789131001.426233:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc86a43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1876039508833536:12345-0@lo:41:osp-pre-1-0.0 Request processed in 111us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131001.426242:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1789131001.426266:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789131001.426277:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddc2e87840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1876039508833664:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789131001.426306:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131001.426337:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508833664 00000100:00100000:3.0:1789131001.426341:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508833664 00000100:00100000:3.0:1789131001.426378:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1789131001.426384:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc2e85e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3628:x1876039508833664:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789131001.426407:0:6506:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789131001.426445:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc2e85e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3628:x1876039508833664:12345-0@lo:41:osp-pre-0-1.0 Request processed in 61us (138us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131001.426452:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1789131001.426530:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddc2e87840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1876039508833664:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789131001.426585:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc86a6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508833536:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789131001.745764:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789131001.928539:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131001.929726:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498241536 00000100:00100000:3.0:1789131001.929742:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498241536 00000100:00100000:3.0:1789131001.929856:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 45 00000100:00100000:3.0:1789131001.929869:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd1dfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+9:11379:x1876039498241536:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:3.0:1789131001.929898:0:6501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789131001.929926:0:6501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5200/0xf3fe2838e1fc256f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269972 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131001.930025:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4800/0xf3fe2838e1fc2576 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131001.930053:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4800/0xf3fe2838e1fc2576 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131001.930067:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4800/0xf3fe2838e1fc2576 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131001.930086:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc257d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131001.930094:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc257d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131001.930100:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc257d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789131001.930306:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789131001.931334:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4800/0xf3fe2838e1fc2576 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131001.931362:0:6501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4800/0xf3fe2838e1fc2576 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131001.931369:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4800/0xf3fe2838e1fc2576 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131001.931377:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddfd0b4800 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:3.0:1789131001.931383:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4800/0xf3fe2838e1fc2576 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131001.931392:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4800/0xf3fe2838e1fc2576 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131001.931412:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91ddcf5fff00) 00010000:00010000:3.0:1789131001.931416:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789131001.931421:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4800/0xf3fe2838e1fc2576 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131001.931427:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4800/0xf3fe2838e1fc2576 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131001.931441:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc257d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131001.931447:0:6501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc257d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131001.931453:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc257d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131001.931488:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddfd0b5a00 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:3.0:1789131001.931499:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc257d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131001.931506:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc257d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131001.931514:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff91dded3a2700) 00010000:00010000:3.0:1789131001.931516:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789131001.931519:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc257d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131001.931524:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc257d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131001.931851:0:6501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5200/0xf3fe2838e1fc256f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269972 expref: 10 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131001.931864:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91ddcf5fff00) 00010000:00010000:3.0:1789131001.931866:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789131001.931870:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5200/0xf3fe2838e1fc256f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269972 expref: 10 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131001.931881:0:6501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ddfd0b5200, rc 0) 00000100:00100000:3.0:1789131001.932048:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd1dfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+9:11379:x1876039498241536:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 2172us (3515us total) trans 0 rc 301/301 00000100:00100000:3.0:1789131001.932058:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 45 00000100:00100000:0.0:1789131001.938481:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131001.938958:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498241792 00000100:00100000:3.0:1789131001.938973:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498241792 00000100:00100000:3.0:1789131001.939415:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 46 00000100:00100000:3.0:1789131001.939431:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc86a4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+9:11379:x1876039498241792:12345-192.168.203.11@tcp:36:lfs.0 00010000:00010000:3.0:1789131001.940201:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789131001.940245:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6200/0xf3fe2838e1fc2529 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d26995d expref: 9 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131001.940266:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91ddcf5fff00) 00010000:00010000:3.0:1789131001.940703:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789131001.940839:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5c00/0xf3fe2838e1fc2584 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131001.940858:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5c00/0xf3fe2838e1fc2584 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131001.941754:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5c00/0xf3fe2838e1fc2584 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131001.941784:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5e00/0xf3fe2838e1fc258b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131001.941794:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5e00/0xf3fe2838e1fc258b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131001.941802:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5e00/0xf3fe2838e1fc258b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131001.943490:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4400/0xf3fe2838e1fc2592 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131001.943515:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4400/0xf3fe2838e1fc2592 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131001.943528:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4400/0xf3fe2838e1fc2592 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789131001.944065:0:6500:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000e47f8727 reply state 000000002d9d83b4 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4400/0xf3fe2838e1fc2592 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131001.944084:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4400/0xf3fe2838e1fc2592 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131001.944093:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff91dded3a2b00) 00010000:00010000:3.0:1789131001.944096:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789131001.944101:0:6500:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789131001.944109:0:6500:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1789131001.944250:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5c00/0xf3fe2838e1fc2584 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131001.944259:0:6500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5c00/0xf3fe2838e1fc2584 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131001.944277:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5c00/0xf3fe2838e1fc2584 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131001.944285:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddfd0b5c00 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:3.0:1789131001.944290:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5c00/0xf3fe2838e1fc2584 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131001.944298:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5c00/0xf3fe2838e1fc2584 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131001.944319:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91dded3a2500) 00010000:00010000:3.0:1789131001.944323:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789131001.944327:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5c00/0xf3fe2838e1fc2584 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131001.944347:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5c00/0xf3fe2838e1fc2584 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789131001.944370:0:6500:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000e47f8727 reply state 000000002d9d83b4 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5e00/0xf3fe2838e1fc258b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131001.944379:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5e00/0xf3fe2838e1fc258b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131001.944385:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff91dded3a2f00) 00010000:00010000:3.0:1789131001.944387:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789131001.944390:0:6500:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1789131001.944561:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc86a4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+10:11379:x1876039498241792:12345-192.168.203.11@tcp:36:lfs.0 Request processed in 5130us (6111us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1789131001.944783:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 46 00000100:00100000:1.0:1789131002.036480:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789131002.036519:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498241920 00000100:00100000:1.0:1789131002.036528:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498241920 00000100:00100000:1.0:1789131002.036596:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 47 00000100:00100000:1.0:1789131002.036606:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd1df92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+10:11386:x1876039498241920:12345-192.168.203.11@tcp:101:lctl.0 00010000:00010000:1.0:1789131002.036643:0:9769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789131002.036669:0:9769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca000/0xf3fe2838e1fc2599 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269979 expref: -99 pid: 9769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131002.036733:0:9769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cba00/0xf3fe2838e1fc25a0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131002.036747:0:9769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cba00/0xf3fe2838e1fc25a0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131002.036758:0:9769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cba00/0xf3fe2838e1fc25a0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789131002.036799:0:9769:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789131002.036803:0:9769:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789131002.036839:0:9769:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cba00/0xf3fe2838e1fc25a0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131002.036861:0:9769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca000/0xf3fe2838e1fc2599 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269979 expref: 12 pid: 9769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131002.036880:0:9769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cba00/0xf3fe2838e1fc25a0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269979 expref: 11 pid: 9769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131002.036889:0:9769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91dcc7d6ac00) 00010000:00010000:1.0:1789131002.036892:0:9769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789131002.036896:0:9769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dcc85cba00, rc 0) 00000100:00100000:1.0:1789131002.036962:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd1df92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+11:11386:x1876039498241920:12345-192.168.203.11@tcp:101:lctl.0 Request processed in 357us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131002.036970:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 47 00000100:00100000:2.0:1789131002.108914:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131002.109189:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498242048 00000100:00100000:3.0:1789131002.109202:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498242048 00000100:00100000:3.0:1789131002.109304:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 48 00000100:00100000:3.0:1789131002.109316:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc12aad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+11:11393:x1876039498242048:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:3.0:1789131002.109343:0:6501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789131002.109370:0:6501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5c00/0xf3fe2838e1fc25a7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269980 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131002.109454:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5200/0xf3fe2838e1fc25ae lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131002.109500:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5200/0xf3fe2838e1fc25ae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131002.109535:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5200/0xf3fe2838e1fc25ae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131002.109656:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc25b5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131002.109664:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc25b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131002.109670:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc25b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131002.109761:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4800/0xf3fe2838e1fc25bc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131002.109768:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4800/0xf3fe2838e1fc25bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131002.109775:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4800/0xf3fe2838e1fc25bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789131002.109814:0:6501:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1789131002.109818:0:6501:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789131002.109863:0:6501:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4800/0xf3fe2838e1fc25bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131002.109876:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5200/0xf3fe2838e1fc25ae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131002.109882:0:6501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5200/0xf3fe2838e1fc25ae lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131002.109927:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5200/0xf3fe2838e1fc25ae lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131002.109934:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddfd0b5200 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:3.0:1789131002.109947:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5200/0xf3fe2838e1fc25ae lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131002.109957:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5200/0xf3fe2838e1fc25ae lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131002.109971:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91dcc7d6ac00) 00010000:00010000:3.0:1789131002.109974:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789131002.109981:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5200/0xf3fe2838e1fc25ae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131002.109988:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5200/0xf3fe2838e1fc25ae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131002.110000:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc25b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131002.110007:0:6501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc25b5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131002.110013:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc25b5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131002.110018:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddfd0b5a00 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:3.0:1789131002.110021:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc25b5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131002.110038:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc25b5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131002.110047:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff91dded3a2f00) 00010000:00010000:3.0:1789131002.110049:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789131002.110053:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc25b5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131002.110058:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc25b5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131002.110090:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5c00/0xf3fe2838e1fc25a7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269980 expref: 13 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131002.110105:0:6501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4800/0xf3fe2838e1fc25bc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269980 expref: 12 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131002.110113:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff91dded3a2b00) 00010000:00010000:3.0:1789131002.110115:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789131002.110117:0:6501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ddfd0b4800, rc 0) 00000100:00100000:3.0:1789131002.110234:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc12aad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+12:11393:x1876039498242048:12345-192.168.203.11@tcp:101:bash.0 Request processed in 920us (1334us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131002.110243:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 48 00000100:00100000:1.0:1789131002.121882:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131002.122089:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498242304 00000100:00100000:3.0:1789131002.122101:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498242304 00000100:00100000:3.0:1789131002.122185:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 49 00000100:00100000:3.0:1789131002.122198:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd1df83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+12:11393:x1876039498242304:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:3.0:1789131002.122248:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789131002.122277:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5c00/0xf3fe2838e1fc25c3 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269987 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131002.122422:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc25ca lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131002.122440:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc25ca lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131002.122453:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc25ca lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131002.122868:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5200/0xf3fe2838e1fc25d1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131002.122889:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5200/0xf3fe2838e1fc25d1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131002.122902:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5200/0xf3fe2838e1fc25d1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789131002.123290:0:6500:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2:0x0], index 0: 0 00010000:00010000:3.0:1789131002.123442:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4a00/0xf3fe2838e1fc25d8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131002.123452:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4a00/0xf3fe2838e1fc25d8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131002.124249:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4a00/0xf3fe2838e1fc25d8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131002.124306:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc25ca lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131002.124314:0:6500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc25ca lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131002.124321:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc25ca lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131002.124327:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddfd0b5a00 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:3.0:1789131002.124331:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc25ca lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131002.124339:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc25ca lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131002.124352:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff91dded3a2b00) 00010000:00010000:3.0:1789131002.124355:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789131002.124360:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc25ca lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131002.124365:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc25ca lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789131002.124379:0:6500:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000af003d29 reply state 000000006ce44fb5 transno 4294967313 ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5200/0xf3fe2838e1fc25d1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131002.124391:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5200/0xf3fe2838e1fc25d1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131002.124397:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff91dded3a2500) 00010000:00010000:3.0:1789131002.124404:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789131002.124408:0:6500:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789131002.124449:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5c00/0xf3fe2838e1fc25c3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269987 expref: 15 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131002.124493:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4a00/0xf3fe2838e1fc25d8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269987 expref: 14 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131002.124504:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff91dded3a2700) 00010000:00010000:3.0:1789131002.124507:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789131002.124510:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ddfd0b4a00, rc 0) 00000100:00100000:0.0:1789131002.127769:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd1df83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+15:11393:x1876039498242304:12345-192.168.203.11@tcp:101:bash.0 Request processed in 5564us (5893us total) trans 4294967313 rc 0/0 00000100:00100000:0.0:1789131002.127781:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 49 00000100:00100000:2.0:1789131002.132839:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131002.133052:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498242432 00000100:00100000:3.0:1789131002.133066:0:9827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498242432 00000100:00100000:3.0:1789131002.133168:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 28 00000100:00100000:3.0:1789131002.133180:0:9827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc12aa1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2384:x1876039498242432:12345-192.168.203.11@tcp:8:bash.0 00010000:00080000:3.0:1789131002.133224:0:9827:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from b99c111d-b9b6-4590-88e4-9fefd4d4c3a4@192.168.203.11@tcp t0 exp 0000000000000000 cur 358 last 0 00000020:00000080:3.0:1789131002.133263:0:9827:0:(genops.c:1385:class_connect()) connect: client b99c111d-b9b6-4590-88e4-9fefd4d4c3a4, cookie 0xf3fe2838e1fc25e6 00002000:00100000:3.0:1789131002.133279:0:9827:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli b99c111d-b9b6-4590-88e4-9fefd4d4c3a4/ffff91ddc2e93000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113984 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789131002.133303:0:9827:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type 37, return 37 00002000:00080000:3.0:1789131002.133410:0:9827:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789131002.133514:0:9827:0:(import.c:65:import_set_state_nolock()) ffff91ddc2e92800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789131002.133622:0:9827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc12aa1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+6:2384:x1876039498242432:12345-192.168.203.11@tcp:8:bash.0 Request processed in 441us (798us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131002.133630:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 28 00000100:00100000:2.0:1789131002.137653:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131002.137971:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498242560 00000100:00100000:0.0:1789131002.137984:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498242560 00000100:00100000:0.0:1789131002.138116:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 29 00000100:00100000:0.0:1789131002.138129:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc12a9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+6:0:x1876039498242560:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:0.0:1789131002.138163:0:8417:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789131002.138193:0:8417:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004728ce7c/0xf3fe2838e1fc25ed lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d26998e expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789131002.138226:0:8417:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789131002.138250:0:8417:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=358s v=(0 0) 00010000:00010000:0.0:1789131002.138256:0:8417:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789131002.138267:0:8417:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004728ce7c/0xf3fe2838e1fc25ed lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d26998e expref: 7 pid: 8417 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131002.138316:0:8417:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004728ce7c/0xf3fe2838e1fc25ed lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d26998e expref: 7 pid: 8417 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131002.138331:0:8417:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91de01ad6600, rc 0) 00000100:00100000:0.0:1789131002.138405:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc12a9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+7:0:x1876039498242560:12345-192.168.203.11@tcp:101:bash.0 Request processed in 279us (768us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131002.138414:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 29 00000100:00080000:1.0:1789131002.141982:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789131002.146274:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789131002.147290:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498242688 00000100:00100000:1.0:1789131002.147306:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498242688 00000100:00100000:1.0:1789131002.147395:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 30 00000100:00100000:1.0:1789131002.147408:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc12a8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+7:11393:x1876039498242688:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:1.0:1789131002.147545:0:8414:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789131002.147575:0:8414:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000383123ce/0xf3fe2838e1fc25f4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269995 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131002.148083:0:8414:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004728ce7c/0xf3fe2838e1fc25ed lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d26998e expref: 8 pid: 8417 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131002.148096:0:8414:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789131002.148102:0:8414:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789131002.148108:0:8414:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383123ce/0xf3fe2838e1fc25f4 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269995 expref: 8 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131002.148153:0:8414:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004728ce7c/0xf3fe2838e1fc25ed lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d26998e expref: 8 pid: 8417 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131002.148170:0:8414:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004728ce7c/0xf3fe2838e1fc25ed lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d26998e expref: 8 pid: 8417 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131002.148188:0:8414:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc86a5e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8414:1876039508833792:192.168.203.11@tcp:104: 00000100:00100000:0.0:1789131002.148404:0:8414:0:(client.c:2715:ptlrpc_set_wait()) set ffff91dcc7c5af00 going to sleep for 11 seconds 00000100:00100000:0.0:1789131002.157837:0:8414:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc86a5e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8414:1876039508833792:192.168.203.11@tcp:104: 00010000:00010000:0.0:1789131002.157908:0:8414:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000383123ce/0xf3fe2838e1fc25f4 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269995 expref: 8 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131002.157948:0:8414:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dcc85ca000, rc 0) 00000100:00100000:0.0:1789131002.158029:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc12a8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+8:11393:x1876039498242688:12345-192.168.203.11@tcp:101:bash.0 Request processed in 10622us (11770us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131002.158040:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 30 00000100:00100000:2.0:1789131002.158568:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131002.159601:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498242816 00000100:00100000:3.0:1789131002.159616:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498242816 00010000:00010000:3.0:1789131002.159667:0:6486:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004728ce7c/0xf3fe2838e1fc25ed lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d26998e expref: 8 pid: 8417 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131002.159752:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 64 00000100:00100000:3.0:1789131002.159764:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc12a8f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+8:2388:x1876039498242816:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789131002.159782:0:6486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789131002.159809:0:6486:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004728ce7c/0xf3fe2838e1fc25ed lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d26998e expref: 8 pid: 8417 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131002.159826:0:6486:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004728ce7c/0xf3fe2838e1fc25ed lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d26998e expref: 8 pid: 8417 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131002.159860:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004728ce7c/0xf3fe2838e1fc25ed lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d26998e expref: 8 pid: 8417 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131002.159881:0:6486:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789131002.159887:0:6486:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789131002.159907:0:6486:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000383123ce/0xf3fe2838e1fc25f4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269995 expref: 7 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131002.159919:0:6486:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000383123ce/0xf3fe2838e1fc25f4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269995 expref: 7 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131002.159978:0:6486:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000383123ce/0xf3fe2838e1fc25f4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269995 expref: 7 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131002.159996:0:6486:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddc2e87840 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6486:1876039508833920:192.168.203.11@tcp:105: 00000100:00100000:3.0:1789131002.160118:0:6486:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddd831ea80 going to sleep for 11 seconds 00000100:00100000:2.0:1789131002.164245:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131002.164403:0:6486:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddc2e87840 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6486:1876039508833920:192.168.203.11@tcp:105: 00010000:00010000:3.0:1789131002.164435:0:6486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789131002.164520:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498243072 00000100:00100000:1.0:1789131002.164530:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498243072 00000100:00100000:3.0:1789131002.164533:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc12a8f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+7:2388:x1876039498242816:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 4771us (5966us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131002.164614:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 6 00000100:00100000:1.0:1789131002.164627:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc12abc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+15:11393:x1876039498243072:12345-192.168.203.11@tcp:35:bash.0 00000100:00100000:1.0:1789131002.165304:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc12abc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+16:11393:x1876039498243072:12345-192.168.203.11@tcp:35:bash.0 Request processed in 678us (1072us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1789131002.165314:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 6 00000100:00100000:3.0:1789131002.167719:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 64 00000100:00100000:2.0:1789131002.257088:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789131002.257268:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498243328 00000100:00100000:1.0:1789131002.257282:0:14273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498243328 00000100:00100000:1.0:1789131002.257376:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 50 00000100:00100000:1.0:1789131002.257389:0:14273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd1dac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+16:11403:x1876039498243328:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:1.0:1789131002.257421:0:14273:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789131002.257449:0:14273:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85caa00/0xf3fe2838e1fc25fb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d26999c expref: -99 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789131002.258308:0:14273:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1789131002.258485:0:14273:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85caa00/0xf3fe2838e1fc25fb lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d26999c expref: 18 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131002.258505:0:14273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91dcc7d6ac00) 00010000:00010000:0.0:1789131002.258509:0:14273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789131002.258516:0:14273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85caa00/0xf3fe2838e1fc25fb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d26999c expref: 18 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131002.258539:0:14273:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dcc85caa00, rc 0) 00000100:00100000:0.0:1789131002.258691:0:14273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd1dac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+17:11403:x1876039498243328:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 1303us (1625us total) trans 4294967315 rc 301/301 00000100:00100000:0.0:1789131002.258701:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 50 00000100:00100000:2.0:1789131002.264918:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789131002.265077:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498243584 00000100:00100000:1.0:1789131002.265090:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498243584 00000100:00100000:1.0:1789131002.265187:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 7 00000100:00100000:1.0:1789131002.265199:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd1dac780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+17:11403:x1876039498243584:12345-192.168.203.11@tcp:35:lfs.0 00000100:00100000:1.0:1789131002.265548:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd1dac780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+18:11403:x1876039498243584:12345-192.168.203.11@tcp:35:lfs.0 Request processed in 350us (645us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1789131002.265558:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 7 00000100:00100000:1.0:1789131002.336778:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131002.337185:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498243712 00000100:00100000:3.0:1789131002.337200:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498243712 00000100:00100000:3.0:1789131002.337286:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 51 00000100:00100000:3.0:1789131002.337300:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd1dfa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+18:11409:x1876039498243712:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:3.0:1789131002.337331:0:6501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789131002.337368:0:6501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5c00/0xf3fe2838e1fc2609 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d2699a3 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131002.337505:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc2610 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131002.337533:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc2610 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131002.337548:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc2610 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789131002.337605:0:6501:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1789131002.337620:0:6501:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789131002.337648:0:6501:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc2610 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131002.337682:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5c00/0xf3fe2838e1fc2609 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d2699a3 expref: 20 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131002.337725:0:6501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc2610 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d2699a3 expref: 19 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131002.337735:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff91dded3a2b00) 00010000:00010000:3.0:1789131002.337740:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789131002.337745:0:6501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ddfd0b5a00, rc 0) 00000100:00100000:3.0:1789131002.337827:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd1dfa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+19:11409:x1876039498243712:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 530us (1067us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131002.337836:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 51 00000100:00100000:2.0:1789131002.347442:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131002.347707:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498243968 00000100:00100000:0.0:1789131002.347722:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498243968 00000100:00100000:0.0:1789131002.347802:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 52 00000100:00100000:0.0:1789131002.347814:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd1daed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+19:11409:x1876039498243968:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:0.0:1789131002.347843:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789131002.347883:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6e00/0xf3fe2838e1fc2617 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d2699aa expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131002.348235:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc261e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131002.348252:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc261e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131002.348266:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc261e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789131002.348280:0:6500:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1789131002.348665:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6e00/0xf3fe2838e1fc2617 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d2699aa expref: 22 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131002.348692:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc261e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d2699aa expref: 21 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131002.348702:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff91dded3a2700) 00010000:00010000:0.0:1789131002.348706:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789131002.348711:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91de01ad7600, rc 0) 00000100:00100000:0.0:1789131002.348861:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd1daed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+21:11409:x1876039498243968:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 1048us (1434us total) trans 4294967317 rc 0/0 00000100:00100000:0.0:1789131002.348880:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 52 00000100:00100000:2.0:1789131002.353866:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131002.353971:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498244224 00000100:00100000:0.0:1789131002.353995:0:14273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498244224 00000100:00100000:0.0:1789131002.354073:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 53 00000100:00100000:0.0:1789131002.354087:0:14273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd1dafc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+21:11409:x1876039498244224:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:0.0:1789131002.354123:0:14273:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789131002.354180:0:14273:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6800/0xf3fe2838e1fc262c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d2699b1 expref: -99 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131002.354329:0:14273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6400/0xf3fe2838e1fc2633 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131002.354739:0:14273:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6400/0xf3fe2838e1fc2633 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131002.354756:0:14273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6400/0xf3fe2838e1fc2633 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789131002.354773:0:14273:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1789131002.354921:0:14273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6800/0xf3fe2838e1fc262c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d2699b1 expref: 24 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131002.354952:0:14273:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6400/0xf3fe2838e1fc2633 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d2699b1 expref: 23 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131002.354962:0:14273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff91dded3a2700) 00010000:00010000:0.0:1789131002.354966:0:14273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789131002.354970:0:14273:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91de01ad6400, rc 0) 00000100:00100000:0.0:1789131002.355068:0:14273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd1dafc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+23:11409:x1876039498244224:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 984us (1217us total) trans 4294967318 rc 0/0 00000100:00100000:0.0:1789131002.355077:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 53 00000100:00100000:1.0:1789131002.358077:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131002.358243:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498244352 00000100:00100000:3.0:1789131002.358257:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498244352 00000100:00100000:3.0:1789131002.358352:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 3 00000100:00100000:3.0:1789131002.358366:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd1df9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+23:2387:x1876039498244352:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789131002.358389:0:6485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789131002.358424:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc261e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d2699aa expref: 23 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131002.358448:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff91dded3a2700) 00010000:00010000:3.0:1789131002.358454:0:6485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789131002.358568:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd1df9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+22:2387:x1876039498244352:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 204us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131002.358577:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 3 00000100:00100000:2.0:1789131002.367058:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131002.367328:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498244480 00000100:00100000:3.0:1789131002.367354:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498244480 00000100:00100000:3.0:1789131002.367436:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 31 00000100:00100000:3.0:1789131002.367448:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd1dae1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+7:2387:x1876039498244480:12345-192.168.203.11@tcp:1:lfs.0 00010000:00010000:3.0:1789131002.367583:0:8416:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4814ea1/0xf3fe2838e1fc2641 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131002.367621:0:8416:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000383123ce/0xf3fe2838e1fc25f4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269995 expref: 7 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131002.367631:0:8416:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789131002.367636:0:8416:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789131002.367642:0:8416:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b4814ea1/0xf3fe2838e1fc2641 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131002.367689:0:8416:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000383123ce/0xf3fe2838e1fc25f4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269995 expref: 7 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131002.367707:0:8416:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000383123ce/0xf3fe2838e1fc25f4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269995 expref: 7 pid: 8414 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131002.367725:0:8416:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddc2e87840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8416:1876039508834048:192.168.203.11@tcp:104: 00000100:00100000:3.0:1789131002.367854:0:8416:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddd831ea80 going to sleep for 11 seconds 00000100:00100000:3.0:1789131002.372823:0:8416:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddc2e87840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8416:1876039508834048:192.168.203.11@tcp:104: 00010000:00010000:3.0:1789131002.372867:0:8416:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b4814ea1/0xf3fe2838e1fc2641 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131002.374745:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131002.374864:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498244608 00000100:00100000:3.0:1789131002.374881:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498244608 00002000:00100000:3.0:1789131002.374959:0:8420:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x2:0x0] (0->12) req@ffff91ddd1dacf00 x1876039498244608/t0(0) o4->b99c111d-b9b6-4590-88e4-9fefd4d4c3a4@192.168.203.11@tcp:718/0 lens 504/0 e 0 to 0 dl 1789131013 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789131002.374995:0:8420:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff91ddd1dacf00 with x1876039498244608 ext(0->12) 00010000:00010000:3.0:1789131002.375008:0:8420:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000383123ce/0xf3fe2838e1fc25f4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269995 expref: 8 pid: 8414 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131002.375027:0:8420:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000383123ce/0xf3fe2838e1fc25f4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269995 expref: 8 pid: 8414 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789131002.375036:0:8420:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff91ddd1dacf00 00000100:00100000:3.0:1789131002.375077:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 0 00000100:00100000:3.0:1789131002.375089:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd1dacf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+8:2387:x1876039498244608:12345-192.168.203.11@tcp:4:lfs.0 00000001:00100000:0.0:1789131002.379175:0:8410:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of b99c111d-b9b6-4590-88e4-9fefd4d4c3a4 00000100:00100000:2.0:1789131002.382342:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd1dacf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+9:2387:x1876039498244608:12345-192.168.203.11@tcp:4:lfs.0 Request processed in 7245us (7597us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1789131002.382361:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 0 00002000:00100000:2.0:1789131002.382374:0:8420:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x2:0x0] (0->12) req@ffff91ddd1dacf00 x1876039498244608/t4294967300(0) o4->b99c111d-b9b6-4590-88e4-9fefd4d4c3a4@192.168.203.11@tcp:718/0 lens 504/448 e 0 to 0 dl 1789131013 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789131002.382385:0:8420:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff91ddd1dacf00 with x1876039498244608 ext(0->12) 00010000:00010000:2.0:1789131002.382395:0:8420:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000383123ce/0xf3fe2838e1fc25f4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269995 expref: 9 pid: 8414 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131002.382431:0:8420:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000383123ce/0xf3fe2838e1fc25f4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269995 expref: 9 pid: 8414 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789131002.382439:0:8420:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff91ddd1dacf00 00000040:00080000:3.0:1789131002.387632:0:14478:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789131002.387894:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131002.387987:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498244736 00000100:00100000:2.0:1789131002.387996:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498244736 00010000:00010000:2.0:1789131002.388031:0:8431:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000383123ce/0xf3fe2838e1fc25f4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269995 expref: 9 pid: 8414 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789131002.388176:0:14475:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789131002.388177:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 65 00000100:00100000:2.0:1789131002.388193:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc33ad450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+9:2386:x1876039498244736:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789131002.388210:0:8431:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1789131002.388227:0:8431:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1789131002.388230:0:8431:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb mtime from disk: 0 -> 1789131001 00002000:00010000:2.0:1789131002.388232:0:8431:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb atime from disk: 0 -> 1789131001 00002000:00010000:2.0:1789131002.388235:0:8431:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb ctime from disk: 0 -> 1789131001 00002000:00010000:2.0:1789131002.388237:0:8431:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1789131002.388244:0:8431:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000383123ce/0xf3fe2838e1fc25f4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269995 expref: 9 pid: 8414 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131002.388258:0:8431:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000383123ce/0xf3fe2838e1fc25f4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269995 expref: 9 pid: 8414 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131002.388285:0:8431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000383123ce/0xf3fe2838e1fc25f4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269995 expref: 9 pid: 8414 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131002.388323:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789131002.388328:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789131002.388333:0:8431:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b4814ea1/0xf3fe2838e1fc2641 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131002.388343:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b4814ea1/0xf3fe2838e1fc2641 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131002.388376:0:8431:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789131002.388429:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc33ad450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+8:2386:x1876039498244736:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 240us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131002.388438:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 65 00010000:00010000:0.0:1789131002.388560:0:8416:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b4814ea1/0xf3fe2838e1fc2641 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131002.388583:0:8416:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b4814ea1/0xf3fe2838e1fc2641 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131002.388680:0:8416:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4814ea1/0xf3fe2838e1fc2641 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131002.388690:0:8416:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b4814ea1/0xf3fe2838e1fc2641 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131002.388699:0:8416:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b4814ea1/0xf3fe2838e1fc2641 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131002.388707:0:8416:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddfd0b5c00 already unused, calling callback (ffffffffc0c4e550) 00010000:00010000:0.0:1789131002.388711:0:8416:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4814ea1/0xf3fe2838e1fc2641 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131002.388720:0:8416:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4814ea1/0xf3fe2838e1fc2641 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131002.388733:0:8416:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b4814ea1/0xf3fe2838e1fc2641 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131002.388740:0:8416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b4814ea1/0xf3fe2838e1fc2641 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131002.388858:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd1dae1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+7:2387:x1876039498244480:12345-192.168.203.11@tcp:1:lfs.0 Request processed in 21411us (21817us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131002.388867:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 31 00000100:00100000:1.0:1789131002.402772:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131002.402956:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498244992 00000100:00100000:2.0:1789131002.402967:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498244992 00000100:00100000:2.0:1789131002.403079:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 8 00000100:00100000:2.0:1789131002.403090:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd1dfb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+22:11409:x1876039498244992:12345-192.168.203.11@tcp:35:lfs.0 00000004:00010000:2.0:1789131002.403169:0:6503:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6400/0xf3fe2838e1fc2633 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d2699b1 expref: 22 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789131002.403386:0:6503:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00000001:00080000:2.0:1789131002.403428:0:6503:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:2.0:1789131002.403752:0:6503:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00010000:00010000:2.0:1789131002.403786:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7ee00/0xf3fe2838e1fc2648 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131002.403800:0:6503:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4a00/0xf3fe2838e1fc25d8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269987 expref: 26 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131002.403827:0:6503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7ee00/0xf3fe2838e1fc2648 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131002.403860:0:6503:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4a00/0xf3fe2838e1fc25d8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269987 expref: 26 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131002.403874:0:6503:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4a00/0xf3fe2838e1fc25d8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269987 expref: 26 pid: 6500 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131002.403888:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd1dad680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6503:1876039508834176:192.168.203.11@tcp:104: 00000100:00100000:2.0:1789131002.403970:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddff7d7b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789131002.408769:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd1dad680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6503:1876039508834176:192.168.203.11@tcp:104: 00010000:00010000:2.0:1789131002.408800:0:6503:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7ee00/0xf3fe2838e1fc2648 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6503 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131002.409552:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131002.409645:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498245120 00000100:00100000:3.0:1789131002.409653:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498245120 00010000:00010000:3.0:1789131002.409689:0:6485:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4a00/0xf3fe2838e1fc25d8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269987 expref: 27 pid: 6500 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131002.409720:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 66 00000100:00100000:3.0:1789131002.409729:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd1dfa940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+27:2388:x1876039498245120:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789131002.409743:0:6485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789131002.409750:0:6485:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4a00/0xf3fe2838e1fc25d8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269987 expref: 27 pid: 6500 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131002.409762:0:6485:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4a00/0xf3fe2838e1fc25d8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269987 expref: 27 pid: 6500 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131002.409804:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4a00/0xf3fe2838e1fc25d8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269987 expref: 27 pid: 6500 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131002.409960:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff91dded3a2700) 00010000:00010000:3.0:1789131002.409967:0:6485:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7ee00/0xf3fe2838e1fc2648 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131002.409977:0:6485:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7ee00/0xf3fe2838e1fc2648 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131002.409984:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7ee00/0xf3fe2838e1fc2648 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131002.410015:0:6485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789131002.410085:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd1dfa940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+26:2388:x1876039498245120:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 355us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131002.410093:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 66 00010000:00010000:1.0:1789131002.410455:0:6503:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7ee00/0xf3fe2838e1fc2648 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131002.410483:0:6503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7ee00/0xf3fe2838e1fc2648 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6503 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789131002.410590:0:6503:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000001:00080000:1.0:1789131002.410708:0:6503:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00000100:00100000:1.0:1789131002.410789:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd1df8000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6503:1876039508834304:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789131002.410847:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131002.410874:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddc4c14f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789131002.411295:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508834304 00000100:00100000:3.0:1789131002.411301:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508834304 00000100:00100000:3.0:1789131002.411362:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1789131002.411370:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd1df8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6503:x1876039508834304:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789131002.411442:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd1df8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6503:x1876039508834304:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 73us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131002.411450:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1789131002.411551:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd1df8000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6503:1876039508834304:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1789131002.411731:0:6503:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00000100:00100000:2.0:1789131002.411776:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd1dad680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6503:1876039508834432:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789131002.411806:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131002.411839:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddff7d73c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789131002.412006:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508834432 00000100:00100000:3.0:1789131002.412012:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508834432 00000100:00100000:3.0:1789131002.412052:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1789131002.412060:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd1dacb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6503:x1876039508834432:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789131002.412168:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd1dacb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6503:x1876039508834432:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 108us (361us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1789131002.412176:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1789131002.412518:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd1dad680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6503:1876039508834432:0@lo:1000:mdt_rdpg00_000.0 00000100:00080000:1.0:1789131002.412539:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1789131002.412558:0:6503:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967325 00010000:00010000:0.0:1789131002.412591:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7ee00/0xf3fe2838e1fc2648 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131002.412601:0:6503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7ee00/0xf3fe2838e1fc2648 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131002.412609:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7ee00/0xf3fe2838e1fc2648 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131002.412615:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc7f7ee00 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:0.0:1789131002.412619:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7ee00/0xf3fe2838e1fc2648 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131002.412627:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7ee00/0xf3fe2838e1fc2648 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131002.412640:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff91dded3a2700) 00010000:00010000:0.0:1789131002.412643:0:6503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1789131002.412648:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7ee00/0xf3fe2838e1fc2648 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131002.412654:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7ee00/0xf3fe2838e1fc2648 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6503 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789131002.412755:0:6503:0:(mdd_object.c:4024:mdd_close()) Object [0x200000402:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1789131002.412815:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:0.0:1789131002.412826:0:6503:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 358330366354ns, next at 359330364411ns, rc = 0 00000001:00080000:0.0:1789131002.412832:0:6503:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967326 00010000:00010000:0.0:1789131002.412852:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff91dded3a2700) 00010000:00010000:0.0:1789131002.412854:0:6503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789131002.412861:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6400/0xf3fe2838e1fc2633 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d2699b1 expref: 30 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131002.412963:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd1dfb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+29:11409:x1876039498244992:12345-192.168.203.11@tcp:35:lfs.0 Request processed in 9874us (10199us total) trans 4294967327 rc 0/0 00000100:00100000:0.0:1789131002.412972:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 8 00000020:00080000:0.0:1789131002.412976:0:6503:0:(tgt_main.c:785:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1789131002.428891:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131002.430717:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498245248 00000100:00100000:2.0:1789131002.430731:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498245248 00000100:00100000:2.0:1789131002.430804:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 54 00000100:00100000:2.0:1789131002.430815:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd1dfad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+29:11409:x1876039498245248:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:2.0:1789131002.430839:0:9769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789131002.430877:0:9769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e000/0xf3fe2838e1fc264f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d2699b8 expref: -99 pid: 9769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131002.430945:0:9769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e000/0xf3fe2838e1fc264f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d2699b8 expref: 30 pid: 9769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131002.430960:0:9769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e000/0xf3fe2838e1fc264f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d2699b8 expref: 30 pid: 9769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131002.430977:0:9769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff91dde1922300) 00010000:00010000:2.0:1789131002.430981:0:9769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789131002.430984:0:9769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dcc7f7e000, rc 0) 00000100:00100000:2.0:1789131002.431094:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd1dfad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+30:11409:x1876039498245248:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 280us (2281us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131002.431102:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 54 00000100:00100000:1.0:1789131002.434907:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131002.435049:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498245504 00000100:00100000:0.0:1789131002.435058:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498245504 00000100:00100000:0.0:1789131002.435117:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 9 00000100:00100000:0.0:1789131002.435128:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dded1d5850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+30:11409:x1876039498245504:12345-192.168.203.11@tcp:35:lfs.0 00000100:00100000:0.0:1789131002.435344:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dded1d5850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+31:11409:x1876039498245504:12345-192.168.203.11@tcp:35:lfs.0 Request processed in 217us (447us total) trans 4294967328 rc 0/0 00000100:00100000:0.0:1789131002.435353:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 9 00000100:00100000:0.0:1789131002.529706:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131002.529814:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498245760 00000100:00100000:2.0:1789131002.529823:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498245760 00000100:00100000:2.0:1789131002.529878:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 55 00000100:00100000:2.0:1789131002.529888:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc86a5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+31:11419:x1876039498245760:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:2.0:1789131002.529909:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789131002.529929:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fa00/0xf3fe2838e1fc2656 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d2699bf expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789131002.530103:0:6500:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1789131002.530220:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fa00/0xf3fe2838e1fc2656 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d2699bf expref: 33 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131002.530234:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91dcc7d6ac00) 00010000:00010000:2.0:1789131002.530249:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789131002.530256:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fa00/0xf3fe2838e1fc2656 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d2699bf expref: 33 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131002.530270:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dcc7f7fa00, rc 0) 00000100:00100000:2.0:1789131002.530332:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc86a5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+32:11419:x1876039498245760:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 445us (635us total) trans 4294967329 rc 301/301 00000100:00100000:2.0:1789131002.530339:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 55 00000100:00100000:1.0:1789131002.533559:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131002.533704:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498245888 00000100:00100000:0.0:1789131002.533715:0:14273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498245888 00000100:00100000:0.0:1789131002.533782:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 56 00000100:00100000:0.0:1789131002.533791:0:14273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd1dfbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+32:11419:x1876039498245888:12345-192.168.203.11@tcp:34:lfs.0 00010000:00010000:0.0:1789131002.533864:0:14273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6e00/0xf3fe2838e1fc2664 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131002.533893:0:14273:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6e00/0xf3fe2838e1fc2664 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131002.533903:0:14273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6e00/0xf3fe2838e1fc2664 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131002.533916:0:14273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7e00/0xf3fe2838e1fc266b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131002.533922:0:14273:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7e00/0xf3fe2838e1fc266b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131002.533928:0:14273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7e00/0xf3fe2838e1fc266b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131002.534016:0:14273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6400/0xf3fe2838e1fc2672 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131002.534024:0:14273:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6400/0xf3fe2838e1fc2672 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131002.534031:0:14273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6400/0xf3fe2838e1fc2672 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789131002.534195:0:14273:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6400/0xf3fe2838e1fc2672 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131002.534209:0:14273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6e00/0xf3fe2838e1fc2664 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131002.534214:0:14273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6e00/0xf3fe2838e1fc2664 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131002.534231:0:14273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6e00/0xf3fe2838e1fc2664 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131002.534237:0:14273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91de01ad6e00 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:0.0:1789131002.534240:0:14273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6e00/0xf3fe2838e1fc2664 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131002.534249:0:14273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6e00/0xf3fe2838e1fc2664 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131002.534261:0:14273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff91dded3a2b00) 00010000:00010000:0.0:1789131002.534264:0:14273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789131002.534269:0:14273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6e00/0xf3fe2838e1fc2664 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131002.534275:0:14273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6e00/0xf3fe2838e1fc2664 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131002.534288:0:14273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7e00/0xf3fe2838e1fc266b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131002.534293:0:14273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7e00/0xf3fe2838e1fc266b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131002.534298:0:14273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7e00/0xf3fe2838e1fc266b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131002.534303:0:14273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91de01ad7e00 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:0.0:1789131002.534305:0:14273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7e00/0xf3fe2838e1fc266b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131002.534320:0:14273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7e00/0xf3fe2838e1fc266b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131002.534328:0:14273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff91dded3a2500) 00010000:00010000:0.0:1789131002.534330:0:14273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789131002.534332:0:14273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7e00/0xf3fe2838e1fc266b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131002.534338:0:14273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7e00/0xf3fe2838e1fc266b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131002.534346:0:14273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6400/0xf3fe2838e1fc2672 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131002.534351:0:14273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6400/0xf3fe2838e1fc2672 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131002.534356:0:14273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6400/0xf3fe2838e1fc2672 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131002.534361:0:14273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91de01ad6400 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:0.0:1789131002.534363:0:14273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6400/0xf3fe2838e1fc2672 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131002.534368:0:14273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6400/0xf3fe2838e1fc2672 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131002.534374:0:14273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff91dde1922300) 00010000:00010000:0.0:1789131002.534376:0:14273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789131002.534379:0:14273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6400/0xf3fe2838e1fc2672 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131002.534393:0:14273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6400/0xf3fe2838e1fc2672 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131002.534834:0:14273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd1dfbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+32:11419:x1876039498245888:12345-192.168.203.11@tcp:34:lfs.0 Request processed in 1039us (1280us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131002.534842:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 56 00000100:00100000:1.0:1789131002.541010:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131002.541413:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498246144 00000100:00100000:0.0:1789131002.541422:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498246144 00000100:00100000:0.0:1789131002.541716:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 10 00000100:00100000:0.0:1789131002.541728:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd1dfa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+32:11419:x1876039498246144:12345-192.168.203.11@tcp:35:lfs.0 00000100:00100000:0.0:1789131002.541958:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd1dfa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+33:11419:x1876039498246144:12345-192.168.203.11@tcp:35:lfs.0 Request processed in 231us (1630us total) trans 4294967330 rc 0/0 00000100:00100000:0.0:1789131002.541966:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 10 00000100:00100000:1.0:1789131002.586163:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131002.586383:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498246400 00000100:00100000:2.0:1789131002.586393:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498246400 00000100:00100000:2.0:1789131002.586451:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 57 00000100:00100000:2.0:1789131002.586491:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd1df8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+33:11422:x1876039498246400:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:2.0:1789131002.586523:0:9769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789131002.586541:0:9769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fa00/0xf3fe2838e1fc2679 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d2699c6 expref: -99 pid: 9769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131002.586619:0:9769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f800/0xf3fe2838e1fc2680 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131002.586634:0:9769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f800/0xf3fe2838e1fc2680 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131002.586645:0:9769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f800/0xf3fe2838e1fc2680 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131002.586655:0:9769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fc00/0xf3fe2838e1fc2687 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131002.586661:0:9769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fc00/0xf3fe2838e1fc2687 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131002.586685:0:9769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fc00/0xf3fe2838e1fc2687 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131002.586790:0:9769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7ee00/0xf3fe2838e1fc268e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131002.586798:0:9769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7ee00/0xf3fe2838e1fc268e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131002.586805:0:9769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7ee00/0xf3fe2838e1fc268e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789131002.586815:0:9769:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1789131002.586886:0:9769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f800/0xf3fe2838e1fc2680 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131002.586893:0:9769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f800/0xf3fe2838e1fc2680 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131002.586899:0:9769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f800/0xf3fe2838e1fc2680 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131002.586905:0:9769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc7f7f800 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:2.0:1789131002.586909:0:9769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f800/0xf3fe2838e1fc2680 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131002.586916:0:9769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f800/0xf3fe2838e1fc2680 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131002.586926:0:9769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff91dded3a2b00) 00010000:00010000:2.0:1789131002.586929:0:9769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789131002.586952:0:9769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f800/0xf3fe2838e1fc2680 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131002.586958:0:9769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f800/0xf3fe2838e1fc2680 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131002.586971:0:9769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fc00/0xf3fe2838e1fc2687 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131002.586977:0:9769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fc00/0xf3fe2838e1fc2687 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131002.586982:0:9769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fc00/0xf3fe2838e1fc2687 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131002.586986:0:9769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc7f7fc00 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:2.0:1789131002.586989:0:9769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fc00/0xf3fe2838e1fc2687 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131002.586995:0:9769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fc00/0xf3fe2838e1fc2687 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131002.587002:0:9769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff91dded3a2500) 00010000:00010000:2.0:1789131002.587004:0:9769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789131002.587007:0:9769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fc00/0xf3fe2838e1fc2687 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131002.587012:0:9769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fc00/0xf3fe2838e1fc2687 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131002.587047:0:9769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fa00/0xf3fe2838e1fc2679 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d2699c6 expref: 36 pid: 9769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131002.587074:0:9769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7ee00/0xf3fe2838e1fc268e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d2699c6 expref: 35 pid: 9769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131002.587082:0:9769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff91dde1922300) 00010000:00010000:2.0:1789131002.587084:0:9769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789131002.587086:0:9769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dcc7f7ee00, rc 0) 00000100:00100000:2.0:1789131002.587139:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd1df8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+35:11422:x1876039498246400:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 679us (994us total) trans 4294967331 rc 0/0 00000100:00100000:2.0:1789131002.587285:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 57 00000100:00100000:1.0:1789131002.591892:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131002.591993:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498246528 00000100:00100000:3.0:1789131002.592003:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498246528 00000100:00100000:3.0:1789131002.592060:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 58 00000100:00100000:3.0:1789131002.592070:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd1df9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+35:11422:x1876039498246528:12345-192.168.203.11@tcp:54:lfs.0 00010000:00010000:3.0:1789131002.592133:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4a00/0xf3fe2838e1fc269c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131002.592161:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4a00/0xf3fe2838e1fc269c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131002.592173:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4a00/0xf3fe2838e1fc269c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131002.592206:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4a00/0xf3fe2838e1fc269c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131002.592213:0:6501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4a00/0xf3fe2838e1fc269c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131002.592220:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4a00/0xf3fe2838e1fc269c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131002.592227:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddfd0b4a00 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:3.0:1789131002.592231:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4a00/0xf3fe2838e1fc269c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131002.592238:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4a00/0xf3fe2838e1fc269c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131002.592257:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff91dde1922300) 00010000:00010000:3.0:1789131002.592260:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789131002.592265:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4a00/0xf3fe2838e1fc269c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131002.592272:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4a00/0xf3fe2838e1fc269c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131002.592394:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd1df9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+35:11422:x1876039498246528:12345-192.168.203.11@tcp:54:lfs.0 Request processed in 324us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131002.592403:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 58 00000100:00100000:1.0:1789131002.600796:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131002.600858:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498246784 00000100:00100000:2.0:1789131002.600869:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498246784 00000100:00100000:2.0:1789131002.601001:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 11 00000100:00100000:2.0:1789131002.601014:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd1dfb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+35:11422:x1876039498246784:12345-192.168.203.11@tcp:35:lfs.0 00000100:00100000:2.0:1789131002.601261:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd1dfb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+36:11422:x1876039498246784:12345-192.168.203.11@tcp:35:lfs.0 Request processed in 249us (474us total) trans 4294967332 rc 0/0 00000100:00100000:2.0:1789131002.601270:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 11 00000100:00100000:0.0:1789131002.724648:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131002.724742:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131002.724773:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131002.724811:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131002.724841:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498247168 00000100:00100000:0.0:1789131002.724850:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498247168 00000100:00100000:0.0:1789131002.724906:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498247040 00000100:00100000:0.0:1789131002.724909:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498247040 00000100:00100000:0.0:1789131002.724928:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498247296 00000100:00100000:0.0:1789131002.724931:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498247296 00000100:00100000:0.0:1789131002.724958:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 315 00000100:00100000:0.0:1789131002.724967:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc86a6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fde8d4a8-44db-4e6b-8249-c1c295e4901d+5:2385:x1876039498247168:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1789131002.725032:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc86a6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fde8d4a8-44db-4e6b-8249-c1c295e4901d+5:2385:x1876039498247168:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 66us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131002.725052:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 315 00000100:00100000:0.0:1789131002.725068:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 316 00000100:00100000:0.0:1789131002.725075:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01ad2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+5:2385:x1876039498247040:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1789131002.725101:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01ad2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+5:2385:x1876039498247040:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 26us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131002.725106:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 316 00000100:00100000:0.0:1789131002.725116:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 317 00000100:00100000:0.0:1789131002.725120:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7d98780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fde8d4a8-44db-4e6b-8249-c1c295e4901d+5:2385:x1876039498247296:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1789131002.725137:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7d98780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fde8d4a8-44db-4e6b-8249-c1c295e4901d+5:2385:x1876039498247296:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 17us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131002.725142:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 317 00000100:00080000:1.0:1789131002.725240:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789131002.725244:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789131002.727712:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498246912 00000100:00100000:3.0:1789131002.727724:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498246912 00000100:00100000:3.0:1789131002.727836:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 446 00000100:00100000:3.0:1789131002.727845:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddcf4fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+13:2385:x1876039498246912:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1789131002.727910:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddcf4fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+13:2385:x1876039498246912:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 66us (3271us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131002.727917:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 446 00010000:00010000:2.0:1789131002.774489:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789131002.887196:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131002.887394:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498247552 00000100:00100000:2.0:1789131002.887404:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498247552 00000100:00100000:2.0:1789131002.887507:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 59 00000100:00100000:2.0:1789131002.887518:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7d992c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+36:11453:x1876039498247552:12345-192.168.203.11@tcp:101:cat.0 00010000:00010000:2.0:1789131002.887547:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789131002.887569:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fa00/0xf3fe2838e1fc26a3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d2699cd expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131002.887688:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fc00/0xf3fe2838e1fc26aa lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131002.887702:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fc00/0xf3fe2838e1fc26aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131002.887714:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fc00/0xf3fe2838e1fc26aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789131002.887726:0:6500:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1789131002.887957:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fa00/0xf3fe2838e1fc26a3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d2699cd expref: 39 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131002.887974:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fc00/0xf3fe2838e1fc26aa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d2699cd expref: 38 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131002.887984:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff91dde1922300) 00010000:00010000:2.0:1789131002.887987:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789131002.887990:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dcc7f7fc00, rc 0) 00000100:00100000:2.0:1789131002.888046:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7d992c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+38:11453:x1876039498247552:12345-192.168.203.11@tcp:101:cat.0 Request processed in 530us (859us total) trans 4294967333 rc 0/0 00000100:00100000:2.0:1789131002.888053:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 59 00000100:00100000:1.0:1789131002.896607:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131002.896649:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498247680 00000100:00100000:3.0:1789131002.896658:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498247680 00000100:00100000:1.0:1789131002.896689:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131002.896726:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 4 00000100:00100000:3.0:1789131002.896737:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd1df8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+38:2388:x1876039498247680:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789131002.896751:0:6486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789131002.896775:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fc00/0xf3fe2838e1fc26aa lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d2699cd expref: 38 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131002.896792:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff91dde1922300) 00000100:00100000:0.0:1789131002.896803:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498247936 00000100:00100000:0.0:1789131002.896807:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498247936 00010000:00010000:3.0:1789131002.896810:0:6486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789131002.896838:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 12 00000100:00100000:0.0:1789131002.896845:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd1df9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+38:11453:x1876039498247936:12345-192.168.203.11@tcp:35:cat.0 00000100:00100000:3.0:1789131002.896864:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd1df8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+38:2388:x1876039498247680:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 130us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131002.896871:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 4 00000100:00100000:0.0:1789131002.897038:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd1df9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+38:11453:x1876039498247936:12345-192.168.203.11@tcp:35:cat.0 Request processed in 192us (347us total) trans 4294967334 rc 0/0 00000100:00100000:0.0:1789131002.897044:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 12 00000100:00100000:1.0:1789131002.966906:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131002.967030:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498248192 00000100:00100000:2.0:1789131002.967040:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498248192 00000100:00100000:2.0:1789131002.967098:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 60 00000100:00100000:2.0:1789131002.967108:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd1dfb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+38:11459:x1876039498248192:12345-192.168.203.11@tcp:101:dd.0 00010000:00010000:2.0:1789131002.967131:0:6502:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789131002.967153:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789131002.967180:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc2610 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d2699a3 expref: 38 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131002.967202:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff91dded3a2b00) 00010000:00010000:2.0:1789131002.967207:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789131002.967219:0:6502:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fa00/0xf3fe2838e1fc26b8 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d2699d4 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131002.967317:0:6502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f800/0xf3fe2838e1fc26bf lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131002.967330:0:6502:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7ee00/0xf3fe2838e1fc268e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d2699c6 expref: 38 pid: 9769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131002.967339:0:6502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f800/0xf3fe2838e1fc26bf lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131002.967368:0:6502:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7ee00/0xf3fe2838e1fc268e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d2699c6 expref: 38 pid: 9769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131002.967382:0:6502:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7ee00/0xf3fe2838e1fc268e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d2699c6 expref: 38 pid: 9769 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131002.967395:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd1daf840 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6502:1876039508834560:192.168.203.11@tcp:104: 00000100:00100000:2.0:1789131002.967549:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddff7d7480 going to sleep for 11 seconds 00000100:00100000:1.0:1789131002.972252:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131002.972405:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498248320 00000100:00100000:0.0:1789131002.972414:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498248320 00010000:00010000:0.0:1789131002.972452:0:6487:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7ee00/0xf3fe2838e1fc268e lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d2699c6 expref: 39 pid: 9769 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131002.972643:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 67 00000100:00100000:0.0:1789131002.972655:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd1df8b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+39:2388:x1876039498248320:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789131002.972671:0:6487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789131002.972678:0:6487:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7ee00/0xf3fe2838e1fc268e lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d2699c6 expref: 39 pid: 9769 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131002.972691:0:6487:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7ee00/0xf3fe2838e1fc268e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d2699c6 expref: 39 pid: 9769 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131002.972713:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff91dde1922300) 00010000:00010000:0.0:1789131002.972719:0:6487:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f800/0xf3fe2838e1fc26bf lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131002.972728:0:6487:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f800/0xf3fe2838e1fc26bf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131002.972735:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f800/0xf3fe2838e1fc26bf lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131002.972754:0:6487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789131002.972797:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd1df8b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+39:2388:x1876039498248320:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 145us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131002.972804:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 67 00010000:00010000:2.0:1789131002.972905:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7ee00/0xf3fe2838e1fc268e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d2699c6 expref: 38 pid: 9769 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131002.972943:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd1daf840 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6502:1876039508834560:192.168.203.11@tcp:104: 00010000:00010000:2.0:1789131002.972967:0:6502:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f800/0xf3fe2838e1fc26bf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131002.972976:0:6502:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f800/0xf3fe2838e1fc26bf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131002.972982:0:6502:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f800/0xf3fe2838e1fc26bf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789131002.973061:0:6502:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1789131002.973438:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fa00/0xf3fe2838e1fc26b8 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d2699d4 expref: 39 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131002.973452:0:6502:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f800/0xf3fe2838e1fc26bf lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d2699d4 expref: 38 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131002.973481:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff91dde1922300) 00010000:00010000:2.0:1789131002.973484:0:6502:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789131002.973486:0:6502:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dcc7f7f800, rc 0) 00000100:00100000:2.0:1789131002.973513:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd1dfb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+38:11459:x1876039498248192:12345-192.168.203.11@tcp:101:dd.0 Request processed in 6408us (6616us total) trans 4294967335 rc 0/0 00000100:00100000:2.0:1789131002.973522:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 60 00000100:00100000:1.0:1789131002.982112:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131002.982222:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498248448 00000100:00100000:2.0:1789131002.982231:0:14273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498248448 00000100:00100000:2.0:1789131002.982292:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 61 00000100:00100000:2.0:1789131002.982303:0:14273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd1df9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+38:11459:x1876039498248448:12345-192.168.203.11@tcp:101:dd.0 00010000:00010000:2.0:1789131002.982342:0:14273:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789131002.982363:0:14273:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fe00/0xf3fe2838e1fc26cd lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d2699db expref: -99 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131002.982398:0:14273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e400/0xf3fe2838e1fc26d4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131002.982412:0:14273:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e400/0xf3fe2838e1fc26d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131002.982423:0:14273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e400/0xf3fe2838e1fc26d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131002.982787:0:14273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fe00/0xf3fe2838e1fc26cd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d2699db expref: 40 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131002.982804:0:14273:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e400/0xf3fe2838e1fc26d4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d2699db expref: 39 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131002.982813:0:14273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff91dde1922300) 00010000:00010000:2.0:1789131002.982816:0:14273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789131002.982819:0:14273:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dcc7f7e400, rc 0) 00000100:00100000:2.0:1789131002.982915:0:14273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd1df9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+39:11459:x1876039498248448:12345-192.168.203.11@tcp:101:dd.0 Request processed in 613us (812us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131002.982923:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 61 00000100:00100000:2.0:1789131002.985919:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131002.986020:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498248704 00000100:00100000:0.0:1789131002.986029:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498248704 00000100:00100000:0.0:1789131002.986087:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 62 00000100:00100000:0.0:1789131002.986097:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd1daf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+39:11459:x1876039498248704:12345-192.168.203.11@tcp:36:dd.0 00010000:00010000:0.0:1789131002.986327:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7e00/0xf3fe2838e1fc26db lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131002.986343:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7e00/0xf3fe2838e1fc26db lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131002.986353:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7e00/0xf3fe2838e1fc26db lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789131002.986394:0:6500:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967336 00000004:00010000:0.0:1789131002.986416:0:6500:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000004e0ed8a2 reply state 0000000096d1a41b transno 4294967337 ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7e00/0xf3fe2838e1fc26db lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131002.986429:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7e00/0xf3fe2838e1fc26db lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131002.986436:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff91dde1922300) 00010000:00010000:0.0:1789131002.986439:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789131002.986442:0:6500:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789131002.986576:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd1daf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+42:11459:x1876039498248704:12345-192.168.203.11@tcp:36:dd.0 Request processed in 479us (663us total) trans 4294967337 rc 0/0 00000100:00100000:0.0:1789131002.986584:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 62 00000020:00080000:0.0:1789131002.986589:0:6500:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789131003.263155:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131003.263304:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498248832 00000100:00100000:2.0:1789131003.263314:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498248832 00000100:00100000:2.0:1789131003.263392:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 63 00000100:00100000:2.0:1789131003.263418:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7ffc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+42:11473:x1876039498248832:12345-192.168.203.11@tcp:101:stat.0 00010000:00010000:2.0:1789131003.263441:0:6502:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789131003.263488:0:6502:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fe00/0xf3fe2838e1fc26e2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d2699e2 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131003.263699:0:6502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fa00/0xf3fe2838e1fc26e9 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131003.263714:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fa00/0xf3fe2838e1fc26e9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131003.263727:0:6502:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fa00/0xf3fe2838e1fc26e9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131003.263737:0:6502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7ee00/0xf3fe2838e1fc26f0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131003.263743:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7ee00/0xf3fe2838e1fc26f0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131003.263750:0:6502:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7ee00/0xf3fe2838e1fc26f0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131003.263811:0:6502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e200/0xf3fe2838e1fc26f7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131003.263821:0:6502:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f800/0xf3fe2838e1fc26bf lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d2699d4 expref: 43 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131003.263829:0:6502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e200/0xf3fe2838e1fc26f7 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789131003.265262:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789131003.265725:0:6502:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f800/0xf3fe2838e1fc26bf lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d2699d4 expref: 43 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131003.265748:0:6502:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f800/0xf3fe2838e1fc26bf lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d2699d4 expref: 43 pid: 6502 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131003.265764:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd1dade00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6502:1876039508834688:192.168.203.11@tcp:104: 00000100:00100000:2.0:1789131003.268176:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddff7d7480 going to sleep for 11 seconds 00000100:00100000:2.0:1789131003.273376:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd1dade00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6502:1876039508834688:192.168.203.11@tcp:104: 00010000:00010000:2.0:1789131003.273406:0:6502:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e200/0xf3fe2838e1fc26f7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131003.273820:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131003.273897:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498249088 00000100:00100000:0.0:1789131003.273904:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498249088 00000100:00100000:0.0:1789131003.273966:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 13 00000100:00100000:0.0:1789131003.273976:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01b33840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+44:6158:x1876039498249088:12345-192.168.203.11@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1789131003.274287:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01b33840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+45:6158:x1876039498249088:12345-192.168.203.11@tcp:35:ldlm_bl.0 Request processed in 312us (467us total) trans 4294967338 rc 0/0 00000100:00100000:0.0:1789131003.274294:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 13 00000100:00100000:3.0:1789131003.277924:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131003.278120:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498249216 00000100:00100000:2.0:1789131003.278129:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498249216 00010000:00010000:2.0:1789131003.278181:0:8431:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f800/0xf3fe2838e1fc26bf lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d2699d4 expref: 45 pid: 6502 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131003.278219:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 68 00000100:00100000:2.0:1789131003.278228:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc2e87840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+45:2387:x1876039498249216:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789131003.278241:0:8431:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789131003.278248:0:8431:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f800/0xf3fe2838e1fc26bf lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d2699d4 expref: 45 pid: 6502 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131003.278260:0:8431:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f800/0xf3fe2838e1fc26bf lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d2699d4 expref: 45 pid: 6502 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131003.278301:0:8431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f800/0xf3fe2838e1fc26bf lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d2699d4 expref: 45 pid: 6502 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131003.278318:0:8431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff91dde1922300) 00010000:00010000:2.0:1789131003.278323:0:8431:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e200/0xf3fe2838e1fc26f7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131003.278334:0:8431:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e200/0xf3fe2838e1fc26f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131003.278342:0:8431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e200/0xf3fe2838e1fc26f7 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131003.278378:0:8431:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789131003.278434:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc2e87840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+44:2387:x1876039498249216:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 206us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131003.278441:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 68 00010000:00010000:1.0:1789131003.278689:0:6502:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e200/0xf3fe2838e1fc26f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131003.278697:0:6502:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e200/0xf3fe2838e1fc26f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789131003.278753:0:6502:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:1.0:1789131003.278759:0:6502:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789131003.278799:0:6502:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e200/0xf3fe2838e1fc26f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131003.278811:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e200/0xf3fe2838e1fc26f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131003.278819:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fa00/0xf3fe2838e1fc26e9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131003.278825:0:6502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fa00/0xf3fe2838e1fc26e9 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131003.278831:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fa00/0xf3fe2838e1fc26e9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131003.278842:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc7f7fa00 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:1.0:1789131003.278846:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fa00/0xf3fe2838e1fc26e9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131003.278854:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fa00/0xf3fe2838e1fc26e9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131003.278863:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff91dded3a2b00) 00010000:00010000:1.0:1789131003.278865:0:6502:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789131003.278869:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fa00/0xf3fe2838e1fc26e9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131003.278875:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fa00/0xf3fe2838e1fc26e9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131003.278886:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7ee00/0xf3fe2838e1fc26f0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131003.278892:0:6502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7ee00/0xf3fe2838e1fc26f0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131003.278898:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7ee00/0xf3fe2838e1fc26f0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131003.278903:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc7f7ee00 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:1.0:1789131003.278905:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7ee00/0xf3fe2838e1fc26f0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131003.278910:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7ee00/0xf3fe2838e1fc26f0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131003.278928:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff91dded3a2500) 00010000:00010000:1.0:1789131003.278945:0:6502:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789131003.278949:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7ee00/0xf3fe2838e1fc26f0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131003.278956:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7ee00/0xf3fe2838e1fc26f0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131003.278989:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fe00/0xf3fe2838e1fc26e2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d2699e2 expref: 44 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131003.279002:0:6502:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e200/0xf3fe2838e1fc26f7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d2699e2 expref: 43 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131003.279009:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff91dde1922300) 00010000:00010000:1.0:1789131003.279011:0:6502:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789131003.279013:0:6502:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dcc7f7e200, rc 0) 00000100:00100000:1.0:1789131003.279042:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7ffc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+43:11473:x1876039498248832:12345-192.168.203.11@tcp:101:stat.0 Request processed in 15628us (15908us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131003.279050:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 63 00000100:00100000:1.0:1789131003.360203:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131003.360344:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498249472 00000100:00100000:2.0:1789131003.360353:0:14273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498249472 00000100:00100000:2.0:1789131003.360412:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 64 00000100:00100000:2.0:1789131003.360422:0:14273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01b31e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+43:11480:x1876039498249472:12345-192.168.203.11@tcp:36:truncate.0 00010000:00010000:2.0:1789131003.360507:0:14273:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789131003.360534:0:14273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e200/0xf3fe2838e1fc26f7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d2699e2 expref: 43 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131003.360555:0:14273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff91dde1922300) 00010000:00010000:2.0:1789131003.360560:0:14273:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789131003.360735:0:14273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f800/0xf3fe2838e1fc26fe lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131003.360749:0:14273:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f800/0xf3fe2838e1fc26fe lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131003.360759:0:14273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f800/0xf3fe2838e1fc26fe lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789131003.360800:0:14273:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967339 00000004:00010000:2.0:1789131003.360820:0:14273:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000008aef8d19 reply state 000000002ed8b071 transno 4294967340 ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f800/0xf3fe2838e1fc26fe lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131003.360831:0:14273:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f800/0xf3fe2838e1fc26fe lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131003.360837:0:14273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff91dde1922300) 00010000:00010000:2.0:1789131003.360840:0:14273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789131003.360842:0:14273:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789131003.361107:0:14273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01b31e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+45:11480:x1876039498249472:12345-192.168.203.11@tcp:36:truncate.0 Request processed in 684us (912us total) trans 4294967340 rc 0/0 00000100:00100000:2.0:1789131003.361115:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 64 00000020:00080000:2.0:1789131003.361120:0:14273:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789131003.474098:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd1dade00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3628:1876039508834816:0@lo:400:kworker.0 00000100:00100000:3.0:1789131003.474185:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131003.474248:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd1dae580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1876039508835328:0@lo:400:kworker.0 00000100:00100000:3.0:1789131003.474286:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131003.474303:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd1dac780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1876039508835840:0@lo:400:kworker.0 00000100:00100000:3.0:1789131003.474325:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131003.474349:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8609a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1876039508836352:0@lo:400:kworker.0 00000100:00100000:3.0:1789131003.474370:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131003.474392:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1789131003.474398:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd1dac3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3628:1876039508835200:0@lo:400:kworker.0 00000100:00100000:3.0:1789131003.474430:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131003.474446:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd1dae940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1876039508835712:0@lo:400:kworker.0 00000100:00100000:3.0:1789131003.474494:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131003.474523:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc850a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1876039508836224:0@lo:400:kworker.0 00000100:00100000:3.0:1789131003.474544:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131003.474568:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd1daf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3625:1876039508834944:0@lo:400:kworker.0 00000100:00100000:3.0:1789131003.474590:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131003.474615:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd1dada40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3625:1876039508835456:0@lo:400:kworker.0 00000100:00100000:3.0:1789131003.474636:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131003.474666:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7b24b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3625:1876039508835968:0@lo:400:kworker.0 00000100:00100000:3.0:1789131003.474691:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131003.474706:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1789131003.474711:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd1dad2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508835072:0@lo:400:kworker.0 00000100:00100000:3.0:1789131003.474749:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131003.474770:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd1daf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3625:1876039508835584:0@lo:400:kworker.0 00000100:00100000:3.0:1789131003.474803:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131003.474824:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7b27c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3625:1876039508836096:0@lo:400:kworker.0 00000100:00100000:3.0:1789131003.474845:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131003.474870:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508835328 00000100:00100000:3.0:1789131003.474877:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508835328 00000100:00100000:3.0:1789131003.474916:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508835072 00000100:00100000:3.0:1789131003.474920:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508835072 00000100:00100000:3.0:1789131003.474944:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1789131003.474953:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc2e87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3628:x1876039508835328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789131003.475005:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc2e87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3628:x1876039508835328:12345-0@lo:400:kworker.0 Request processed in 52us (718us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131003.475012:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1789131003.475029:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1789131003.475035:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd28692c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508835072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789131003.475065:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd28692c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508835072:12345-0@lo:400:kworker.0 Request processed in 31us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131003.475071:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1789131003.475106:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd1dad2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508835072:0@lo:400:kworker.0 00000100:00100000:3.0:1789131003.475138:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd1dae580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1876039508835328:0@lo:400:kworker.0 00000100:00100000:3.0:1789131003.475169:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508835840 00000100:00100000:3.0:1789131003.475173:0:9827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508835840 00000100:00100000:3.0:1789131003.475194:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508836352 00000100:00100000:3.0:1789131003.475197:0:9827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508836352 00000100:00100000:3.0:1789131003.475216:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508835712 00000100:00100000:3.0:1789131003.475219:0:9827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508835712 00000100:00100000:3.0:1789131003.475234:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508836224 00000100:00100000:3.0:1789131003.475237:0:9827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508836224 00000100:00100000:3.0:1789131003.475250:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1789131003.475256:0:9827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc2e852c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3628:x1876039508835840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789131003.475295:0:9827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc2e852c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3628:x1876039508835840:12345-0@lo:400:kworker.0 Request processed in 39us (968us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131003.475302:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1789131003.475313:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1789131003.475318:0:9827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc2e843c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3628:x1876039508836352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789131003.475344:0:9827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc2e843c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3628:x1876039508836352:12345-0@lo:400:kworker.0 Request processed in 27us (974us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131003.475349:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1789131003.475358:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1789131003.475363:0:9827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc2e85a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3628:x1876039508835712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789131003.475386:0:9827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc2e85a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3628:x1876039508835712:12345-0@lo:400:kworker.0 Request processed in 23us (892us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131003.475391:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1789131003.475402:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1789131003.475407:0:9827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc2e870c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3628:x1876039508836224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789131003.475432:0:9827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc2e870c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3628:x1876039508836224:12345-0@lo:400:kworker.0 Request processed in 25us (887us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131003.475448:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1789131003.475500:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd1dae940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1876039508835712:0@lo:400:kworker.0 00000100:00100000:3.0:1789131003.475510:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc850a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1876039508836224:0@lo:400:kworker.0 00000100:00100000:3.0:1789131003.475519:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd1dac780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1876039508835840:0@lo:400:kworker.0 00000100:00100000:3.0:1789131003.475527:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8609a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1876039508836352:0@lo:400:kworker.0 00000100:00100000:2.0:1789131003.475839:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508834816 00000100:00100000:2.0:1789131003.475845:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508834816 00000100:00100000:2.0:1789131003.475881:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 447 00000100:00100000:2.0:1789131003.475889:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddcf4fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+24:3628:x1876039508834816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131003.475952:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddcf4fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+24:3628:x1876039508834816:12345-0@lo:400:kworker.0 Request processed in 64us (1768us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131003.475959:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 447 00000100:00100000:2.0:1789131003.475999:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd1dade00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3628:1876039508834816:0@lo:400:kworker.0 00000100:00100000:0.0:1789131003.476481:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7d9b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508836480:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789131003.476686:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131003.476718:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789131003.476724:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd286d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508836608:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789131003.476748:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131003.476789:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508835200 00000100:00100000:0.0:1789131003.476793:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508835200 00000100:00100000:0.0:1789131003.476819:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508834944 00000100:00100000:0.0:1789131003.476823:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508834944 00000100:00100000:0.0:1789131003.476838:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508835456 00000100:00100000:0.0:1789131003.476840:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508835456 00000100:00100000:0.0:1789131003.476853:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508835968 00000100:00100000:0.0:1789131003.476855:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508835968 00000100:00100000:0.0:1789131003.476866:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508835584 00000100:00100000:0.0:1789131003.476868:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508835584 00000100:00100000:0.0:1789131003.476879:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508836096 00000100:00100000:0.0:1789131003.476881:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508836096 00000100:00100000:0.0:1789131003.476899:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:0.0:1789131003.476905:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc2e86580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3628:x1876039508835200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789131003.476953:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc2e86580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3628:x1876039508835200:12345-0@lo:400:kworker.0 Request processed in 48us (2523us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131003.476960:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:0.0:1789131003.476976:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:0.0:1789131003.476982:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc2e84b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1876039508834944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131003.477114:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd1dac3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3628:1876039508835200:0@lo:400:kworker.0 00000100:00100000:1.0:1789131003.477267:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508836480 00000100:00100000:1.0:1789131003.477283:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508836480 00000100:00100000:1.0:1789131003.477311:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508836608 00000100:00100000:1.0:1789131003.477314:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508836608 00000100:00100000:1.0:1789131003.477328:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1789131003.477335:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd286c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508836480:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789131003.477356:0:8419:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789131003.478547:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:2.0:1789131003.478567:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc2e84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1876039508835456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789131003.478610:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:0.0:1789131003.478674:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc2e84b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1876039508834944:12345-0@lo:400:kworker.0 Request processed in 1691us (4081us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131003.478682:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:0.0:1789131003.478705:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:0.0:1789131003.478712:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd28683c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1876039508835584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789131003.478760:0:14273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc2e86940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1876039508835968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789131003.480076:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd286c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508836480:12345-0@lo:13:osp-pre-1-1.0 Request processed in 2735us (3383us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131003.480088:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1789131003.480122:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1789131003.480134:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd286e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1876039508836608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789131003.480163:0:8419:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789131003.480205:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd286e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1876039508836608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (3457us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131003.480210:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00080000:1.0:1789131003.480241:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789131003.480246:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789131003.480249:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789131003.480251:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789131003.480262:0:6502:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 5 min 3 max 116 00000100:00100000:1.0:1789131003.480280:0:6502:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_005' 00000100:00100000:1.0:1789131003.480403:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:1.0:1789131003.480410:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd286a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1876039508836096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789131003.480442:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd286a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1876039508836096:12345-0@lo:400:kworker.0 Request processed in 33us (5595us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131003.480448:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:1.0:1789131003.483827:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd286d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508836608:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789131003.483848:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7d9b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508836480:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789131003.485554:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc2e84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1876039508835456:12345-0@lo:400:kworker.0 Request processed in 6986us (10907us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131003.485567:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:3.0:1789131003.498748:0:14273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc2e86940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1876039508835968:12345-0@lo:400:kworker.0 Request processed in 20119us (24045us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131003.498764:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:0.0:1789131003.505439:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd28683c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1876039508835584:12345-0@lo:400:kworker.0 Request processed in 26716us (30624us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131003.505471:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00010000:00080000:1.0:1789131003.506212:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91ddd1daf0c0 x1876039508835584/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789131019 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789131003.506229:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd1daf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3625:1876039508835584:0@lo:400:kworker.0 00010000:00080000:1.0:1789131003.506247:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc7b27c00 x1876039508836096/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789131019 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789131003.506329:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7b27c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3625:1876039508836096:0@lo:400:kworker.0 00000100:00100000:1.0:1789131003.506348:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd1daf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3625:1876039508834944:0@lo:400:kworker.0 00000100:00100000:1.0:1789131003.506358:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd1dada40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3625:1876039508835456:0@lo:400:kworker.0 00000100:00100000:1.0:1789131003.506368:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7b24b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3625:1876039508835968:0@lo:400:kworker.0 00000100:00100000:0.0:1789131003.534245:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789131003.534612:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498249600 00000100:00100000:1.0:1789131003.534623:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498249600 00000100:00100000:1.0:1789131003.535150:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 65 00000100:00100000:1.0:1789131003.535163:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd286da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+45:11494:x1876039498249600:12345-192.168.203.11@tcp:101:stat.0 00010000:00010000:1.0:1789131003.535193:0:6502:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789131003.535215:0:6502:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85caa00/0xf3fe2838e1fc2705 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d2699e9 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131003.535294:0:6502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb800/0xf3fe2838e1fc270c lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131003.535309:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb800/0xf3fe2838e1fc270c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131003.535321:0:6502:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb800/0xf3fe2838e1fc270c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131003.535331:0:6502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb200/0xf3fe2838e1fc2713 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131003.535338:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb200/0xf3fe2838e1fc2713 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131003.535365:0:6502:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb200/0xf3fe2838e1fc2713 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131003.535443:0:6502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb600/0xf3fe2838e1fc271a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131003.535482:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb600/0xf3fe2838e1fc271a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131003.535491:0:6502:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb600/0xf3fe2838e1fc271a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789131003.535542:0:6502:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00000004:00200000:1.0:1789131003.535547:0:6502:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789131003.535567:0:6502:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb600/0xf3fe2838e1fc271a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131003.535578:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb600/0xf3fe2838e1fc271a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131003.535586:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb800/0xf3fe2838e1fc270c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131003.535591:0:6502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb800/0xf3fe2838e1fc270c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131003.535597:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb800/0xf3fe2838e1fc270c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131003.535602:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc85cb800 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:1.0:1789131003.535606:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb800/0xf3fe2838e1fc270c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131003.535621:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb800/0xf3fe2838e1fc270c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131003.535632:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff91dded3a2b00) 00010000:00010000:1.0:1789131003.535636:0:6502:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789131003.535641:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb800/0xf3fe2838e1fc270c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131003.535646:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb800/0xf3fe2838e1fc270c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131003.535659:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb200/0xf3fe2838e1fc2713 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131003.535676:0:6502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb200/0xf3fe2838e1fc2713 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131003.535682:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb200/0xf3fe2838e1fc2713 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131003.535687:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc85cb200 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:1.0:1789131003.535690:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb200/0xf3fe2838e1fc2713 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131003.535695:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb200/0xf3fe2838e1fc2713 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131003.535702:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff91dded3a2500) 00010000:00010000:1.0:1789131003.535704:0:6502:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789131003.535707:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb200/0xf3fe2838e1fc2713 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131003.535722:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb200/0xf3fe2838e1fc2713 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131003.535750:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85caa00/0xf3fe2838e1fc2705 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d2699e9 expref: 47 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131003.535764:0:6502:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb600/0xf3fe2838e1fc271a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d2699e9 expref: 46 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131003.535771:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff91dde1922300) 00010000:00010000:1.0:1789131003.535774:0:6502:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789131003.535776:0:6502:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dcc85cb600, rc 0) 00000100:00100000:1.0:1789131003.535848:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd286da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+46:11494:x1876039498249600:12345-192.168.203.11@tcp:101:stat.0 Request processed in 688us (1610us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131003.535856:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 65 00000100:00100000:3.0:1789131003.644261:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789131003.644323:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498249856 00000100:00100000:1.0:1789131003.644333:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498249856 00000100:00100000:1.0:1789131003.644399:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 66 00000100:00100000:1.0:1789131003.644409:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd2869a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+46:11504:x1876039498249856:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:1.0:1789131003.644428:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789131003.644447:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85caa00/0xf3fe2838e1fc2721 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d2699f0 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789131003.644580:0:6500:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1789131003.644681:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85caa00/0xf3fe2838e1fc2721 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d2699f0 expref: 48 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131003.644712:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91dcc7d6ac00) 00010000:00010000:1.0:1789131003.644715:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789131003.644721:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85caa00/0xf3fe2838e1fc2721 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d2699f0 expref: 48 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131003.644736:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dcc85caa00, rc 0) 00000100:00100000:1.0:1789131003.644787:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd2869a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+47:11504:x1876039498249856:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 381us (536us total) trans 4294967341 rc 301/301 00000100:00100000:1.0:1789131003.644796:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 66 00000100:00100000:3.0:1789131003.648444:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131003.648555:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498250112 00000100:00100000:0.0:1789131003.648564:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498250112 00000100:00100000:0.0:1789131003.648611:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 14 00000100:00100000:0.0:1789131003.648621:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd286b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+47:11504:x1876039498250112:12345-192.168.203.11@tcp:35:lfs.0 00000100:00100000:0.0:1789131003.648844:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd286b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+48:11504:x1876039498250112:12345-192.168.203.11@tcp:35:lfs.0 Request processed in 224us (409us total) trans 4294967342 rc 0/0 00000100:00100000:0.0:1789131003.648852:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 14 00000100:00100000:0.0:1789131003.759985:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131003.760078:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498250368 00000100:00100000:3.0:1789131003.760089:0:14273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498250368 00000100:00100000:3.0:1789131003.760156:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 67 00000100:00100000:3.0:1789131003.760166:0:14273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd286f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+48:11510:x1876039498250368:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:3.0:1789131003.760190:0:14273:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789131003.760211:0:14273:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4a00/0xf3fe2838e1fc272f lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d2699f7 expref: -99 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131003.760311:0:14273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5800/0xf3fe2838e1fc2736 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131003.760325:0:14273:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb600/0xf3fe2838e1fc271a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d2699e9 expref: 49 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131003.760349:0:14273:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5800/0xf3fe2838e1fc2736 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131003.760382:0:14273:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb600/0xf3fe2838e1fc271a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d2699e9 expref: 49 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131003.760396:0:14273:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb600/0xf3fe2838e1fc271a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d2699e9 expref: 49 pid: 6502 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131003.760408:0:14273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd286a940 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14273:1876039508836736:192.168.203.11@tcp:104: 00000100:00100000:3.0:1789131003.760559:0:14273:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddd831e540 going to sleep for 11 seconds 00000100:00100000:3.0:1789131003.765573:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131003.765692:0:14273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd286a940 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14273:1876039508836736:192.168.203.11@tcp:104: 00010000:00010000:2.0:1789131003.765720:0:14273:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5800/0xf3fe2838e1fc2736 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131003.766016:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498250496 00000100:00100000:0.0:1789131003.766024:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498250496 00010000:00010000:0.0:1789131003.766059:0:6487:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb600/0xf3fe2838e1fc271a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d2699e9 expref: 50 pid: 6502 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131003.766095:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 69 00000100:00100000:0.0:1789131003.766103:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd2868000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+50:2388:x1876039498250496:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789131003.766117:0:6487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789131003.766123:0:6487:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb600/0xf3fe2838e1fc271a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d2699e9 expref: 50 pid: 6502 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131003.766134:0:6487:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb600/0xf3fe2838e1fc271a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d2699e9 expref: 50 pid: 6502 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131003.766184:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb600/0xf3fe2838e1fc271a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d2699e9 expref: 50 pid: 6502 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131003.766199:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff91dde1922300) 00010000:00010000:0.0:1789131003.766203:0:6487:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5800/0xf3fe2838e1fc2736 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131003.766213:0:6487:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5800/0xf3fe2838e1fc2736 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131003.766220:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5800/0xf3fe2838e1fc2736 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131003.766246:0:6487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789131003.766303:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd2868000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+49:2388:x1876039498250496:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 200us (738us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131003.766311:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 69 00010000:00010000:2.0:1789131003.766372:0:14273:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5800/0xf3fe2838e1fc2736 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131003.766380:0:14273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5800/0xf3fe2838e1fc2736 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789131003.766396:0:14273:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00010000:00010000:2.0:1789131003.766553:0:14273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4a00/0xf3fe2838e1fc272f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d2699f7 expref: 50 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131003.766568:0:14273:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5800/0xf3fe2838e1fc2736 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d2699f7 expref: 49 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131003.766576:0:14273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff91dde1922300) 00010000:00010000:2.0:1789131003.766590:0:14273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789131003.766599:0:14273:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ddfd0b5800, rc 0) 00000100:00100000:2.0:1789131003.766624:0:14273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd286f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+49:11510:x1876039498250368:12345-192.168.203.11@tcp:101:bash.0 Request processed in 6461us (6650us total) trans 4294967343 rc 0/0 00000100:00100000:2.0:1789131003.766637:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 67 00000100:00100000:1.0:1789131003.770557:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131003.771023:0:14851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498250752 00000100:00100000:2.0:1789131003.771033:0:14851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498250752 00000100:00100000:2.0:1789131003.771093:0:14851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 68 00000100:00100000:2.0:1789131003.771103:0:14851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01b33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+49:11510:x1876039498250752:12345-192.168.203.11@tcp:36:bash.0 00010000:00010000:2.0:1789131003.771330:0:14851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e200/0xf3fe2838e1fc2744 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131003.771347:0:14851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e200/0xf3fe2838e1fc2744 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131003.771358:0:14851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e200/0xf3fe2838e1fc2744 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789131003.771397:0:14851:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967344 00000004:00010000:2.0:1789131003.771415:0:14851:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000003d9e63dd reply state 000000006845ad6e transno 4294967345 ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e200/0xf3fe2838e1fc2744 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131003.771428:0:14851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e200/0xf3fe2838e1fc2744 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131003.771435:0:14851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff91dde1922300) 00010000:00010000:2.0:1789131003.771438:0:14851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789131003.771442:0:14851:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789131003.771558:0:14851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01b33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+52:11510:x1876039498250752:12345-192.168.203.11@tcp:36:bash.0 Request processed in 456us (1009us total) trans 4294967345 rc 0/0 00000100:00100000:2.0:1789131003.771566:0:14851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 68 00000020:00080000:2.0:1789131003.771571:0:14851:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789131003.786347:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131003.787226:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498250880 00000100:00100000:0.0:1789131003.787234:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498250880 00000100:00100000:0.0:1789131003.787289:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 69 00000100:00100000:0.0:1789131003.787295:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01b312c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+52:11510:x1876039498250880:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:0.0:1789131003.787315:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789131003.787330:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc274b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d2699fe expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131003.787401:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6600/0xf3fe2838e1fc2752 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131003.787426:0:6500:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5800/0xf3fe2838e1fc2736 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d2699f7 expref: 53 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131003.787432:0:6500:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6600/0xf3fe2838e1fc2752 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131003.787489:0:6500:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5800/0xf3fe2838e1fc2736 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d2699f7 expref: 53 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131003.787504:0:6500:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5800/0xf3fe2838e1fc2736 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d2699f7 expref: 53 pid: 14273 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131003.787518:0:6500:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd286e940 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6500:1876039508836864:192.168.203.11@tcp:104: 00000100:00100000:0.0:1789131003.787603:0:6500:0:(client.c:2715:ptlrpc_set_wait()) set ffff91dcc7c5a000 going to sleep for 11 seconds 00000100:00100000:1.0:1789131003.790011:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131003.790096:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498251008 00000100:00100000:2.0:1789131003.790117:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498251008 00010000:00010000:2.0:1789131003.790161:0:8431:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5800/0xf3fe2838e1fc2736 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d2699f7 expref: 54 pid: 14273 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131003.790201:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 70 00000100:00100000:2.0:1789131003.790211:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01b303c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+54:2387:x1876039498251008:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789131003.790224:0:8431:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789131003.790231:0:8431:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5800/0xf3fe2838e1fc2736 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d2699f7 expref: 54 pid: 14273 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131003.790244:0:8431:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5800/0xf3fe2838e1fc2736 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d2699f7 expref: 54 pid: 14273 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131003.790265:0:8431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff91dde1922300) 00010000:00010000:2.0:1789131003.790270:0:8431:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6600/0xf3fe2838e1fc2752 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131003.790280:0:8431:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6600/0xf3fe2838e1fc2752 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131003.790289:0:8431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6600/0xf3fe2838e1fc2752 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131003.790307:0:8431:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789131003.790355:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01b303c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+54:2387:x1876039498251008:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 145us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131003.790364:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 70 00010000:00010000:0.0:1789131003.791825:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5800/0xf3fe2838e1fc2736 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d2699f7 expref: 53 pid: 14273 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131003.791848:0:6500:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd286e940 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6500:1876039508836864:192.168.203.11@tcp:104: 00010000:00010000:0.0:1789131003.791871:0:6500:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6600/0xf3fe2838e1fc2752 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131003.791881:0:6500:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6600/0xf3fe2838e1fc2752 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131003.791887:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6600/0xf3fe2838e1fc2752 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789131003.791947:0:6500:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1789131003.791964:0:6500:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789131003.791992:0:6500:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6600/0xf3fe2838e1fc2752 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131003.792026:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc274b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d2699fe expref: 53 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131003.792041:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6600/0xf3fe2838e1fc2752 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d2699fe expref: 52 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131003.792051:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff91dde1922300) 00010000:00010000:0.0:1789131003.792054:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789131003.792057:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91de01ad6600, rc 0) 00000100:00100000:0.0:1789131003.792157:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01b312c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+52:11510:x1876039498250880:12345-192.168.203.11@tcp:101:bash.0 Request processed in 4860us (5820us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131003.792166:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 69 00010000:00010000:1.0:1789131003.793819:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789131003.795849:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131003.796115:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498251264 00000100:00100000:0.0:1789131003.796124:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498251264 00000100:00100000:0.0:1789131003.796287:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 15 00000100:00100000:0.0:1789131003.796298:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dded1d4850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+52:11510:x1876039498251264:12345-192.168.203.11@tcp:35:bash.0 00000100:00100000:0.0:1789131003.796531:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dded1d4850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+53:11510:x1876039498251264:12345-192.168.203.11@tcp:35:bash.0 Request processed in 234us (689us total) trans 4294967346 rc 0/0 00000100:00100000:0.0:1789131003.796539:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 15 00000100:00100000:3.0:1789131003.872419:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131003.872886:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498251520 00000100:00100000:0.0:1789131003.872896:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498251520 00000100:00100000:0.0:1789131003.872970:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 70 00000100:00100000:0.0:1789131003.872982:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd2868780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+53:11520:x1876039498251520:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:0.0:1789131003.873005:0:6501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789131003.873039:0:6501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc2759 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269a05 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789131003.873129:0:6501:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1789131003.873221:0:6501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc2759 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269a05 expref: 55 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131003.873241:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91dcc7d6ac00) 00010000:00010000:0.0:1789131003.873245:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789131003.873250:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc2759 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269a05 expref: 55 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131003.873264:0:6501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91de01ad7600, rc 0) 00000100:00100000:0.0:1789131003.873324:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd2868780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+54:11520:x1876039498251520:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 343us (912us total) trans 4294967347 rc 301/301 00000100:00100000:0.0:1789131003.873331:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 70 00000100:00100000:1.0:1789131003.881125:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131003.881275:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498251648 00000100:00100000:3.0:1789131003.881285:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498251648 00000100:00100000:3.0:1789131003.881336:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 71 00000100:00100000:3.0:1789131003.881345:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01b32580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+54:11520:x1876039498251648:12345-192.168.203.11@tcp:34:lfs.0 00010000:00010000:3.0:1789131003.881414:0:6502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc2767 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131003.881430:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc2767 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131003.883302:0:6502:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc2767 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131003.884124:0:6502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f600/0xf3fe2838e1fc276e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131003.884153:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f600/0xf3fe2838e1fc276e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131003.884164:0:6502:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f600/0xf3fe2838e1fc276e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131003.884240:0:6502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e800/0xf3fe2838e1fc2775 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131003.884249:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e800/0xf3fe2838e1fc2775 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131003.884256:0:6502:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e800/0xf3fe2838e1fc2775 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789131003.884310:0:6502:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e800/0xf3fe2838e1fc2775 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131003.884324:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc2767 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131003.884331:0:6502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc2767 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131003.884338:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc2767 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131003.884345:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddfd0b5a00 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:2.0:1789131003.884349:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc2767 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131003.884357:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc2767 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131003.884375:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff91dded3a2b00) 00010000:00010000:2.0:1789131003.884377:0:6502:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789131003.884382:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc2767 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131003.884388:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc2767 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131003.884401:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f600/0xf3fe2838e1fc276e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131003.884407:0:6502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f600/0xf3fe2838e1fc276e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131003.884412:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f600/0xf3fe2838e1fc276e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131003.884418:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc7f7f600 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:2.0:1789131003.884421:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f600/0xf3fe2838e1fc276e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131003.884427:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f600/0xf3fe2838e1fc276e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131003.884434:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff91dded3a2500) 00010000:00010000:2.0:1789131003.884436:0:6502:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789131003.884438:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f600/0xf3fe2838e1fc276e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131003.884444:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f600/0xf3fe2838e1fc276e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131003.884480:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e800/0xf3fe2838e1fc2775 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131003.884487:0:6502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e800/0xf3fe2838e1fc2775 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131003.884492:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e800/0xf3fe2838e1fc2775 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131003.884496:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc7f7e800 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:2.0:1789131003.884499:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e800/0xf3fe2838e1fc2775 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131003.884504:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e800/0xf3fe2838e1fc2775 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131003.884512:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff91dde1922300) 00010000:00010000:2.0:1789131003.884515:0:6502:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789131003.884518:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e800/0xf3fe2838e1fc2775 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131003.884522:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e800/0xf3fe2838e1fc2775 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131003.884770:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01b32580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+54:11520:x1876039498251648:12345-192.168.203.11@tcp:34:lfs.0 Request processed in 3421us (3648us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131003.884781:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 71 00000100:00100000:1.0:1789131003.892132:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131003.892211:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498251904 00000100:00100000:2.0:1789131003.892222:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498251904 00000100:00100000:2.0:1789131003.892272:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 16 00000100:00100000:2.0:1789131003.892293:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01b31a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+54:11520:x1876039498251904:12345-192.168.203.11@tcp:35:lfs.0 00000100:00100000:2.0:1789131003.892563:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01b31a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+55:11520:x1876039498251904:12345-192.168.203.11@tcp:35:lfs.0 Request processed in 270us (440us total) trans 4294967348 rc 0/0 00000100:00100000:2.0:1789131003.892571:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 16 00000100:00100000:2.0:1789131003.937568:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131003.937685:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498252160 00000100:00100000:0.0:1789131003.937695:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498252160 00000100:00100000:0.0:1789131003.937763:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 72 00000100:00100000:0.0:1789131003.937773:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8609a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+55:11523:x1876039498252160:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:0.0:1789131003.937796:0:9769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789131003.937818:0:9769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc277c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269a0c expref: -99 pid: 9769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131003.937886:0:9769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6200/0xf3fe2838e1fc2783 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131003.937901:0:9769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6200/0xf3fe2838e1fc2783 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131003.937936:0:9769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6200/0xf3fe2838e1fc2783 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131003.937948:0:9769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6a00/0xf3fe2838e1fc278a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131003.937956:0:9769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6a00/0xf3fe2838e1fc278a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131003.937963:0:9769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6a00/0xf3fe2838e1fc278a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131003.938077:0:9769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7c00/0xf3fe2838e1fc2791 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131003.938087:0:9769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7c00/0xf3fe2838e1fc2791 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131003.938095:0:9769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7c00/0xf3fe2838e1fc2791 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789131003.938104:0:9769:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:0.0:1789131003.938191:0:9769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6200/0xf3fe2838e1fc2783 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131003.938199:0:9769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6200/0xf3fe2838e1fc2783 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131003.938205:0:9769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6200/0xf3fe2838e1fc2783 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131003.938211:0:9769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91de01ad6200 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:0.0:1789131003.938222:0:9769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6200/0xf3fe2838e1fc2783 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131003.938230:0:9769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6200/0xf3fe2838e1fc2783 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131003.938242:0:9769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff91dded3a2b00) 00010000:00010000:0.0:1789131003.938245:0:9769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789131003.938250:0:9769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6200/0xf3fe2838e1fc2783 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131003.938257:0:9769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6200/0xf3fe2838e1fc2783 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131003.938271:0:9769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6a00/0xf3fe2838e1fc278a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131003.938277:0:9769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6a00/0xf3fe2838e1fc278a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131003.938283:0:9769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6a00/0xf3fe2838e1fc278a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131003.938288:0:9769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91de01ad6a00 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:0.0:1789131003.938291:0:9769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6a00/0xf3fe2838e1fc278a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131003.938297:0:9769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6a00/0xf3fe2838e1fc278a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131003.938303:0:9769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff91dded3a2500) 00010000:00010000:0.0:1789131003.938305:0:9769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789131003.938315:0:9769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6a00/0xf3fe2838e1fc278a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131003.938321:0:9769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6a00/0xf3fe2838e1fc278a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131003.938360:0:9769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc277c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269a0c expref: 58 pid: 9769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131003.938374:0:9769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7c00/0xf3fe2838e1fc2791 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269a0c expref: 57 pid: 9769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131003.938381:0:9769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff91dde1922300) 00010000:00010000:0.0:1789131003.938383:0:9769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789131003.938385:0:9769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91de01ad7c00, rc 0) 00000100:00100000:0.0:1789131003.938453:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8609a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+57:11523:x1876039498252160:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 681us (896us total) trans 4294967349 rc 0/0 00000100:00100000:0.0:1789131003.939127:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 72 00000100:00100000:1.0:1789131003.944652:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789131003.944694:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131003.944787:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498252288 00000100:00100000:0.0:1789131003.944797:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498252288 00000100:00100000:0.0:1789131003.944850:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 73 00000100:00100000:0.0:1789131003.944861:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01b330c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+57:11523:x1876039498252288:12345-192.168.203.11@tcp:54:lfs.0 00010000:00010000:0.0:1789131003.944935:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7800/0xf3fe2838e1fc279f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131003.944953:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7800/0xf3fe2838e1fc279f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131003.944963:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7800/0xf3fe2838e1fc279f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131003.945026:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7800/0xf3fe2838e1fc279f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131003.945034:0:6501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7800/0xf3fe2838e1fc279f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131003.945039:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7800/0xf3fe2838e1fc279f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131003.945045:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91de01ad7800 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:0.0:1789131003.945049:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7800/0xf3fe2838e1fc279f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131003.945056:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7800/0xf3fe2838e1fc279f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131003.945066:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff91dde1922300) 00010000:00010000:0.0:1789131003.945069:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789131003.945073:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7800/0xf3fe2838e1fc279f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131003.945078:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7800/0xf3fe2838e1fc279f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131003.945155:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01b330c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+57:11523:x1876039498252288:12345-192.168.203.11@tcp:54:lfs.0 Request processed in 295us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131003.945162:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 73 00000100:00100000:3.0:1789131003.945379:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498252416 00000100:00100000:3.0:1789131003.945383:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498252416 00000100:00100000:3.0:1789131003.945425:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 5 00000100:00100000:3.0:1789131003.945433:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc33ac450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+57:2388:x1876039498252416:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789131003.945444:0:6487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789131003.945487:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7c00/0xf3fe2838e1fc2791 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269a0c expref: 57 pid: 9769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131003.945500:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff91dde1922300) 00010000:00010000:3.0:1789131003.945504:0:6487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789131003.945525:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc33ac450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+56:2388:x1876039498252416:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 94us (830us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131003.945532:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 5 00000100:00100000:2.0:1789131003.953433:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131003.953640:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498252672 00000100:00100000:0.0:1789131003.953650:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498252672 00000100:00100000:0.0:1789131003.953706:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 17 00000100:00100000:0.0:1789131003.953733:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc12abc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+56:11523:x1876039498252672:12345-192.168.203.11@tcp:35:lfs.0 00000100:00100000:0.0:1789131003.953994:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc12abc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+57:11523:x1876039498252672:12345-192.168.203.11@tcp:35:lfs.0 Request processed in 264us (571us total) trans 4294967350 rc 0/0 00000100:00100000:0.0:1789131003.954011:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 17 00000100:00100000:2.0:1789131003.991447:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd286e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1876039508836992:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789131003.991533:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1789131003.991650:0:8862:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 359909190434ns, next at 360909187195ns, rc = 0 00000100:00100000:1.0:1789131003.991734:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508836992 00000100:00100000:1.0:1789131003.991741:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508836992 00000100:00100000:1.0:1789131003.991796:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1789131003.991806:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc12a8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3627:x1876039508836992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789131003.991826:0:8419:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789131003.995380:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc12a8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3627:x1876039508836992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3566us (3836us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131003.995397:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1789131003.999376:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd286e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1876039508836992:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789131004.101553:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789131004.105958:0:14851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498252928 00000100:00100000:1.0:1789131004.105973:0:14851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498252928 00000100:00100000:1.0:1789131004.106057:0:14851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 74 00000100:00100000:1.0:1789131004.106069:0:14851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc6ffa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+57:11541:x1876039498252928:12345-192.168.203.11@tcp:101:cat.0 00010000:00010000:1.0:1789131004.106093:0:14851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789131004.106115:0:14851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cae00/0xf3fe2838e1fc27a6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269a13 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.106227:0:14851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca400/0xf3fe2838e1fc27ad lrc: 3/1,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.106243:0:14851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca400/0xf3fe2838e1fc27ad lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.106256:0:14851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca400/0xf3fe2838e1fc27ad lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789131004.106266:0:14851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:1.0:1789131004.106375:0:14851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cae00/0xf3fe2838e1fc27a6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269a13 expref: 60 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.106396:0:14851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca400/0xf3fe2838e1fc27ad lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269a13 expref: 59 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.106405:0:14851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff91dde1922300) 00010000:00010000:1.0:1789131004.106409:0:14851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1789131004.106413:0:14851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dcc85ca400, rc 0) 00000100:00100000:1.0:1789131004.106758:0:14851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc6ffa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+59:11541:x1876039498252928:12345-192.168.203.11@tcp:101:cat.0 Request processed in 689us (5213us total) trans 4294967351 rc 0/0 00000100:00100000:1.0:1789131004.106782:0:14851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 74 00000100:00100000:1.0:1789131004.147303:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131004.147395:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498253056 00000100:00100000:0.0:1789131004.147404:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498253056 00000100:00100000:0.0:1789131004.147491:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 75 00000100:00100000:0.0:1789131004.147502:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01b32940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+59:11542:x1876039498253056:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:0.0:1789131004.147525:0:9769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789131004.147547:0:9769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc27bb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269a1a expref: -99 pid: 9769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131004.147607:0:9769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6a00/0xf3fe2838e1fc27c2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131004.147622:0:9769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6a00/0xf3fe2838e1fc27c2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131004.147633:0:9769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6a00/0xf3fe2838e1fc27c2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789131004.147675:0:9769:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1789131004.147679:0:9769:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789131004.147698:0:9769:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6a00/0xf3fe2838e1fc27c2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131004.147723:0:9769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc27bb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269a1a expref: 61 pid: 9769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131004.147760:0:9769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6a00/0xf3fe2838e1fc27c2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269a1a expref: 60 pid: 9769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131004.147769:0:9769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff91dded3a2b00) 00010000:00010000:0.0:1789131004.147772:0:9769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789131004.147776:0:9769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91de01ad6a00, rc 0) 00000100:00100000:0.0:1789131004.147836:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01b32940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+60:11542:x1876039498253056:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 335us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131004.147844:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 75 00000100:00100000:0.0:1789131004.164805:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131004.164891:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498253440 00000100:00100000:3.0:1789131004.164901:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498253440 00000100:00100000:3.0:1789131004.164969:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 18 00000100:00100000:3.0:1789131004.164979:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd286c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+60:11542:x1876039498253440:12345-192.168.203.11@tcp:35:lfs.0 00000100:00100000:3.0:1789131004.165259:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd286c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+61:11542:x1876039498253440:12345-192.168.203.11@tcp:35:lfs.0 Request processed in 281us (463us total) trans 4294967352 rc 0/0 00000100:00100000:3.0:1789131004.165268:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 18 00000100:00100000:2.0:1789131004.167618:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789131004.167930:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498253568 00000100:00100000:1.0:1789131004.167940:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498253568 00000100:00100000:1.0:1789131004.168005:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 6 00000100:00100000:1.0:1789131004.168015:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc6ff8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+61:11542:x1876039498253568:12345-192.168.203.11@tcp:103:lfs.0 00010000:00010000:1.0:1789131004.168029:0:8431:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1789131004.168052:0:8431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6600/0xf3fe2838e1fc2752 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d2699fe expref: 61 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.168075:0:8431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca400/0xf3fe2838e1fc27ad lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269a13 expref: 60 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.168090:0:8431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e000/0xf3fe2838e1fc264f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d2699b8 expref: 59 pid: 9769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.168100:0:8431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff91dde1922300) 00010000:00010000:1.0:1789131004.168105:0:8431:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789131004.168168:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc6ff8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+58:11542:x1876039498253568:12345-192.168.203.11@tcp:103:lfs.0 Request processed in 155us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131004.168176:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 6 00000100:00100000:1.0:1789131004.171522:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131004.171622:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498253696 00000100:00100000:0.0:1789131004.171632:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498253696 00000100:00100000:0.0:1789131004.171691:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 76 00000100:00100000:0.0:1789131004.171702:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01b30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+58:11542:x1876039498253696:12345-192.168.203.11@tcp:58:lfs.0 00010000:00010000:0.0:1789131004.171822:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6200/0xf3fe2838e1fc27c9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131004.171840:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6200/0xf3fe2838e1fc27c9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131004.171852:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6200/0xf3fe2838e1fc27c9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789131004.172103:0:6501:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789131004.172256:0:6501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:0.0:1789131004.172333:0:6501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:0.0:1789131004.172415:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01b30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+58:11542:x1876039498253696:12345-192.168.203.11@tcp:58:lfs.0 Request processed in 713us (899us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131004.172430:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 76 00000100:00100000:0.0:1789131004.197690:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789131004.200281:0:14851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498253824 00000100:00100000:1.0:1789131004.200294:0:14851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498253824 00000100:00100000:1.0:1789131004.200367:0:14851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 77 00000100:00100000:1.0:1789131004.200377:0:14851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd286c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+58:11544:x1876039498253824:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:1.0:1789131004.200410:0:14851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789131004.201208:0:14851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca400/0xf3fe2838e1fc27d0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269a21 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.201282:0:14851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cac00/0xf3fe2838e1fc27d7 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.201297:0:14851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cac00/0xf3fe2838e1fc27d7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.201309:0:14851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cac00/0xf3fe2838e1fc27d7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.201319:0:14851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca000/0xf3fe2838e1fc27de lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.201324:0:14851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca000/0xf3fe2838e1fc27de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.201330:0:14851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca000/0xf3fe2838e1fc27de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.201398:0:14851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca200/0xf3fe2838e1fc27e5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.201407:0:14851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca200/0xf3fe2838e1fc27e5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.201414:0:14851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca200/0xf3fe2838e1fc27e5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789131004.201673:0:14851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:1.0:1789131004.201691:0:14851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789131004.201717:0:14851:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca200/0xf3fe2838e1fc27e5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.201936:0:14851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca200/0xf3fe2838e1fc27e5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.201948:0:14851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cac00/0xf3fe2838e1fc27d7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.201955:0:14851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cac00/0xf3fe2838e1fc27d7 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.201961:0:14851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cac00/0xf3fe2838e1fc27d7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.201967:0:14851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc85cac00 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:1.0:1789131004.201971:0:14851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cac00/0xf3fe2838e1fc27d7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.201978:0:14851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cac00/0xf3fe2838e1fc27d7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.201989:0:14851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff91dded3a2b00) 00010000:00010000:1.0:1789131004.201991:0:14851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789131004.201996:0:14851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cac00/0xf3fe2838e1fc27d7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.202000:0:14851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cac00/0xf3fe2838e1fc27d7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.202014:0:14851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca000/0xf3fe2838e1fc27de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.202029:0:14851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca000/0xf3fe2838e1fc27de lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.202034:0:14851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca000/0xf3fe2838e1fc27de lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.202038:0:14851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc85ca000 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:1.0:1789131004.202040:0:14851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca000/0xf3fe2838e1fc27de lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.202045:0:14851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca000/0xf3fe2838e1fc27de lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.202052:0:14851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff91dded3a2500) 00010000:00010000:1.0:1789131004.202055:0:14851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789131004.202057:0:14851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca000/0xf3fe2838e1fc27de lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.202062:0:14851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca000/0xf3fe2838e1fc27de lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.202093:0:14851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca400/0xf3fe2838e1fc27d0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269a21 expref: 60 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.202104:0:14851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca200/0xf3fe2838e1fc27e5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269a21 expref: 59 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.202110:0:14851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff91dde1922300) 00010000:00010000:1.0:1789131004.202113:0:14851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789131004.202120:0:14851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dcc85ca200, rc 0) 00000100:00100000:1.0:1789131004.203387:0:14851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd286c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+59:11544:x1876039498253824:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 3003us (5698us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131004.203399:0:14851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 77 00000040:00080000:0.0:1789131004.433732:0:14475:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789131004.433742:0:14475:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789131004.433787:0:14475:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1789131004.433794:0:14475:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789131004.433945:0:14475:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd286ed00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14475:1876039508837120:192.168.203.11@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789131004.434103:0:14475:0:(client.c:2715:ptlrpc_set_wait()) set ffff91dcc7c5a780 going to sleep for 11 seconds 00000100:00100000:0.0:1789131004.442830:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131004.442905:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498253952 00000100:00100000:2.0:1789131004.442932:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498253952 00000100:00100000:2.0:1789131004.442989:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 78 00000100:00100000:2.0:1789131004.442999:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd286fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+60:11556:x1876039498253952:12345-192.168.203.11@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789131004.443029:0:9769:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789131004.443182:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd286fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+60:11556:x1876039498253952:12345-192.168.203.11@tcp:53:lhsmtool_posix.0 Request processed in 183us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131004.443190:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 78 00000100:00100000:3.0:1789131004.445812:0:14475:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd286ed00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14475:1876039508837120:192.168.203.11@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789131004.453886:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131004.454767:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498254080 00000100:00100000:0.0:1789131004.454777:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498254080 00000100:00100000:0.0:1789131004.454839:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 79 00000100:00100000:0.0:1789131004.454850:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc6ffad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+59:11556:x1876039498254080:12345-192.168.203.11@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1789131004.455035:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6600/0xf3fe2838e1fc27ec lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131004.455051:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6600/0xf3fe2838e1fc27ec lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131004.455062:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6600/0xf3fe2838e1fc27ec lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131004.455115:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc27f3 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131004.455123:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc27f3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131004.455130:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc27f3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131004.455294:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7800/0xf3fe2838e1fc27fa lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131004.455303:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7800/0xf3fe2838e1fc27fa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131004.455310:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7800/0xf3fe2838e1fc27fa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789131004.455352:0:6501:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1789131004.455356:0:6501:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789131004.455369:0:6501:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7800/0xf3fe2838e1fc27fa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131004.455380:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6600/0xf3fe2838e1fc27ec lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131004.455387:0:6501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6600/0xf3fe2838e1fc27ec lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131004.455394:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6600/0xf3fe2838e1fc27ec lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131004.455400:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91de01ad6600 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:0.0:1789131004.455403:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6600/0xf3fe2838e1fc27ec lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131004.455410:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6600/0xf3fe2838e1fc27ec lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131004.455422:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff91ddcf5ffa00) 00010000:00010000:0.0:1789131004.455430:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789131004.455435:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6600/0xf3fe2838e1fc27ec lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131004.455440:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6600/0xf3fe2838e1fc27ec lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131004.455454:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc27f3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131004.455510:0:6501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc27f3 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131004.455517:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc27f3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131004.455522:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91de01ad7600 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:0.0:1789131004.455524:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc27f3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131004.455529:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc27f3 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131004.455536:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x840cc931 (ffff91ddc4c81700) 00010000:00010000:0.0:1789131004.455539:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789131004.455541:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc27f3 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131004.455546:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc27f3 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131004.455560:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7800/0xf3fe2838e1fc27fa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131004.455572:0:6501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7800/0xf3fe2838e1fc27fa lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131004.455577:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7800/0xf3fe2838e1fc27fa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131004.455581:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91de01ad7800 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:0.0:1789131004.455583:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7800/0xf3fe2838e1fc27fa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131004.455589:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7800/0xf3fe2838e1fc27fa lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131004.455595:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff91dde1922300) 00010000:00010000:0.0:1789131004.455598:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789131004.455601:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7800/0xf3fe2838e1fc27fa lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131004.455605:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7800/0xf3fe2838e1fc27fa lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131004.455681:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc6ffad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+59:11556:x1876039498254080:12345-192.168.203.11@tcp:34:lhsmtool_posix.0 Request processed in 834us (1802us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131004.455689:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 79 00000100:00100000:0.0:1789131004.460506:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131004.463255:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498254336 00000100:00100000:2.0:1789131004.463271:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498254336 00000100:00100000:2.0:1789131004.463356:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 80 00000100:00100000:2.0:1789131004.463368:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd286e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+59:11556:x1876039498254336:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789131004.463389:0:6502:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789131004.463422:0:6502:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fa00/0xf3fe2838e1fc2801 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269a28 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131004.463550:0:6502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fc00/0xf3fe2838e1fc2808 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131004.463565:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fc00/0xf3fe2838e1fc2808 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131004.463577:0:6502:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fc00/0xf3fe2838e1fc2808 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789131004.463590:0:6502:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1789131004.463665:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fc00/0xf3fe2838e1fc2808 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131004.463672:0:6502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fc00/0xf3fe2838e1fc2808 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131004.463679:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fc00/0xf3fe2838e1fc2808 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131004.463685:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc7f7fc00 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:2.0:1789131004.463688:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fc00/0xf3fe2838e1fc2808 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131004.463695:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fc00/0xf3fe2838e1fc2808 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131004.463706:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff91dde1922300) 00010000:00010000:2.0:1789131004.463710:0:6502:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789131004.463715:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fc00/0xf3fe2838e1fc2808 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131004.463731:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fc00/0xf3fe2838e1fc2808 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131004.463774:0:6502:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fa00/0xf3fe2838e1fc2801 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269a28 expref: 61 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131004.463783:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff91ddcf5ffa00) 00010000:00010000:2.0:1789131004.463786:0:6502:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789131004.463790:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fa00/0xf3fe2838e1fc2801 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269a28 expref: 61 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131004.463799:0:6502:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dcc7f7fa00, rc 0) 00000100:00100000:2.0:1789131004.463869:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd286e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+60:11556:x1876039498254336:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 504us (3374us total) trans 4294967353 rc 301/301 00000100:00100000:2.0:1789131004.463877:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 80 00000100:00100000:2.0:1789131004.470600:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131004.470687:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498254464 00000100:00100000:0.0:1789131004.470697:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498254464 00000100:00100000:0.0:1789131004.470756:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 81 00000100:00100000:0.0:1789131004.470766:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc6ffbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+60:11556:x1876039498254464:12345-192.168.203.11@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789131004.470815:0:9769:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789131004.470950:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc6ffbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+60:11556:x1876039498254464:12345-192.168.203.11@tcp:53:lhsmtool_posix.0 Request processed in 184us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131004.470958:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 81 00000100:00100000:0.0:1789131004.497293:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131004.497546:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498254720 00000100:00100000:2.0:1789131004.497557:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498254720 00000100:00100000:2.0:1789131004.497627:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 82 00000100:00100000:2.0:1789131004.497638:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd286cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+60:11556:x1876039498254720:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789131004.497658:0:6501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789131004.497661:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789131004.497688:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6a00/0xf3fe2838e1fc27c2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269a1a expref: 60 pid: 9769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131004.497716:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff91dded3a2b00) 00010000:00010000:2.0:1789131004.497734:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789131004.497747:0:6501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fc00/0xf3fe2838e1fc2816 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269a2f expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789131004.498125:0:6501:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x3:0x0], index 1: 0 00010000:00010000:2.0:1789131004.498260:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e600/0xf3fe2838e1fc281d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131004.498274:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e600/0xf3fe2838e1fc281d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131004.498285:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e600/0xf3fe2838e1fc281d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131004.498338:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fc00/0xf3fe2838e1fc2816 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269a2f expref: 62 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131004.498352:0:6501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e600/0xf3fe2838e1fc281d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269a2f expref: 61 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131004.498360:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff91dde1922700) 00010000:00010000:2.0:1789131004.498363:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789131004.498366:0:6501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dcc7f7e600, rc 0) 00000100:00100000:2.0:1789131004.498418:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd286cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+61:11556:x1876039498254720:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 782us (1140us total) trans 4294967354 rc 0/0 00000100:00100000:2.0:1789131004.498426:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 82 00000100:00100000:0.0:1789131004.501273:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789131004.501295:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd286d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508837248:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789131004.501364:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131004.501433:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508837248 00000100:00100000:0.0:1789131004.501440:0:8418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508837248 00000100:00100000:0.0:1789131004.501499:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1789131004.501508:0:8418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddffe0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508837248:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789131004.501537:0:8418:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:0.0:1789131004.501582:0:8418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddffe0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508837248:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131004.501588:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1789131004.502044:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd286d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508837248:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789131004.507918:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131004.508437:0:14851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498254976 00000100:00100000:0.0:1789131004.508447:0:14851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498254976 00000100:00100000:0.0:1789131004.508536:0:14851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 83 00000100:00100000:0.0:1789131004.508546:0:14851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc6ffa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+61:11556:x1876039498254976:12345-192.168.203.11@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789131004.508601:0:14851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789131004.508638:0:14851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e600/0xf3fe2838e1fc281d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269a2f expref: 61 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131004.508673:0:14851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff91dde1922700) 00010000:00010000:0.0:1789131004.508684:0:14851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789131004.508705:0:14851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc282b lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131004.508718:0:14851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc282b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131004.508727:0:14851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc282b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131004.508740:0:14851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7c00/0xf3fe2838e1fc2832 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x21dfabe8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131004.508746:0:14851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7c00/0xf3fe2838e1fc2832 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x21dfabe8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131004.508752:0:14851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7c00/0xf3fe2838e1fc2832 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x21dfabe8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131004.508793:0:14851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc282b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131004.508799:0:14851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc282b lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131004.508805:0:14851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc282b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131004.508811:0:14851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91de01ad7600 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:0.0:1789131004.508814:0:14851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc282b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131004.508829:0:14851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc282b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131004.508838:0:14851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff91dded3a2b00) 00010000:00010000:0.0:1789131004.508841:0:14851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789131004.508845:0:14851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc282b lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131004.508851:0:14851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc282b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131004.508863:0:14851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7c00/0xf3fe2838e1fc2832 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x21dfabe8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131004.508868:0:14851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7c00/0xf3fe2838e1fc2832 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x21dfabe8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131004.508874:0:14851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7c00/0xf3fe2838e1fc2832 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x21dfabe8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131004.508879:0:14851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91de01ad7c00 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:0.0:1789131004.508882:0:14851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7c00/0xf3fe2838e1fc2832 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x21dfabe8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131004.508888:0:14851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7c00/0xf3fe2838e1fc2832 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x21dfabe8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131004.508895:0:14851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x21dfabe8 (ffff91ddc4c81700) 00010000:00010000:0.0:1789131004.508898:0:14851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789131004.508900:0:14851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7c00/0xf3fe2838e1fc2832 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x21dfabe8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131004.508915:0:14851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7c00/0xf3fe2838e1fc2832 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x21dfabe8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131004.509010:0:14851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc6ffa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+60:11556:x1876039498254976:12345-192.168.203.11@tcp:36:lhsmtool_posix.0 Request processed in 464us (1100us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789131004.509018:0:14851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 83 00000100:00100000:2.0:1789131004.517400:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789131004.519853:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498255104 00000100:00100000:1.0:1789131004.519865:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498255104 00000100:00100000:1.0:1789131004.520031:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 84 00000100:00100000:1.0:1789131004.520043:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc6ff8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+60:11556:x1876039498255104:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789131004.520061:0:9769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789131004.520079:0:9769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca400/0xf3fe2838e1fc2839 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269a36 expref: -99 pid: 9769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.520110:0:9769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca000/0xf3fe2838e1fc2840 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.520580:0:9769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca000/0xf3fe2838e1fc2840 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.520592:0:9769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca000/0xf3fe2838e1fc2840 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.520698:0:9769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca400/0xf3fe2838e1fc2839 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269a36 expref: 62 pid: 9769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.520716:0:9769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca000/0xf3fe2838e1fc2840 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269a36 expref: 61 pid: 9769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.520725:0:9769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff91dcc7d6a300) 00010000:00010000:1.0:1789131004.520728:0:9769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789131004.520737:0:9769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dcc85ca000, rc 0) 00000100:00100000:1.0:1789131004.522128:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc6ff8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+61:11556:x1876039498255104:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 1867us (4517us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131004.522139:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 84 00000100:00100000:3.0:1789131004.525578:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789131004.526237:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498255360 00000100:00100000:1.0:1789131004.526247:0:14273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498255360 00000100:00100000:1.0:1789131004.526300:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 85 00000100:00100000:1.0:1789131004.526311:0:14273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd2868000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+61:11556:x1876039498255360:12345-192.168.203.11@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789131004.526400:0:14273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cac00/0xf3fe2838e1fc2847 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.526416:0:14273:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cac00/0xf3fe2838e1fc2847 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.526428:0:14273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cac00/0xf3fe2838e1fc2847 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789131004.526629:0:14273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:1.0:1789131004.526638:0:14273:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 360444178857ns, next at 361444176082ns, rc = 0 00000004:00010000:1.0:1789131004.526756:0:14273:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000009c1b2ca1 reply state 000000004da98e11 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cac00/0xf3fe2838e1fc2847 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.527387:0:14273:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cac00/0xf3fe2838e1fc2847 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.527395:0:14273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff91dcc7d6a300) 00010000:00010000:1.0:1789131004.527398:0:14273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1789131004.527402:0:14273:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789131004.527746:0:14273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd2868000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+63:11556:x1876039498255360:12345-192.168.203.11@tcp:36:lhsmtool_posix.0 Request processed in 1433us (2213us total) trans 4294967355 rc 0/0 00000100:00100000:1.0:1789131004.527776:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 85 00000100:00100000:0.0:1789131004.533375:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789131004.534708:0:14851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498255488 00000100:00100000:1.0:1789131004.534717:0:14851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498255488 00000100:00100000:1.0:1789131004.534774:0:14851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 86 00000100:00100000:1.0:1789131004.534785:0:14851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd286d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+63:11556:x1876039498255488:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789131004.534808:0:14851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789131004.534829:0:14851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb800/0xf3fe2838e1fc284e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269a3d expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.534885:0:14851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb800/0xf3fe2838e1fc284e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269a3d expref: 64 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.534902:0:14851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb800/0xf3fe2838e1fc284e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269a3d expref: 64 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.535083:0:14851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff91dcc7d6a300) 00010000:00010000:1.0:1789131004.535086:0:14851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789131004.535089:0:14851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dcc85cb800, rc 0) 00000100:00100000:1.0:1789131004.535153:0:14851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd286d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+64:11556:x1876039498255488:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 370us (1786us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131004.535162:0:14851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 86 00000100:00100000:0.0:1789131004.540574:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789131004.540742:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498255616 00000100:00100000:1.0:1789131004.540759:0:9827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498255616 00000100:00100000:1.0:1789131004.540831:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 32 00000100:00100000:1.0:1789131004.540841:0:9827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd286c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2384:x1876039498255616:12345-192.168.203.11@tcp:8:lhsmtool_posix.0 00010000:00080000:1.0:1789131004.540897:0:9827:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from b99c111d-b9b6-4590-88e4-9fefd4d4c3a4@192.168.203.11@tcp t0 exp 0000000000000000 cur 360 last 0 00000020:00000080:1.0:1789131004.540967:0:9827:0:(genops.c:1385:class_connect()) connect: client b99c111d-b9b6-4590-88e4-9fefd4d4c3a4, cookie 0xf3fe2838e1fc2855 00002000:00100000:1.0:1789131004.540984:0:9827:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli b99c111d-b9b6-4590-88e4-9fefd4d4c3a4/ffff91de01bf9800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113984 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789131004.540997:0:9827:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type 37, return 37 00002000:00080000:1.0:1789131004.541144:0:9827:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789131004.541196:0:9827:0:(import.c:65:import_set_state_nolock()) ffff91de01bfb000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789131004.541411:0:9827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd286c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+6:2384:x1876039498255616:12345-192.168.203.11@tcp:8:lhsmtool_posix.0 Request processed in 569us (846us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131004.541421:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 32 00000100:00100000:3.0:1789131004.546792:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131004.546888:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498255744 00000100:00100000:0.0:1789131004.546899:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498255744 00000100:00080000:3.0:1789131004.547040:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789131004.547119:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 33 00000100:00100000:0.0:1789131004.547130:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd286ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+6:0:x1876039498255744:12345-192.168.203.11@tcp:2:lhsmtool_posix.0 00000001:00080000:0.0:1789131004.551767:0:9493:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00100000:0.0:1789131004.551782:0:9493:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of b99c111d-b9b6-4590-88e4-9fefd4d4c3a4 00000100:00100000:3.0:1789131004.552077:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd286ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+5:0:x1876039498255744:12345-192.168.203.11@tcp:2:lhsmtool_posix.0 Request processed in 4934us (5279us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1789131004.552093:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 33 00000100:00100000:0.0:1789131004.559672:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131004.563218:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498256000 00000100:00100000:3.0:1789131004.563240:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498256000 00000100:00100000:3.0:1789131004.563338:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 19 00000100:00100000:3.0:1789131004.563351:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd286e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+64:11556:x1876039498256000:12345-192.168.203.11@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789131004.563742:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd286e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+65:11556:x1876039498256000:12345-192.168.203.11@tcp:35:lhsmtool_posix.0 Request processed in 391us (4077us total) trans 4294967356 rc 0/0 00000100:00100000:3.0:1789131004.563751:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 19 00000100:00100000:0.0:1789131004.567629:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131004.567747:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498256256 00000100:00100000:3.0:1789131004.567763:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498256256 00000100:00100000:3.0:1789131004.567840:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 87 00000100:00100000:3.0:1789131004.567852:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd286cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+65:11556:x1876039498256256:12345-192.168.203.11@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789131004.568009:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd286cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+65:11556:x1876039498256256:12345-192.168.203.11@tcp:57:lhsmtool_posix.0 Request processed in 158us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131004.568018:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 87 00000100:00100000:0.0:1789131004.575761:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131004.575865:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498256384 00000100:00100000:2.0:1789131004.575890:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498256384 00000100:00100000:2.0:1789131004.575994:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 88 00000100:00100000:2.0:1789131004.576005:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd286f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+65:11556:x1876039498256384:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789131004.576032:0:6501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789131004.576056:0:6501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7ea00/0xf3fe2838e1fc285c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269a44 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131004.576147:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e000/0xf3fe2838e1fc2863 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131004.576164:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e000/0xf3fe2838e1fc2863 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131004.576177:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e000/0xf3fe2838e1fc2863 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789131004.576240:0:6501:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789131004.576264:0:6501:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e000/0xf3fe2838e1fc2863 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131004.576294:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7ea00/0xf3fe2838e1fc285c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269a44 expref: 67 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131004.576315:0:6501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e000/0xf3fe2838e1fc2863 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269a44 expref: 66 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131004.576325:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff91dcc7d6a300) 00010000:00010000:2.0:1789131004.576328:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789131004.576333:0:6501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dcc7f7e000, rc 0) 00000100:00100000:2.0:1789131004.576407:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd286f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+66:11556:x1876039498256384:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 403us (660us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131004.576421:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 88 00000100:00100000:3.0:1789131004.579991:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789131004.580318:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498256512 00000100:00100000:1.0:1789131004.580332:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498256512 00000100:00100000:1.0:1789131004.580407:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 34 00000100:00100000:1.0:1789131004.580419:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd286bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+5:2388:x1876039498256512:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789131004.580443:0:8417:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789131004.580494:0:8417:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007df34cb8/0xf3fe2838e1fc286a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269a4b expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789131004.580529:0:8417:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa3f8fc, blocks: 0x0 00010000:00010000:1.0:1789131004.580554:0:8417:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=360s v=(0 0) 00010000:00010000:1.0:1789131004.580559:0:8417:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789131004.580574:0:8417:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007df34cb8/0xf3fe2838e1fc286a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269a4b expref: 6 pid: 8417 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.580610:0:8417:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007df34cb8/0xf3fe2838e1fc286a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269a4b expref: 6 pid: 8417 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.580627:0:8417:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dcc85ca400, rc 0) 00000100:00100000:1.0:1789131004.581362:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd286bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+6:2388:x1876039498256512:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 942us (1383us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131004.581372:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 34 00000100:00100000:0.0:1789131004.587228:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131004.587372:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498256768 00000100:00100000:2.0:1789131004.587384:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498256768 00000100:00100000:2.0:1789131004.587497:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 89 00000100:00100000:2.0:1789131004.587510:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd286de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+66:11556:x1876039498256768:12345-192.168.203.11@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789131004.587838:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd286de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+66:11556:x1876039498256768:12345-192.168.203.11@tcp:57:lhsmtool_posix.0 Request processed in 331us (626us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131004.587847:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 89 00000100:00100000:3.0:1789131004.591215:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131004.591357:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498256896 00000100:00100000:0.0:1789131004.591369:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498256896 00000100:00100000:0.0:1789131004.591430:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 35 00000100:00100000:0.0:1789131004.591440:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd286a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+6:11556:x1876039498256896:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789131004.591500:0:8414:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789131004.591527:0:8414:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000146d23ab/0xf3fe2838e1fc2871 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269a52 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131004.591721:0:8414:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007df34cb8/0xf3fe2838e1fc286a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269a4b expref: 7 pid: 8417 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131004.591733:0:8414:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789131004.591739:0:8414:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789131004.591745:0:8414:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000146d23ab/0xf3fe2838e1fc2871 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269a52 expref: 7 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131004.591792:0:8414:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007df34cb8/0xf3fe2838e1fc286a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269a4b expref: 7 pid: 8417 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131004.591878:0:8414:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007df34cb8/0xf3fe2838e1fc286a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269a4b expref: 7 pid: 8417 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131004.591897:0:8414:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd286f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8414:1876039508837376:192.168.203.11@tcp:104: 00000100:00100000:0.0:1789131004.592049:0:8414:0:(client.c:2715:ptlrpc_set_wait()) set ffff91dcc7c5a780 going to sleep for 11 seconds 00000100:00100000:3.0:1789131004.594938:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131004.595068:0:8414:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd286f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8414:1876039508837376:192.168.203.11@tcp:104: 00010000:00010000:0.0:1789131004.595108:0:8414:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000146d23ab/0xf3fe2838e1fc2871 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269a52 expref: 7 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131004.595133:0:8414:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91de01ad6400, rc 0) 00000100:00100000:0.0:1789131004.595219:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd286a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+7:11556:x1876039498256896:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 3778us (4023us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131004.595230:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 35 00000100:00100000:1.0:1789131004.595422:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498257024 00000100:00100000:1.0:1789131004.595430:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498257024 00010000:00010000:1.0:1789131004.595504:0:6487:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007df34cb8/0xf3fe2838e1fc286a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269a4b expref: 7 pid: 8417 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131004.595534:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 71 00000100:00100000:1.0:1789131004.595543:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd2868f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+7:2388:x1876039498257024:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789131004.595558:0:6487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789131004.595583:0:6487:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007df34cb8/0xf3fe2838e1fc286a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269a4b expref: 7 pid: 8417 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.595606:0:6487:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007df34cb8/0xf3fe2838e1fc286a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269a4b expref: 7 pid: 8417 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.595644:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007df34cb8/0xf3fe2838e1fc286a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269a4b expref: 7 pid: 8417 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.595663:0:6487:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789131004.595668:0:6487:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789131004.595678:0:6487:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000146d23ab/0xf3fe2838e1fc2871 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269a52 expref: 6 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.595690:0:6487:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000146d23ab/0xf3fe2838e1fc2871 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269a52 expref: 6 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.595741:0:6487:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000146d23ab/0xf3fe2838e1fc2871 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269a52 expref: 6 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131004.595757:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01b30780 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6487:1876039508837504:192.168.203.11@tcp:105: 00000100:00100000:1.0:1789131004.595824:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddc4c14180 going to sleep for 11 seconds 00000100:00100000:1.0:1789131004.598814:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01b30780 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6487:1876039508837504:192.168.203.11@tcp:105: 00010000:00010000:1.0:1789131004.598846:0:6487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789131004.598914:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd2868f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+6:2388:x1876039498257024:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 3371us (3995us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131004.598936:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 71 00000100:00100000:3.0:1789131004.603124:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131004.603502:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498257152 00000100:00100000:2.0:1789131004.603566:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498257152 00002000:00100000:2.0:1789131004.603693:0:8422:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff91ddd2869680 x1876039498257152/t0(0) o4->b99c111d-b9b6-4590-88e4-9fefd4d4c3a4@192.168.203.11@tcp:720/0 lens 504/0 e 0 to 0 dl 1789131015 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789131004.603708:0:8422:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff91ddd2869680 with x1876039498257152 ext(0->8) 00002000:00010000:2.0:1789131004.603716:0:8422:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91ddd2869680 00000100:00100000:2.0:1789131004.603758:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 0 00000100:00100000:2.0:1789131004.603770:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd2869680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+6:2387:x1876039498257152:12345-192.168.203.11@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1789131004.607028:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd2869680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+8:2387:x1876039498257152:12345-192.168.203.11@tcp:4:lhsmtool_posix.0 Request processed in 3243us (3903us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1789131004.607047:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 0 00002000:00100000:3.0:1789131004.607062:0:8422:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff91ddd2869680 x1876039498257152/t4294967303(0) o4->b99c111d-b9b6-4590-88e4-9fefd4d4c3a4@192.168.203.11@tcp:720/0 lens 504/448 e 0 to 0 dl 1789131015 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789131004.607087:0:8422:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff91ddd2869680 with x1876039498257152 ext(0->8) 00002000:00010000:3.0:1789131004.607095:0:8422:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91ddd2869680 00000100:00100000:3.0:1789131004.611553:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789131004.611684:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498257280 00000100:00100000:1.0:1789131004.611697:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498257280 00000100:00100000:0.0:1789131004.611857:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 90 00000100:00100000:0.0:1789131004.611876:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd2868b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+66:11556:x1876039498257280:12345-192.168.203.11@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1789131004.615056:0:6479:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967356 is committed 00000004:00080000:2.0:1789131004.615080:0:6479:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000004:00080000:2.0:1789131004.615117:0:6479:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000004:00080000:2.0:1789131004.615186:0:6479:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:2.0:1789131004.615198:0:6479:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff91ddff7d7600 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:2.0:1789131004.615210:0:6479:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff91dcc6e4f800 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff91ddff7d7b40 00000020:00080000:2.0:1789131004.615215:0:6479:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff91dcc6e4f000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff91dde19dde00 00000020:00080000:2.0:1789131004.615308:0:6532:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:2.0:1789131004.615559:0:6532:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:3.0:1789131004.615896:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd286b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508837632:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1789131004.615997:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131004.616068:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508837632 00000100:00100000:3.0:1789131004.616078:0:9827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508837632 00000100:00100000:3.0:1789131004.616135:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789131004.616145:0:9827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd2869e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3625:x1876039508837632:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1789131004.616289:0:9827:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1789131004.616293:0:9827:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1789131004 00002000:00010000:3.0:1789131004.616297:0:9827:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1789131004.616299:0:9827:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1789131004 -> 1789131004 00002000:00010000:3.0:1789131004.616303:0:9827:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:3.0:1789131004.616350:0:9827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd2869e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3625:x1876039508837632:12345-0@lo:2:osp-syn-1-0.0 Request processed in 205us (353us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1789131004.616359:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000004:00080000:3.0:1789131004.616410:0:3625:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff91ddd286b840/2, rc 0, transno 4294967304 00000100:00100000:3.0:1789131004.616416:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd286b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508837632:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1789131004.616606:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd2868b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+20:11556:x1876039498257280:12345-192.168.203.11@tcp:44:lhsmtool_posix.0 Request processed in 4734us (5063us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131004.616618:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 90 00010000:00010000:1.0:1789131004.617449:0:3612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5e00/0xf3fe2838e1fc258b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.617541:0:3612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5e00/0xf3fe2838e1fc258b lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.617550:0:3612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5e00/0xf3fe2838e1fc258b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.617558:0:3612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddfd0b5e00 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:1.0:1789131004.617564:0:3612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5e00/0xf3fe2838e1fc258b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.617573:0:3612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5e00/0xf3fe2838e1fc258b lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.617730:0:3612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff91dded3a2f00) 00010000:00010000:1.0:1789131004.617734:0:3612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789131004.617741:0:3612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5e00/0xf3fe2838e1fc258b lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.617750:0:3612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5e00/0xf3fe2838e1fc258b lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.617778:0:3612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4400/0xf3fe2838e1fc2592 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.617785:0:3612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4400/0xf3fe2838e1fc2592 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.617792:0:3612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4400/0xf3fe2838e1fc2592 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.617801:0:3612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddfd0b4400 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:1.0:1789131004.617878:0:3612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4400/0xf3fe2838e1fc2592 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.617888:0:3612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4400/0xf3fe2838e1fc2592 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.617898:0:3612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff91dded3a2b00) 00010000:00010000:1.0:1789131004.617901:0:3612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789131004.617904:0:3612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4400/0xf3fe2838e1fc2592 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.617910:0:3612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4400/0xf3fe2838e1fc2592 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.617952:0:3612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5200/0xf3fe2838e1fc25d1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.617959:0:3612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5200/0xf3fe2838e1fc25d1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.617966:0:3612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5200/0xf3fe2838e1fc25d1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.617972:0:3612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddfd0b5200 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:1.0:1789131004.617975:0:3612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5200/0xf3fe2838e1fc25d1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.617981:0:3612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5200/0xf3fe2838e1fc25d1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.617990:0:3612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff91dded3a2500) 00010000:00010000:1.0:1789131004.617992:0:3612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789131004.617996:0:3612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5200/0xf3fe2838e1fc25d1 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.618003:0:3612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5200/0xf3fe2838e1fc25d1 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.618022:0:3612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7e00/0xf3fe2838e1fc26db lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.618028:0:3612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7e00/0xf3fe2838e1fc26db lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.618033:0:3612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7e00/0xf3fe2838e1fc26db lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.618045:0:3612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91de01ad7e00 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:1.0:1789131004.618048:0:3612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7e00/0xf3fe2838e1fc26db lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.618054:0:3612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7e00/0xf3fe2838e1fc26db lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.618063:0:3612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff91dde1922300) 00010000:00010000:1.0:1789131004.618066:0:3612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789131004.618068:0:3612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7e00/0xf3fe2838e1fc26db lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.618073:0:3612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7e00/0xf3fe2838e1fc26db lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.618085:0:3612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f800/0xf3fe2838e1fc26fe lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.618091:0:3612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f800/0xf3fe2838e1fc26fe lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.618097:0:3612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f800/0xf3fe2838e1fc26fe lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.618102:0:3612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc7f7f800 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:1.0:1789131004.618105:0:3612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f800/0xf3fe2838e1fc26fe lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.618110:0:3612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f800/0xf3fe2838e1fc26fe lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.618130:0:3612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff91dde1922300) 00010000:00010000:1.0:1789131004.618132:0:3612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789131004.618270:0:3612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f800/0xf3fe2838e1fc26fe lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.618281:0:3612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f800/0xf3fe2838e1fc26fe lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.618296:0:3612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e200/0xf3fe2838e1fc2744 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.618303:0:3612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e200/0xf3fe2838e1fc2744 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.618310:0:3612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e200/0xf3fe2838e1fc2744 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.618315:0:3612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc7f7e200 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:1.0:1789131004.618318:0:3612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e200/0xf3fe2838e1fc2744 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.618325:0:3612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e200/0xf3fe2838e1fc2744 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.618337:0:3612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff91dde1922300) 00010000:00010000:1.0:1789131004.618340:0:3612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789131004.618343:0:3612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e200/0xf3fe2838e1fc2744 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.618350:0:3612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e200/0xf3fe2838e1fc2744 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.618377:0:3612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cac00/0xf3fe2838e1fc2847 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.618384:0:3612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cac00/0xf3fe2838e1fc2847 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.618390:0:3612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cac00/0xf3fe2838e1fc2847 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.618403:0:3612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc85cac00 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:1.0:1789131004.618407:0:3612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cac00/0xf3fe2838e1fc2847 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.618414:0:3612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cac00/0xf3fe2838e1fc2847 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.618422:0:3612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff91dcc7d6a300) 00010000:00010000:1.0:1789131004.618424:0:3612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789131004.618427:0:3612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cac00/0xf3fe2838e1fc2847 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.618432:0:3612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cac00/0xf3fe2838e1fc2847 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131004.618918:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789131004.619074:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd286f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508837760:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789131004.619281:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131004.619543:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508837760 00000100:00100000:0.0:1789131004.619552:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508837760 00000100:00100000:0.0:1789131004.619667:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789131004.619680:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01b30780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3625:x1876039508837760:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1789131004.619713:0:8416:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2 count 1 00002000:00010000:0.0:1789131004.619751:0:8416:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 13, mtime: 0x6aa3f8f9, atime: 0x6aa3f8f9, ctime: 0x6aa3f8f9, blocks: 0x8 00010000:00010000:0.0:1789131004.619760:0:8416:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087b7015b/0xf3fe2838e1fc2878 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131004.619779:0:8416:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=360s v=(0 0) 00010000:00010000:0.0:1789131004.619784:0:8416:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789131004.619793:0:8416:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087b7015b/0xf3fe2838e1fc2878 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131004.619822:0:8416:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000087b7015b/0xf3fe2838e1fc2878 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131004.619833:0:8416:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087b7015b/0xf3fe2838e1fc2878 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131004.619841:0:8416:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000087b7015b/0xf3fe2838e1fc2878 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131004.619864:0:8416:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789131004.620074:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01b30780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3625:x1876039508837760:12345-0@lo:6:osp-syn-0-0.0 Request processed in 398us (796us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1789131004.620082:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00010000:0.0:1789131004.620107:0:7442:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789131004.620113:0:7442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000087b7015b/0xf3fe2838e1fc2878 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131004.620121:0:7442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91de01ad6e00 already unused, calling callback (ffffffffc0c4e550) 00010000:00010000:0.0:1789131004.620125:0:7442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000087b7015b/0xf3fe2838e1fc2878 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131004.620133:0:7442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000087b7015b/0xf3fe2838e1fc2878 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131004.620160:0:7442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000087b7015b/0xf3fe2838e1fc2878 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131004.620169:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000087b7015b/0xf3fe2838e1fc2878 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131004.620187:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789131004.620189:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789131004.620190:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789131004.620297:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131004.620333:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498257408 00000100:00100000:2.0:1789131004.620343:0:9827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498257408 00000004:00080000:0.0:1789131004.620371:0:3625:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff91ddd286f480/2, rc 0, transno 4294967302 00000100:00100000:0.0:1789131004.620380:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd286f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508837760:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789131004.620403:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 38 00000100:00080000:1.0:1789131004.620532:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789131004.620780:0:9827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc6ff9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+8:2388:x1876039498257408:12345-192.168.203.11@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1789131004.624975:0:9493:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:0.0:1789131004.625010:0:9493:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000100:00100000:2.0:1789131004.625186:0:9827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc6ff9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+6:2388:x1876039498257408:12345-192.168.203.11@tcp:16:lhsmtool_posix.0 Request processed in 4767us (4893us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131004.625198:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 38 00000100:00100000:0.0:1789131004.628559:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789131004.628824:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498257664 00000100:00100000:1.0:1789131004.628842:0:14273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498257664 00000100:00100000:1.0:1789131004.628962:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 91 00000100:00100000:1.0:1789131004.628977:0:14273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd286ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+14:11556:x1876039498257664:12345-192.168.203.11@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789131004.629077:0:14273:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789131004.629124:0:14273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e000/0xf3fe2838e1fc2863 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269a44 expref: 14 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.629149:0:14273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff91dcc7d6a300) 00010000:00010000:1.0:1789131004.629156:0:14273:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789131004.629194:0:14273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cac00/0xf3fe2838e1fc287f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.629224:0:14273:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cac00/0xf3fe2838e1fc287f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.629237:0:14273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cac00/0xf3fe2838e1fc287f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789131004.629397:0:14273:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000056561aca reply state 00000000dbb89a61 transno 4294967357 ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cac00/0xf3fe2838e1fc287f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.629413:0:14273:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cac00/0xf3fe2838e1fc287f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.629420:0:14273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff91dcc7d6a300) 00010000:00010000:1.0:1789131004.629423:0:14273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789131004.629426:0:14273:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789131004.629606:0:14273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd286ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+15:11556:x1876039498257664:12345-192.168.203.11@tcp:36:lhsmtool_posix.0 Request processed in 632us (1053us total) trans 4294967357 rc 0/0 00000100:00100000:1.0:1789131004.629615:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 91 00000100:00100000:3.0:1789131004.635571:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131004.638339:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498257792 00000100:00100000:2.0:1789131004.638355:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498257792 00000100:00100000:2.0:1789131004.638414:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 39 00000100:00100000:2.0:1789131004.638425:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd286b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+6:2388:x1876039498257792:12345-192.168.203.11@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1789131004.638609:0:8416:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1789131004.638613:0:8416:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 1789131004 -> 1789131003 00002000:00010000:2.0:1789131004.638616:0:8416:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 1789131001 00002000:00010000:2.0:1789131004.638618:0:8416:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1789131004 -> 1789131003 00002000:00010000:2.0:1789131004.638620:0:8416:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1789131004.638789:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd286b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+7:2388:x1876039498257792:12345-192.168.203.11@tcp:2:lhsmtool_posix.0 Request processed in 363us (3261us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1789131004.638799:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 39 00000100:00100000:2.0:1789131004.644253:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789131004.645836:0:14851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498258048 00000100:00100000:1.0:1789131004.645863:0:14851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498258048 00000100:00100000:1.0:1789131004.646928:0:14851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 92 00000100:00100000:1.0:1789131004.646944:0:14851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc6ff8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+15:11556:x1876039498258048:12345-192.168.203.11@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1789131004.647009:0:14851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca400/0xf3fe2838e1fc2886 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.647026:0:14851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca000/0xf3fe2838e1fc2840 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269a36 expref: 15 pid: 9769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.647035:0:14851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca400/0xf3fe2838e1fc2886 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.647069:0:14851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca000/0xf3fe2838e1fc2840 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269a36 expref: 15 pid: 9769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.647084:0:14851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca000/0xf3fe2838e1fc2840 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269a36 expref: 15 pid: 9769 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131004.647099:0:14851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01b32d00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:14851:1876039508837888:192.168.203.11@tcp:104: 00000100:00100000:1.0:1789131004.647232:0:14851:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddc4c14900 going to sleep for 11 seconds 00000100:00100000:1.0:1789131004.650946:0:14851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01b32d00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:14851:1876039508837888:192.168.203.11@tcp:104: 00010000:00010000:1.0:1789131004.650976:0:14851:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca400/0xf3fe2838e1fc2886 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131004.652890:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789131004.652961:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498258176 00000100:00100000:1.0:1789131004.652970:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498258176 00010000:00010000:1.0:1789131004.653006:0:8431:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca000/0xf3fe2838e1fc2840 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269a36 expref: 16 pid: 9769 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131004.653058:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 72 00000100:00100000:1.0:1789131004.653068:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc6ffb840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+16:2388:x1876039498258176:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789131004.653116:0:8431:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789131004.653124:0:8431:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca000/0xf3fe2838e1fc2840 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269a36 expref: 16 pid: 9769 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.653137:0:8431:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca000/0xf3fe2838e1fc2840 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269a36 expref: 16 pid: 9769 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.653158:0:8431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca000/0xf3fe2838e1fc2840 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269a36 expref: 16 pid: 9769 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.653175:0:8431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff91dcc7d6a300) 00010000:00010000:1.0:1789131004.653180:0:8431:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca400/0xf3fe2838e1fc2886 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.653190:0:8431:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca400/0xf3fe2838e1fc2886 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.653198:0:8431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca400/0xf3fe2838e1fc2886 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.653232:0:8431:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789131004.653281:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc6ffb840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+15:2388:x1876039498258176:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 213us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131004.653289:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 72 00010000:00010000:2.0:1789131004.653345:0:14851:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca400/0xf3fe2838e1fc2886 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131004.653353:0:14851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca400/0xf3fe2838e1fc2886 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131004.653395:0:14851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca400/0xf3fe2838e1fc2886 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131004.653402:0:14851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca400/0xf3fe2838e1fc2886 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131004.653408:0:14851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca400/0xf3fe2838e1fc2886 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131004.653413:0:14851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc85ca400 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:2.0:1789131004.653417:0:14851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca400/0xf3fe2838e1fc2886 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131004.653426:0:14851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca400/0xf3fe2838e1fc2886 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131004.653441:0:14851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff91dcc7d6a300) 00010000:00010000:2.0:1789131004.653444:0:14851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1789131004.653448:0:14851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca400/0xf3fe2838e1fc2886 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131004.653454:0:14851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca400/0xf3fe2838e1fc2886 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131004.653521:0:14851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc6ff8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+14:11556:x1876039498258048:12345-192.168.203.11@tcp:55:lhsmtool_posix.0 Request processed in 6580us (9277us total) trans 0 rc -22/-22 00000100:00100000:2.0:1789131004.653530:0:14851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 92 00000100:00100000:2.0:1789131004.658032:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131004.658105:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498258304 00000100:00100000:3.0:1789131004.658115:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498258304 00000100:00100000:3.0:1789131004.659189:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 40 00000100:00100000:3.0:1789131004.659213:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc6ff9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+7:2386:x1876039498258304:12345-192.168.203.11@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1789131004.659260:0:8417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000b4814ea1/0xf3fe2838e1fc288d lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131004.659291:0:8417:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000146d23ab/0xf3fe2838e1fc2871 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269a52 expref: 7 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131004.659299:0:8417:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789131004.659303:0:8417:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789131004.659307:0:8417:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4814ea1/0xf3fe2838e1fc288d lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131004.659340:0:8417:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000146d23ab/0xf3fe2838e1fc2871 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269a52 expref: 7 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131004.659354:0:8417:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000146d23ab/0xf3fe2838e1fc2871 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269a52 expref: 7 pid: 8414 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131004.659368:0:8417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd286b0c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8417:1876039508838016:192.168.203.11@tcp:104: 00000100:00100000:3.0:1789131004.659472:0:8417:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddff8aab40 going to sleep for 11 seconds 00000100:00100000:3.0:1789131004.662836:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789131004.662912:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498258432 00000100:00100000:1.0:1789131004.662941:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498258432 00010000:00010000:1.0:1789131004.662977:0:6485:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000146d23ab/0xf3fe2838e1fc2871 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269a52 expref: 8 pid: 8414 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131004.663018:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 73 00000100:00100000:1.0:1789131004.663028:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd286a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+8:2388:x1876039498258432:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789131004.663041:0:6485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789131004.663061:0:6485:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000146d23ab/0xf3fe2838e1fc2871 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269a52 expref: 8 pid: 8414 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.663073:0:6485:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000146d23ab/0xf3fe2838e1fc2871 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269a52 expref: 8 pid: 8414 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.663097:0:6485:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789131004.663101:0:6485:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789131004.663106:0:6485:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b4814ea1/0xf3fe2838e1fc288d lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.663114:0:6485:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4814ea1/0xf3fe2838e1fc288d lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.663134:0:6485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789131004.663179:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd286a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+8:2388:x1876039498258432:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 152us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131004.663187:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 73 00010000:00010000:2.0:1789131004.663490:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000146d23ab/0xf3fe2838e1fc2871 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269a52 expref: 7 pid: 8414 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131004.663517:0:8417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd286b0c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8417:1876039508838016:192.168.203.11@tcp:104: 00010000:00010000:2.0:1789131004.663535:0:8417:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b4814ea1/0xf3fe2838e1fc288d lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131004.663546:0:8417:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b4814ea1/0xf3fe2838e1fc288d lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131004.663555:0:8417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b4814ea1/0xf3fe2838e1fc288d lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131004.663574:0:8417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000b4814ea1/0xf3fe2838e1fc288d lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131004.663582:0:8417:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b4814ea1/0xf3fe2838e1fc288d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131004.663589:0:8417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b4814ea1/0xf3fe2838e1fc288d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131004.663596:0:8417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddfd0b5c00 already unused, calling callback (ffffffffc0c4e550) 00010000:00010000:2.0:1789131004.663600:0:8417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4814ea1/0xf3fe2838e1fc288d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131004.663609:0:8417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4814ea1/0xf3fe2838e1fc288d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131004.663629:0:8417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b4814ea1/0xf3fe2838e1fc288d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131004.663636:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4814ea1/0xf3fe2838e1fc288d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131004.663690:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc6ff9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+6:2386:x1876039498258304:12345-192.168.203.11@tcp:1:lhsmtool_posix.0 Request processed in 4490us (5664us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131004.663698:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 40 00000100:00100000:3.0:1789131004.666814:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131004.666849:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498258688 00000100:00100000:3.0:1789131004.666858:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498258688 00000100:00100000:3.0:1789131004.666918:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 93 00000100:00100000:3.0:1789131004.666938:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd286b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+14:11556:x1876039498258688:12345-192.168.203.11@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789131004.667013:0:9769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4200/0xf3fe2838e1fc2894 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131004.667037:0:9769:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e400/0xf3fe2838e1fc26d4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d2699db expref: 14 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131004.667046:0:9769:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4200/0xf3fe2838e1fc2894 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131004.667082:0:9769:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e400/0xf3fe2838e1fc26d4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d2699db expref: 14 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131004.667096:0:9769:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e400/0xf3fe2838e1fc26d4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d2699db expref: 14 pid: 14273 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131004.667110:0:9769:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddc2e87840 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9769:1876039508838144:192.168.203.11@tcp:104: 00000100:00100000:3.0:1789131004.667192:0:9769:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddff8aab40 going to sleep for 11 seconds 00000100:00100000:3.0:1789131004.670086:0:9769:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddc2e87840 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9769:1876039508838144:192.168.203.11@tcp:104: 00000100:00100000:1.0:1789131004.670102:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00010000:00010000:3.0:1789131004.670115:0:9769:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4200/0xf3fe2838e1fc2894 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131004.670133:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498258816 00000100:00100000:1.0:1789131004.670151:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498258816 00010000:00010000:1.0:1789131004.670185:0:8431:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e400/0xf3fe2838e1fc26d4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d2699db expref: 15 pid: 14273 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131004.670218:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 74 00000100:00100000:1.0:1789131004.670228:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01b32d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+15:2387:x1876039498258816:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789131004.670240:0:8431:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789131004.670247:0:8431:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e400/0xf3fe2838e1fc26d4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d2699db expref: 15 pid: 14273 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.670259:0:8431:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e400/0xf3fe2838e1fc26d4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d2699db expref: 15 pid: 14273 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.670280:0:8431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e400/0xf3fe2838e1fc26d4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d2699db expref: 15 pid: 14273 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.670294:0:8431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff91dde1922300) 00010000:00010000:1.0:1789131004.670299:0:8431:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4200/0xf3fe2838e1fc2894 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.670308:0:8431:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4200/0xf3fe2838e1fc2894 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.670316:0:8431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4200/0xf3fe2838e1fc2894 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.670335:0:8431:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789131004.670376:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01b32d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+14:2387:x1876039498258816:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 148us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131004.670392:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 74 00010000:00010000:3.0:1789131004.672042:0:9769:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4200/0xf3fe2838e1fc2894 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131004.672057:0:9769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4200/0xf3fe2838e1fc2894 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131004.672228:0:9769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5400/0xf3fe2838e1fc289b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131004.672244:0:9769:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb800/0xf3fe2838e1fc284e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269a3d expref: 14 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131004.672261:0:9769:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5400/0xf3fe2838e1fc289b lrc: 4/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131004.672297:0:9769:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb800/0xf3fe2838e1fc284e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269a3d expref: 14 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131004.672312:0:9769:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb800/0xf3fe2838e1fc284e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269a3d expref: 14 pid: 14851 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131004.672328:0:9769:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddc2e87840 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9769:1876039508838272:192.168.203.11@tcp:104: 00000100:00100000:3.0:1789131004.672410:0:9769:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddf5cf1300 going to sleep for 11 seconds 00000100:00100000:1.0:1789131004.676625:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789131004.676660:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498258944 00000100:00100000:1.0:1789131004.676668:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498258944 00010000:00010000:1.0:1789131004.676705:0:6485:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb800/0xf3fe2838e1fc284e lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269a3d expref: 15 pid: 14851 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131004.676747:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 75 00000100:00100000:1.0:1789131004.676757:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01b33c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+15:2387:x1876039498258944:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789131004.676774:0:6485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789131004.676781:0:6485:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb800/0xf3fe2838e1fc284e lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269a3d expref: 15 pid: 14851 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.676794:0:6485:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb800/0xf3fe2838e1fc284e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269a3d expref: 15 pid: 14851 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.676816:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff91dcc7d6a300) 00010000:00010000:1.0:1789131004.676821:0:6485:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5400/0xf3fe2838e1fc289b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.676832:0:6485:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5400/0xf3fe2838e1fc289b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.676840:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5400/0xf3fe2838e1fc289b lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.676858:0:6485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789131004.676912:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01b33c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+15:2387:x1876039498258944:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 156us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131004.676940:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 75 00010000:00010000:3.0:1789131004.677578:0:9769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb800/0xf3fe2838e1fc284e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269a3d expref: 14 pid: 14851 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131004.677595:0:9769:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddc2e87840 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9769:1876039508838272:192.168.203.11@tcp:104: 00010000:00010000:3.0:1789131004.677616:0:9769:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5400/0xf3fe2838e1fc289b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131004.677624:0:9769:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5400/0xf3fe2838e1fc289b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131004.677630:0:9769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5400/0xf3fe2838e1fc289b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789131004.677730:0:9769:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000001:00080000:3.0:1789131004.677841:0:9769:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000001:00080000:3.0:1789131004.677877:0:9769:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967360 00000100:00100000:3.0:1789131004.678033:0:9769:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddc2e87840 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9769:1876039508838400:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1789131004.678090:0:9769:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131004.678122:0:9769:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddff8aab40 going to sleep for 11 seconds 00000100:00100000:1.0:1789131004.678208:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508838400 00000100:00100000:1.0:1789131004.678214:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508838400 00000100:00100000:1.0:1789131004.678252:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1789131004.678259:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8509680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:9769:x1876039508838400:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1789131004.678350:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8509680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:9769:x1876039508838400:12345-0@lo:1000:mdt00_003.0 Request processed in 90us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131004.678357:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1789131004.678427:0:9769:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:3.0:1789131004.678432:0:9769:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff91ddd286b840, transno 4294967304 00000100:00100000:3.0:1789131004.678452:0:9769:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddc2e87840 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9769:1876039508838400:0@lo:1000:mdt00_003.0 00000001:00080000:3.0:1789131004.678573:0:9769:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00000100:00100000:3.0:1789131004.678612:0:9769:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8509a40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9769:1876039508838528:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1789131004.678639:0:9769:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131004.679149:0:9769:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddd8364240 going to sleep for 11 seconds 00000100:00100000:1.0:1789131004.681309:0:11069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508838528 00000100:00100000:1.0:1789131004.681321:0:11069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508838528 00000100:00100000:1.0:1789131004.681363:0:11069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1789131004.681370:0:11069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc850b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:9769:x1876039508838528:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1789131004.681557:0:11069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc850b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:9769:x1876039508838528:12345-0@lo:1000:mdt00_003.0 Request processed in 187us (2917us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1789131004.681566:0:11069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1789131004.681621:0:9769:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8509a40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9769:1876039508838528:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1789131004.681665:0:9769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5400/0xf3fe2838e1fc289b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.681675:0:9769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5400/0xf3fe2838e1fc289b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.681682:0:9769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5400/0xf3fe2838e1fc289b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.681688:0:9769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddfd0b5400 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:1.0:1789131004.681693:0:9769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5400/0xf3fe2838e1fc289b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.681707:0:9769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5400/0xf3fe2838e1fc289b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.681721:0:9769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff91dcc7d6a300) 00010000:00010000:1.0:1789131004.681724:0:9769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789131004.681728:0:9769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5400/0xf3fe2838e1fc289b lrc: 2/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.681734:0:9769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5400/0xf3fe2838e1fc289b lrc: 0/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.681764:0:9769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6200/0xf3fe2838e1fc27c9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.681771:0:9769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6200/0xf3fe2838e1fc27c9 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.681778:0:9769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6200/0xf3fe2838e1fc27c9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.681783:0:9769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91de01ad6200 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:1.0:1789131004.681786:0:9769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6200/0xf3fe2838e1fc27c9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.681792:0:9769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6200/0xf3fe2838e1fc27c9 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.681801:0:9769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff91dde1922300) 00010000:00010000:1.0:1789131004.681803:0:9769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789131004.681806:0:9769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6200/0xf3fe2838e1fc27c9 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.681820:0:9769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6200/0xf3fe2838e1fc27c9 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.681841:0:9769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85caa00/0xf3fe2838e1fc28a2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.681855:0:9769:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca200/0xf3fe2838e1fc27e5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269a21 expref: 17 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.681863:0:9769:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85caa00/0xf3fe2838e1fc28a2 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.681891:0:9769:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca200/0xf3fe2838e1fc27e5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269a21 expref: 17 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131004.681909:0:9769:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca200/0xf3fe2838e1fc27e5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269a21 expref: 17 pid: 14851 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131004.681940:0:9769:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01b321c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9769:1876039508838656:192.168.203.11@tcp:104: 00000100:00100000:1.0:1789131004.682166:0:9769:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddc4c14900 going to sleep for 11 seconds 00000100:00100000:1.0:1789131004.685094:0:9769:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01b321c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9769:1876039508838656:192.168.203.11@tcp:104: 00010000:00010000:1.0:1789131004.685122:0:9769:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85caa00/0xf3fe2838e1fc28a2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131004.690963:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131004.693887:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498259072 00000100:00100000:2.0:1789131004.693901:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498259072 00010000:00010000:2.0:1789131004.693962:0:8431:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca200/0xf3fe2838e1fc27e5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269a21 expref: 18 pid: 14851 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131004.694043:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 76 00000100:00100000:2.0:1789131004.694055:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc33afc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+18:2388:x1876039498259072:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789131004.694069:0:8431:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789131004.694077:0:8431:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca200/0xf3fe2838e1fc27e5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269a21 expref: 18 pid: 14851 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131004.694092:0:8431:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca200/0xf3fe2838e1fc27e5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269a21 expref: 18 pid: 14851 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131004.694115:0:8431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca200/0xf3fe2838e1fc27e5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269a21 expref: 18 pid: 14851 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131004.694144:0:8431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff91dde1922300) 00010000:00010000:2.0:1789131004.694148:0:8431:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85caa00/0xf3fe2838e1fc28a2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131004.694157:0:8431:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85caa00/0xf3fe2838e1fc28a2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131004.694164:0:8431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85caa00/0xf3fe2838e1fc28a2 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131004.694202:0:8431:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789131004.694260:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc33afc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+17:2388:x1876039498259072:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 208us (3305us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131004.694268:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 76 00010000:00010000:0.0:1789131004.694348:0:9769:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85caa00/0xf3fe2838e1fc28a2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131004.694358:0:9769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85caa00/0xf3fe2838e1fc28a2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131004.694371:0:9769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85caa00/0xf3fe2838e1fc28a2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131004.694377:0:9769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85caa00/0xf3fe2838e1fc28a2 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131004.694384:0:9769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85caa00/0xf3fe2838e1fc28a2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131004.694390:0:9769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc85caa00 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:0.0:1789131004.694395:0:9769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85caa00/0xf3fe2838e1fc28a2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131004.694403:0:9769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85caa00/0xf3fe2838e1fc28a2 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131004.694414:0:9769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff91dde1922300) 00010000:00010000:0.0:1789131004.694417:0:9769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789131004.694420:0:9769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85caa00/0xf3fe2838e1fc28a2 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131004.694438:0:9769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85caa00/0xf3fe2838e1fc28a2 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131004.694453:0:9769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4200/0xf3fe2838e1fc2894 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131004.694481:0:9769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4200/0xf3fe2838e1fc2894 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131004.694487:0:9769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4200/0xf3fe2838e1fc2894 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131004.694493:0:9769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddfd0b4200 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:0.0:1789131004.694496:0:9769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4200/0xf3fe2838e1fc2894 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131004.694502:0:9769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4200/0xf3fe2838e1fc2894 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131004.694512:0:9769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff91dde1922300) 00010000:00010000:0.0:1789131004.694515:0:9769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789131004.694518:0:9769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4200/0xf3fe2838e1fc2894 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131004.694524:0:9769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4200/0xf3fe2838e1fc2894 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131004.694676:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd286b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+16:11556:x1876039498258688:12345-192.168.203.11@tcp:57:lhsmtool_posix.0 Request processed in 27739us (27869us total) trans 4294967362 rc 0/0 00000100:00100000:0.0:1789131004.694687:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 93 00000020:00080000:0.0:1789131004.694699:0:9769:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1789131004.694802:0:14475:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789131004.694807:0:14475:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789131004.694822:0:14475:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1789131004.694831:0:14475:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789131004.697013:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131004.697091:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498259328 00000100:00100000:2.0:1789131004.697100:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498259328 00000100:00100000:2.0:1789131004.697163:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 20 00000100:00100000:2.0:1789131004.697174:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd286e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+16:11556:x1876039498259328:12345-192.168.203.11@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1789131004.697413:0:6503:0:(mdd_object.c:4024:mdd_close()) Object [0x200000402:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1789131004.697447:0:6503:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967363 00010000:00010000:2.0:1789131004.697769:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fa00/0xf3fe2838e1fc28a9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131004.697786:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fa00/0xf3fe2838e1fc28a9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131004.697797:0:6503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fa00/0xf3fe2838e1fc28a9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131004.697823:0:6503:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fa00/0xf3fe2838e1fc28a9 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131004.697829:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fa00/0xf3fe2838e1fc28a9 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131004.697835:0:6503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fa00/0xf3fe2838e1fc28a9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131004.697858:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789131004.697950:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd286e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+18:11556:x1876039498259328:12345-192.168.203.11@tcp:35:lhsmtool_posix.0 Request processed in 777us (944us total) trans 4294967364 rc 0/0 00000100:00100000:2.0:1789131004.697959:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 20 00000020:00080000:2.0:1789131004.697963:0:6503:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789131004.699862:0:6489:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789131004.699874:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fa00/0xf3fe2838e1fc28a9 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131004.699884:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc7f7fa00 already unused, calling callback (ffffffffc0c4e550) 00010000:00010000:0.0:1789131004.699888:0:6489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fa00/0xf3fe2838e1fc28a9 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131004.699898:0:6489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fa00/0xf3fe2838e1fc28a9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131004.699914:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff91dcc7d6a300) 00010000:00010000:0.0:1789131004.699916:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789131004.699933:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fa00/0xf3fe2838e1fc28a9 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131004.699940:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fa00/0xf3fe2838e1fc28a9 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131004.699953:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789131004.699955:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789131004.699957:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131004.818906:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789131004.921454:0:14889:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789131004.922022:0:14889:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789131004.922053:0:14889:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1789131004.922060:0:14889:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789131005.059855:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131005.059941:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498259584 00000100:00100000:0.0:1789131005.059950:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498259584 00000100:00100000:0.0:1789131005.060077:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 94 00000100:00100000:0.0:1789131005.060089:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc6ff8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+18:11566:x1876039498259584:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:0.0:1789131005.060121:0:6501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789131005.060154:0:6501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7800/0xf3fe2838e1fc28b0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269a59 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131005.060253:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6600/0xf3fe2838e1fc28b7 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131005.060269:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6600/0xf3fe2838e1fc28b7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131005.060281:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6600/0xf3fe2838e1fc28b7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789131005.060293:0:6501:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1789131005.060395:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7800/0xf3fe2838e1fc28b0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269a59 expref: 21 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131005.060412:0:6501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6600/0xf3fe2838e1fc28b7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269a59 expref: 20 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131005.060425:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff91dded3a2b00) 00010000:00010000:0.0:1789131005.060428:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789131005.060432:0:6501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91de01ad6600, rc 0) 00000100:00100000:0.0:1789131005.060507:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc6ff8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+20:11566:x1876039498259584:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 421us (662us total) trans 4294967365 rc 0/0 00000100:00100000:0.0:1789131005.060515:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 94 00000100:00080000:3.0:1789131005.062309:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789131005.065017:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131005.066270:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498259712 00000100:00100000:3.0:1789131005.066281:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498259712 00000100:00100000:3.0:1789131005.066337:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 95 00000100:00100000:3.0:1789131005.066346:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01b321c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+20:11566:x1876039498259712:12345-192.168.203.11@tcp:34:lfs.0 00010000:00010000:3.0:1789131005.066416:0:6502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5000/0xf3fe2838e1fc28c5 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131005.066432:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5000/0xf3fe2838e1fc28c5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131005.066443:0:6502:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5000/0xf3fe2838e1fc28c5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131005.066486:0:6502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4c00/0xf3fe2838e1fc28cc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131005.066503:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4c00/0xf3fe2838e1fc28cc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131005.066510:0:6502:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4c00/0xf3fe2838e1fc28cc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131005.066580:0:6502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4600/0xf3fe2838e1fc28d3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131005.066588:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4600/0xf3fe2838e1fc28d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131005.066594:0:6502:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4600/0xf3fe2838e1fc28d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789131005.066634:0:6502:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4600/0xf3fe2838e1fc28d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131005.066645:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5000/0xf3fe2838e1fc28c5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131005.066651:0:6502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5000/0xf3fe2838e1fc28c5 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131005.066657:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5000/0xf3fe2838e1fc28c5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131005.066663:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddfd0b5000 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:3.0:1789131005.066667:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5000/0xf3fe2838e1fc28c5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131005.066674:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5000/0xf3fe2838e1fc28c5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131005.066692:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff91dded3a2b00) 00010000:00010000:3.0:1789131005.066695:0:6502:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789131005.066700:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5000/0xf3fe2838e1fc28c5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131005.066707:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5000/0xf3fe2838e1fc28c5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131005.066717:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4c00/0xf3fe2838e1fc28cc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131005.066724:0:6502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4c00/0xf3fe2838e1fc28cc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131005.066729:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4c00/0xf3fe2838e1fc28cc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131005.066734:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddfd0b4c00 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:3.0:1789131005.066737:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4c00/0xf3fe2838e1fc28cc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131005.066743:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4c00/0xf3fe2838e1fc28cc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131005.066749:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff91dded3a2000) 00010000:00010000:3.0:1789131005.066752:0:6502:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789131005.066754:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4c00/0xf3fe2838e1fc28cc lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131005.066760:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4c00/0xf3fe2838e1fc28cc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131005.066783:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4600/0xf3fe2838e1fc28d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131005.066788:0:6502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4600/0xf3fe2838e1fc28d3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131005.066793:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4600/0xf3fe2838e1fc28d3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131005.066797:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddfd0b4600 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:3.0:1789131005.066799:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4600/0xf3fe2838e1fc28d3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131005.066804:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4600/0xf3fe2838e1fc28d3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131005.066809:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff91dded3a2d00) 00010000:00010000:3.0:1789131005.066811:0:6502:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789131005.066814:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4600/0xf3fe2838e1fc28d3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131005.066819:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4600/0xf3fe2838e1fc28d3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131005.066891:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01b321c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+20:11566:x1876039498259712:12345-192.168.203.11@tcp:34:lfs.0 Request processed in 546us (1881us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131005.073542:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 95 00000100:00100000:0.0:1789131005.105105:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131005.105167:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498259968 00000100:00100000:2.0:1789131005.105177:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498259968 00000100:00100000:2.0:1789131005.105241:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 96 00000100:00100000:2.0:1789131005.105251:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd286d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+20:11569:x1876039498259968:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:2.0:1789131005.105271:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789131005.105293:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fe00/0xf3fe2838e1fc28da lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269a60 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131005.105372:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e400/0xf3fe2838e1fc28e1 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131005.105387:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e400/0xf3fe2838e1fc28e1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131005.105413:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e400/0xf3fe2838e1fc28e1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131005.105428:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e600/0xf3fe2838e1fc28e8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131005.105435:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e600/0xf3fe2838e1fc28e8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131005.105442:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e600/0xf3fe2838e1fc28e8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131005.105587:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e800/0xf3fe2838e1fc28ef lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131005.105596:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e800/0xf3fe2838e1fc28ef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131005.105602:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e800/0xf3fe2838e1fc28ef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789131005.105613:0:6500:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:2.0:1789131005.105683:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e400/0xf3fe2838e1fc28e1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131005.105691:0:6500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e400/0xf3fe2838e1fc28e1 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131005.105697:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e400/0xf3fe2838e1fc28e1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131005.105703:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc7f7e400 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:2.0:1789131005.105713:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e400/0xf3fe2838e1fc28e1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131005.105722:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e400/0xf3fe2838e1fc28e1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131005.105733:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff91dded3a2b00) 00010000:00010000:2.0:1789131005.105737:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789131005.105741:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e400/0xf3fe2838e1fc28e1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131005.105747:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e400/0xf3fe2838e1fc28e1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131005.105761:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e600/0xf3fe2838e1fc28e8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131005.105767:0:6500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e600/0xf3fe2838e1fc28e8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131005.105772:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e600/0xf3fe2838e1fc28e8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131005.105778:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc7f7e600 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:2.0:1789131005.105781:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e600/0xf3fe2838e1fc28e8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131005.105791:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e600/0xf3fe2838e1fc28e8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131005.105799:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff91dde1922900) 00010000:00010000:2.0:1789131005.105801:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789131005.105810:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e600/0xf3fe2838e1fc28e8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131005.105816:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e600/0xf3fe2838e1fc28e8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131005.105868:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fe00/0xf3fe2838e1fc28da lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269a60 expref: 23 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131005.105892:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e800/0xf3fe2838e1fc28ef lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269a60 expref: 22 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131005.105899:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff91dde1922d00) 00010000:00010000:2.0:1789131005.105902:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789131005.105904:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dcc7f7e800, rc 0) 00000100:00100000:2.0:1789131005.105979:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd286d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+22:11569:x1876039498259968:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 730us (883us total) trans 4294967366 rc 0/0 00000100:00100000:2.0:1789131005.105987:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 96 00000100:00100000:1.0:1789131005.109943:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131005.110022:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498260096 00000100:00100000:0.0:1789131005.110040:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498260096 00000100:00100000:0.0:1789131005.110123:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 97 00000100:00100000:0.0:1789131005.110133:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01b30f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+22:11569:x1876039498260096:12345-192.168.203.11@tcp:54:lfs.0 00010000:00010000:0.0:1789131005.110200:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7800/0xf3fe2838e1fc28fd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131005.110217:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7800/0xf3fe2838e1fc28fd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131005.110228:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7800/0xf3fe2838e1fc28fd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131005.110264:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7800/0xf3fe2838e1fc28fd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131005.110271:0:6501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7800/0xf3fe2838e1fc28fd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131005.110277:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7800/0xf3fe2838e1fc28fd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131005.110284:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91de01ad7800 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:0.0:1789131005.110288:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7800/0xf3fe2838e1fc28fd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131005.110296:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7800/0xf3fe2838e1fc28fd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131005.110307:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff91dde1922d00) 00010000:00010000:0.0:1789131005.110310:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789131005.110314:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7800/0xf3fe2838e1fc28fd lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131005.110332:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7800/0xf3fe2838e1fc28fd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131005.110411:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01b30f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+22:11569:x1876039498260096:12345-192.168.203.11@tcp:54:lfs.0 Request processed in 280us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131005.110419:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 97 00000100:00100000:3.0:1789131005.112902:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131005.113161:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498260352 00000100:00100000:2.0:1789131005.113171:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498260352 00000100:00100000:2.0:1789131005.113222:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 21 00000100:00100000:2.0:1789131005.113233:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dded1d4050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+22:11569:x1876039498260352:12345-192.168.203.11@tcp:35:lfs.0 00000100:00100000:2.0:1789131005.113422:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dded1d4050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+23:11569:x1876039498260352:12345-192.168.203.11@tcp:35:lfs.0 Request processed in 191us (527us total) trans 4294967367 rc 0/0 00000100:00100000:2.0:1789131005.113430:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 21 00000100:00100000:2.0:1789131005.154043:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789131005.154160:0:14851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498260608 00000100:00100000:1.0:1789131005.154170:0:14851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498260608 00000100:00100000:1.0:1789131005.154244:0:14851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 98 00000100:00100000:1.0:1789131005.154253:0:14851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc6ff8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+23:11094:x1876039498260608:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:1.0:1789131005.154274:0:14851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789131005.154293:0:14851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca200/0xf3fe2838e1fc2904 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269a67 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131005.154395:0:14851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85caa00/0xf3fe2838e1fc290b lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131005.154410:0:14851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e800/0xf3fe2838e1fc28ef lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269a60 expref: 24 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131005.154418:0:14851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85caa00/0xf3fe2838e1fc290b lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131005.154450:0:14851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e800/0xf3fe2838e1fc28ef lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269a60 expref: 24 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131005.154498:0:14851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e800/0xf3fe2838e1fc28ef lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269a60 expref: 24 pid: 6500 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131005.154512:0:14851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01b31680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:14851:1876039508838784:192.168.203.11@tcp:104: 00000100:00100000:1.0:1789131005.154638:0:14851:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddc4c14900 going to sleep for 11 seconds 00000100:00100000:2.0:1789131005.160186:0:14851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01b31680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:14851:1876039508838784:192.168.203.11@tcp:104: 00010000:00010000:2.0:1789131005.160215:0:14851:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85caa00/0xf3fe2838e1fc290b lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131005.160626:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789131005.160841:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498260736 00000100:00100000:1.0:1789131005.160848:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498260736 00010000:00010000:1.0:1789131005.161190:0:6485:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e800/0xf3fe2838e1fc28ef lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269a60 expref: 25 pid: 6500 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131005.161234:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 77 00000100:00100000:1.0:1789131005.161253:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc6ffb840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+25:2387:x1876039498260736:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789131005.161268:0:6485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789131005.161275:0:6485:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e800/0xf3fe2838e1fc28ef lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269a60 expref: 25 pid: 6500 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131005.161287:0:6485:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e800/0xf3fe2838e1fc28ef lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269a60 expref: 25 pid: 6500 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131005.161309:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e800/0xf3fe2838e1fc28ef lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269a60 expref: 25 pid: 6500 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131005.161325:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff91dde1922d00) 00010000:00010000:1.0:1789131005.161329:0:6485:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85caa00/0xf3fe2838e1fc290b lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131005.161338:0:6485:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85caa00/0xf3fe2838e1fc290b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131005.161344:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85caa00/0xf3fe2838e1fc290b lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131005.161382:0:6485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789131005.161440:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc6ffb840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+24:2387:x1876039498260736:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 188us (815us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131005.161448:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 77 00010000:00010000:2.0:1789131005.161620:0:14851:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85caa00/0xf3fe2838e1fc290b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131005.161629:0:14851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85caa00/0xf3fe2838e1fc290b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789131005.161660:0:14851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:2.0:1789131005.161790:0:14851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca200/0xf3fe2838e1fc2904 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269a67 expref: 25 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131005.161808:0:14851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85caa00/0xf3fe2838e1fc290b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269a67 expref: 24 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131005.161821:0:14851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff91dde1922d00) 00010000:00010000:2.0:1789131005.161823:0:14851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789131005.161826:0:14851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dcc85caa00, rc 0) 00000100:00100000:2.0:1789131005.161853:0:14851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc6ff8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+24:11094:x1876039498260608:12345-192.168.203.11@tcp:101:bash.0 Request processed in 7601us (7819us total) trans 4294967368 rc 0/0 00000100:00100000:2.0:1789131005.161861:0:14851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 98 00000100:00100000:1.0:1789131005.165437:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131005.165608:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498260864 00000100:00100000:2.0:1789131005.165617:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498260864 00000100:00100000:2.0:1789131005.165736:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 99 00000100:00100000:2.0:1789131005.165747:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01b30b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+24:11094:x1876039498260864:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:2.0:1789131005.165769:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789131005.165788:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fe00/0xf3fe2838e1fc2919 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269a6e expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131005.165855:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e600/0xf3fe2838e1fc2920 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131005.165868:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e600/0xf3fe2838e1fc2920 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131005.165878:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e600/0xf3fe2838e1fc2920 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131005.166000:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fe00/0xf3fe2838e1fc2919 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269a6e expref: 26 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131005.166017:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e600/0xf3fe2838e1fc2920 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269a6e expref: 25 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131005.166026:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff91dde1922d00) 00010000:00010000:2.0:1789131005.166029:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789131005.166043:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dcc7f7e600, rc 0) 00000100:00100000:2.0:1789131005.166105:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01b30b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+25:11094:x1876039498260864:12345-192.168.203.11@tcp:101:bash.0 Request processed in 360us (675us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131005.166113:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 99 00000100:00100000:0.0:1789131005.170745:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131005.170826:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498261120 00000100:00100000:2.0:1789131005.170836:0:14273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498261120 00000100:00100000:2.0:1789131005.170898:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 100 00000100:00100000:2.0:1789131005.170909:0:14273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd286c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+25:11094:x1876039498261120:12345-192.168.203.11@tcp:36:bash.0 00010000:00010000:2.0:1789131005.171124:0:14273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e400/0xf3fe2838e1fc2927 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131005.171174:0:14273:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e400/0xf3fe2838e1fc2927 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131005.171186:0:14273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e400/0xf3fe2838e1fc2927 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789131005.171229:0:14273:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967369 00000004:00010000:2.0:1789131005.171249:0:14273:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000f66e3d42 reply state 00000000e3a645eb transno 4294967370 ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e400/0xf3fe2838e1fc2927 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131005.171262:0:14273:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e400/0xf3fe2838e1fc2927 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131005.171269:0:14273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff91dde1922d00) 00010000:00010000:2.0:1789131005.171272:0:14273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789131005.171275:0:14273:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1789131005.171332:0:14273:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967370 00000100:00100000:2.0:1789131005.171421:0:14273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd286c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+29:11094:x1876039498261120:12345-192.168.203.11@tcp:36:bash.0 Request processed in 514us (685us total) trans 4294967371 rc 0/0 00000100:00100000:2.0:1789131005.171429:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 100 00000020:00080000:2.0:1789131005.171434:0:14273:0:(tgt_main.c:785:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1789131005.174674:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131005.174744:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498261248 00000100:00100000:3.0:1789131005.174752:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498261248 00000100:00100000:3.0:1789131005.174912:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 101 00000100:00100000:3.0:1789131005.174932:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd286e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+29:11094:x1876039498261248:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:3.0:1789131005.174954:0:6502:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789131005.174973:0:6502:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4600/0xf3fe2838e1fc292e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269a75 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131005.175022:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4600/0xf3fe2838e1fc292e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269a75 expref: 30 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131005.175046:0:6502:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4600/0xf3fe2838e1fc292e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269a75 expref: 30 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131005.175064:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff91dde1922d00) 00010000:00010000:3.0:1789131005.175067:0:6502:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789131005.175071:0:6502:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ddfd0b4600, rc 0) 00000100:00100000:3.0:1789131005.175128:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd286e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+30:11094:x1876039498261248:12345-192.168.203.11@tcp:101:bash.0 Request processed in 198us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131005.175135:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 101 00000100:00100000:1.0:1789131005.177997:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131005.178081:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498261376 00000100:00100000:0.0:1789131005.178091:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498261376 00000100:00100000:0.0:1789131005.178184:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 41 00000100:00100000:0.0:1789131005.178193:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01b31680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+6:11094:x1876039498261376:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:0.0:1789131005.178210:0:8414:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789131005.178228:0:8414:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002f64cbe7/0xf3fe2838e1fc2935 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269a7c expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789131005.178251:0:8414:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 9, mtime: 0x6aa3f8fb, atime: 0x6aa3f8f9, ctime: 0x6aa3f8fb, blocks: 0x8 00010000:00010000:0.0:1789131005.178269:0:8414:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=361s v=(0 0) 00010000:00010000:0.0:1789131005.178274:0:8414:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789131005.178281:0:8414:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002f64cbe7/0xf3fe2838e1fc2935 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269a7c expref: 7 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131005.178299:0:8414:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002f64cbe7/0xf3fe2838e1fc2935 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269a7c expref: 7 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131005.178311:0:8414:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91de01ad6a00, rc 0) 00000100:00100000:0.0:1789131005.178377:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01b31680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+7:11094:x1876039498261376:12345-192.168.203.11@tcp:101:bash.0 Request processed in 184us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131005.178384:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 41 00000100:00100000:0.0:1789131005.182084:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131005.183331:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498261504 00000100:00100000:2.0:1789131005.183343:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498261504 00002000:00010000:2.0:1789131005.183384:0:8420:0:(ofd_dev.c:2842:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/3 (0->18446744073709551615) 00002000:00100000:2.0:1789131005.183389:0:8420:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff91ddd286e940 with x1876039498261504 ext(0->18446744073709551615) 00002000:00010000:2.0:1789131005.183400:0:8420:0:(ofd_dev.c:2847:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91ddd286e940. 00000100:00100000:2.0:1789131005.183492:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1 00000100:00100000:2.0:1789131005.183502:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd286e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+7:2388:x1876039498261504:12345-192.168.203.11@tcp:10:bash.0 00002000:00010000:2.0:1789131005.183782:0:8420:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1789131005.183796:0:8420:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 1789131003 -> 1789131004 00002000:00010000:2.0:1789131005.183798:0:8420:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 1789131001 -> 1789131001 00002000:00010000:2.0:1789131005.183800:0:8420:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1789131003 -> 1789131004 00002000:00010000:2.0:1789131005.183802:0:8420:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:2.0:1789131005.183989:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd286e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+8:2388:x1876039498261504:12345-192.168.203.11@tcp:10:bash.0 Request processed in 487us (1913us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1789131005.183998:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1 00002000:00010000:2.0:1789131005.184002:0:8420:0:(ofd_dev.c:2842:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/3 (0->18446744073709551615) 00002000:00100000:2.0:1789131005.184004:0:8420:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff91ddd286e940 with x1876039498261504 ext(0->18446744073709551615) 00002000:00010000:2.0:1789131005.184009:0:8420:0:(ofd_dev.c:2847:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91ddd286e940. 00000100:00100000:1.0:1789131005.247996:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131005.248314:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498261632 00000100:00100000:0.0:1789131005.248325:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498261632 00000100:00100000:0.0:1789131005.248387:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 102 00000100:00100000:0.0:1789131005.248397:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01b31a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+30:11583:x1876039498261632:12345-192.168.203.11@tcp:34:lfs.0 00010000:00010000:0.0:1789131005.248505:0:9769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7c00/0xf3fe2838e1fc293c lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131005.248535:0:9769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7c00/0xf3fe2838e1fc293c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131005.248546:0:9769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7c00/0xf3fe2838e1fc293c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131005.248563:0:9769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6200/0xf3fe2838e1fc2943 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131005.248570:0:9769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6200/0xf3fe2838e1fc2943 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131005.248577:0:9769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6200/0xf3fe2838e1fc2943 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131005.248661:0:9769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc294a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131005.248671:0:9769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc294a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131005.248695:0:9769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc294a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789131005.248738:0:9769:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc294a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131005.248748:0:9769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7c00/0xf3fe2838e1fc293c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131005.248754:0:9769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7c00/0xf3fe2838e1fc293c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131005.248761:0:9769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7c00/0xf3fe2838e1fc293c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131005.248766:0:9769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91de01ad7c00 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:0.0:1789131005.248770:0:9769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7c00/0xf3fe2838e1fc293c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131005.248777:0:9769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7c00/0xf3fe2838e1fc293c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131005.248788:0:9769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff91dded3a2b00) 00010000:00010000:0.0:1789131005.248791:0:9769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789131005.248795:0:9769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7c00/0xf3fe2838e1fc293c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131005.248801:0:9769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7c00/0xf3fe2838e1fc293c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131005.248813:0:9769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6200/0xf3fe2838e1fc2943 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131005.248824:0:9769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6200/0xf3fe2838e1fc2943 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131005.248830:0:9769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6200/0xf3fe2838e1fc2943 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131005.248835:0:9769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91de01ad6200 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:0.0:1789131005.248838:0:9769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6200/0xf3fe2838e1fc2943 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131005.248844:0:9769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6200/0xf3fe2838e1fc2943 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131005.248851:0:9769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff91ddc4c81200) 00010000:00010000:0.0:1789131005.248854:0:9769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789131005.248856:0:9769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6200/0xf3fe2838e1fc2943 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131005.248862:0:9769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6200/0xf3fe2838e1fc2943 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131005.248876:0:9769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc294a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131005.248882:0:9769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc294a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131005.248887:0:9769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc294a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131005.248892:0:9769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91de01ad7600 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:0.0:1789131005.248900:0:9769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc294a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131005.248907:0:9769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc294a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131005.248925:0:9769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff91dde1922d00) 00010000:00010000:0.0:1789131005.248928:0:9769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789131005.248932:0:9769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc294a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131005.248938:0:9769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc294a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131005.249282:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01b31a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+30:11583:x1876039498261632:12345-192.168.203.11@tcp:34:lfs.0 Request processed in 884us (1292us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131005.249292:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 102 00000100:00100000:1.0:1789131005.301371:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131005.301498:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498261888 00000100:00100000:2.0:1789131005.301514:0:14273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498261888 00000100:00100000:2.0:1789131005.301572:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 103 00000100:00100000:2.0:1789131005.301581:0:14273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01b32d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+30:11586:x1876039498261888:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:2.0:1789131005.301604:0:14273:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789131005.301623:0:14273:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fe00/0xf3fe2838e1fc2951 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269a83 expref: -99 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131005.301685:0:14273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e200/0xf3fe2838e1fc2958 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131005.301700:0:14273:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e200/0xf3fe2838e1fc2958 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131005.301711:0:14273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e200/0xf3fe2838e1fc2958 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131005.301725:0:14273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f800/0xf3fe2838e1fc295f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131005.301748:0:14273:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f800/0xf3fe2838e1fc295f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131005.301755:0:14273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f800/0xf3fe2838e1fc295f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131005.301847:0:14273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7ea00/0xf3fe2838e1fc2966 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131005.301857:0:14273:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7ea00/0xf3fe2838e1fc2966 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131005.301864:0:14273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7ea00/0xf3fe2838e1fc2966 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789131005.301874:0:14273:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1789131005.301947:0:14273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e200/0xf3fe2838e1fc2958 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131005.301955:0:14273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e200/0xf3fe2838e1fc2958 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131005.301961:0:14273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e200/0xf3fe2838e1fc2958 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131005.301967:0:14273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc7f7e200 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:2.0:1789131005.301971:0:14273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e200/0xf3fe2838e1fc2958 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131005.301977:0:14273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e200/0xf3fe2838e1fc2958 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131005.301998:0:14273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff91dded3a2b00) 00010000:00010000:2.0:1789131005.302001:0:14273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789131005.302005:0:14273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e200/0xf3fe2838e1fc2958 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131005.302012:0:14273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e200/0xf3fe2838e1fc2958 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131005.302024:0:14273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f800/0xf3fe2838e1fc295f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131005.302030:0:14273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f800/0xf3fe2838e1fc295f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131005.302035:0:14273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f800/0xf3fe2838e1fc295f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131005.302040:0:14273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc7f7f800 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:2.0:1789131005.302043:0:14273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f800/0xf3fe2838e1fc295f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131005.302049:0:14273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f800/0xf3fe2838e1fc295f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131005.302055:0:14273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff91dde1922900) 00010000:00010000:2.0:1789131005.302057:0:14273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789131005.302060:0:14273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f800/0xf3fe2838e1fc295f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131005.302065:0:14273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f800/0xf3fe2838e1fc295f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131005.302115:0:14273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fe00/0xf3fe2838e1fc2951 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269a83 expref: 33 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131005.302375:0:14273:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7ea00/0xf3fe2838e1fc2966 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269a83 expref: 32 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131005.302384:0:14273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff91dde1922d00) 00010000:00010000:2.0:1789131005.302386:0:14273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789131005.302389:0:14273:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dcc7f7ea00, rc 0) 00000100:00100000:2.0:1789131005.302828:0:14273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01b32d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+32:11586:x1876039498261888:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 1245us (1465us total) trans 4294967372 rc 0/0 00000100:00100000:2.0:1789131005.302837:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 103 00000100:00100000:1.0:1789131005.310018:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131005.310231:0:14851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498262016 00000100:00100000:2.0:1789131005.310242:0:14851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498262016 00000100:00100000:2.0:1789131005.310299:0:14851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 104 00000100:00100000:2.0:1789131005.310310:0:14851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01b33c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+32:11586:x1876039498262016:12345-192.168.203.11@tcp:54:lfs.0 00010000:00010000:2.0:1789131005.310378:0:14851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f600/0xf3fe2838e1fc2974 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131005.310395:0:14851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85caa00/0xf3fe2838e1fc290b lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269a67 expref: 32 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131005.310405:0:14851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f600/0xf3fe2838e1fc2974 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131005.310452:0:14851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85caa00/0xf3fe2838e1fc290b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269a67 expref: 32 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131005.310942:0:14851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85caa00/0xf3fe2838e1fc290b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269a67 expref: 32 pid: 14851 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131005.310960:0:14851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc6ffb480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:14851:1876039508838912:192.168.203.11@tcp:104: 00000100:00100000:2.0:1789131005.311094:0:14851:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddff7d73c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789131005.318714:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131005.318800:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498262272 00000100:00100000:0.0:1789131005.318809:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498262272 00000100:00100000:0.0:1789131005.318868:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 22 00000100:00100000:0.0:1789131005.318878:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01b303c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+33:11030:x1876039498262272:12345-192.168.203.11@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1789131005.319171:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01b303c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+34:11030:x1876039498262272:12345-192.168.203.11@tcp:35:ldlm_bl.0 Request processed in 294us (465us total) trans 4294967373 rc 0/0 00000100:00100000:0.0:1789131005.319179:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 22 00000100:00100000:2.0:1789131005.319993:0:14851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc6ffb480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:14851:1876039508838912:192.168.203.11@tcp:104: 00010000:00010000:2.0:1789131005.320019:0:14851:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f600/0xf3fe2838e1fc2974 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131005.321971:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131005.322064:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498262400 00000100:00100000:3.0:1789131005.322073:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498262400 00010000:00010000:3.0:1789131005.322109:0:6486:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85caa00/0xf3fe2838e1fc290b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269a67 expref: 34 pid: 14851 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131005.322154:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 78 00000100:00100000:3.0:1789131005.322164:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01b33840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+34:2387:x1876039498262400:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789131005.322179:0:6486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789131005.322186:0:6486:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85caa00/0xf3fe2838e1fc290b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269a67 expref: 34 pid: 14851 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131005.322213:0:6486:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85caa00/0xf3fe2838e1fc290b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269a67 expref: 34 pid: 14851 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131005.322236:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85caa00/0xf3fe2838e1fc290b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269a67 expref: 34 pid: 14851 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131005.322416:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff91dde1922d00) 00010000:00010000:3.0:1789131005.322423:0:6486:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f600/0xf3fe2838e1fc2974 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131005.322431:0:6486:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f600/0xf3fe2838e1fc2974 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131005.322438:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f600/0xf3fe2838e1fc2974 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131005.322508:0:6486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789131005.322561:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01b33840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+33:2387:x1876039498262400:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 398us (597us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131005.322570:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 78 00010000:00010000:2.0:1789131005.322884:0:14851:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f600/0xf3fe2838e1fc2974 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131005.322893:0:14851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f600/0xf3fe2838e1fc2974 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131005.322937:0:14851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f600/0xf3fe2838e1fc2974 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131005.322945:0:14851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f600/0xf3fe2838e1fc2974 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131005.322952:0:14851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f600/0xf3fe2838e1fc2974 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131005.322958:0:14851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc7f7f600 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:2.0:1789131005.322962:0:14851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f600/0xf3fe2838e1fc2974 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131005.322969:0:14851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f600/0xf3fe2838e1fc2974 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131005.322987:0:14851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff91dde1922d00) 00010000:00010000:2.0:1789131005.322990:0:14851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789131005.322994:0:14851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f600/0xf3fe2838e1fc2974 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131005.323001:0:14851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f600/0xf3fe2838e1fc2974 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131005.323059:0:14851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01b33c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+32:11586:x1876039498262016:12345-192.168.203.11@tcp:54:lfs.0 Request processed in 12749us (13049us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131005.323068:0:14851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 104 00000100:00100000:1.0:1789131005.328359:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131005.328443:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498262656 00000100:00100000:0.0:1789131005.328453:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498262656 00000100:00100000:0.0:1789131005.328541:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 23 00000100:00100000:0.0:1789131005.328551:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd2868f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+32:11586:x1876039498262656:12345-192.168.203.11@tcp:35:lfs.0 00000100:00100000:0.0:1789131005.328766:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd2868f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+33:11586:x1876039498262656:12345-192.168.203.11@tcp:35:lfs.0 Request processed in 215us (416us total) trans 4294967374 rc 0/0 00000100:00100000:0.0:1789131005.328788:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 23 00000100:00100000:1.0:1789131005.481403:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131005.483500:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498262912 00000100:00100000:2.0:1789131005.483513:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498262912 00000100:00100000:2.0:1789131005.483588:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 105 00000100:00100000:2.0:1789131005.483598:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd286a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+33:11597:x1876039498262912:12345-192.168.203.11@tcp:101:cat.0 00010000:00010000:2.0:1789131005.483622:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789131005.483641:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f600/0xf3fe2838e1fc297b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269a8a expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131005.483704:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fe00/0xf3fe2838e1fc2982 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131005.483717:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fe00/0xf3fe2838e1fc2982 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131005.483727:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fe00/0xf3fe2838e1fc2982 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131005.483740:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f800/0xf3fe2838e1fc2989 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131005.483758:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f800/0xf3fe2838e1fc2989 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131005.483764:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f800/0xf3fe2838e1fc2989 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131005.483865:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e200/0xf3fe2838e1fc2990 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131005.483874:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e200/0xf3fe2838e1fc2990 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131005.483881:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e200/0xf3fe2838e1fc2990 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789131005.483891:0:6500:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 8 00010000:00010000:2.0:1789131005.483967:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fe00/0xf3fe2838e1fc2982 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131005.483974:0:6500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fe00/0xf3fe2838e1fc2982 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131005.483981:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fe00/0xf3fe2838e1fc2982 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131005.483987:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc7f7fe00 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:2.0:1789131005.484001:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fe00/0xf3fe2838e1fc2982 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131005.484009:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fe00/0xf3fe2838e1fc2982 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131005.484030:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff91dded3a2b00) 00010000:00010000:2.0:1789131005.484033:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789131005.484037:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fe00/0xf3fe2838e1fc2982 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131005.484044:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fe00/0xf3fe2838e1fc2982 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131005.484055:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f800/0xf3fe2838e1fc2989 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131005.484061:0:6500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f800/0xf3fe2838e1fc2989 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131005.484066:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f800/0xf3fe2838e1fc2989 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131005.484072:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc7f7f800 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:2.0:1789131005.484075:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f800/0xf3fe2838e1fc2989 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131005.484080:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f800/0xf3fe2838e1fc2989 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131005.484633:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff91dde1922900) 00010000:00010000:2.0:1789131005.484636:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789131005.484639:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f800/0xf3fe2838e1fc2989 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131005.484646:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f800/0xf3fe2838e1fc2989 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131005.484698:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f600/0xf3fe2838e1fc297b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269a8a expref: 36 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131005.484722:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e200/0xf3fe2838e1fc2990 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269a8a expref: 35 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131005.484730:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff91dde1922d00) 00010000:00010000:2.0:1789131005.484732:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789131005.484735:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dcc7f7e200, rc 0) 00000100:00100000:2.0:1789131005.484794:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd286a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+35:11597:x1876039498262912:12345-192.168.203.11@tcp:101:cat.0 Request processed in 1197us (3400us total) trans 4294967375 rc 0/0 00000100:00100000:2.0:1789131005.484802:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 105 00000100:00100000:1.0:1789131005.499909:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131005.500022:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498263168 00000100:00100000:0.0:1789131005.500032:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498263168 00000100:00100000:0.0:1789131005.500090:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 24 00000100:00100000:0.0:1789131005.500100:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd286b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+35:11597:x1876039498263168:12345-192.168.203.11@tcp:35:cat.0 00000100:00100000:0.0:1789131005.500391:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd286b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+36:11597:x1876039498263168:12345-192.168.203.11@tcp:35:cat.0 Request processed in 291us (489us total) trans 4294967376 rc 0/0 00000100:00100000:0.0:1789131005.500399:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 24 00000100:00100000:1.0:1789131005.555117:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131005.555211:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498263424 00000100:00100000:0.0:1789131005.555221:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498263424 00000100:00100000:0.0:1789131005.555283:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 106 00000100:00100000:0.0:1789131005.555292:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7b24f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+36:11598:x1876039498263424:12345-192.168.203.11@tcp:36:rm.0 00010000:00010000:0.0:1789131005.555357:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1789131005.555384:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4600/0xf3fe2838e1fc292e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269a75 expref: 36 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131005.555406:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e200/0xf3fe2838e1fc2990 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269a8a expref: 35 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131005.555418:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7ea00/0xf3fe2838e1fc2966 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269a83 expref: 34 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131005.555430:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e600/0xf3fe2838e1fc2920 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269a6e expref: 33 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131005.555440:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff91dde1922d00) 00010000:00010000:0.0:1789131005.555505:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789131005.555526:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc299e lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131005.555548:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc299e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131005.555558:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc299e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131005.555572:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6200/0xf3fe2838e1fc29a5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131005.555580:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6200/0xf3fe2838e1fc29a5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131005.555586:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6200/0xf3fe2838e1fc29a5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131005.555654:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7c00/0xf3fe2838e1fc29ac lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131005.555663:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7c00/0xf3fe2838e1fc29ac lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131005.555669:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7c00/0xf3fe2838e1fc29ac lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789131005.555858:0:6501:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:0.0:1789131005.555867:0:6501:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 361473407378ns, next at 362473405036ns, rc = 0 00010000:00010000:0.0:1789131005.555906:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6400/0xf3fe2838e1fc29b3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131005.555937:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6400/0xf3fe2838e1fc29b3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131005.555945:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6400/0xf3fe2838e1fc29b3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131005.555952:0:6501:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6400/0xf3fe2838e1fc29b3 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131005.555958:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6400/0xf3fe2838e1fc29b3 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131005.555964:0:6501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6400/0xf3fe2838e1fc29b3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131005.555979:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789131005.555995:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7c00/0xf3fe2838e1fc29ac lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131005.556001:0:6501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7c00/0xf3fe2838e1fc29ac lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131005.556007:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7c00/0xf3fe2838e1fc29ac lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131005.556013:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91de01ad7c00 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:0.0:1789131005.556017:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7c00/0xf3fe2838e1fc29ac lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131005.556023:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7c00/0xf3fe2838e1fc29ac lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131005.556043:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff91dde1922d00) 00010000:00010000:0.0:1789131005.556046:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789131005.556050:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7c00/0xf3fe2838e1fc29ac lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131005.556056:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7c00/0xf3fe2838e1fc29ac lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131005.556071:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc299e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131005.556077:0:6501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc299e lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131005.556083:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc299e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131005.556088:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91de01ad7600 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:0.0:1789131005.556090:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc299e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131005.556095:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc299e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131005.556101:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff91dded3a2b00) 00010000:00010000:0.0:1789131005.556103:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789131005.556106:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc299e lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131005.556112:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc299e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789131005.556131:0:6501:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000ce983d06 reply state 00000000f8536bc8 transno 4294967377 ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6200/0xf3fe2838e1fc29a5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131005.556142:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6200/0xf3fe2838e1fc29a5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131005.556148:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff91ddc4c81200) 00010000:00010000:0.0:1789131005.556150:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789131005.556152:0:6501:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789131005.556229:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7b24f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+34:11598:x1876039498263424:12345-192.168.203.11@tcp:36:rm.0 Request processed in 937us (1120us total) trans 4294967377 rc 0/0 00000100:00100000:0.0:1789131005.556237:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 106 00010000:00010000:1.0:1789131005.556303:0:7442:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789131005.556309:0:7442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6400/0xf3fe2838e1fc29b3 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131005.556315:0:7442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91de01ad6400 already unused, calling callback (ffffffffc0c4e550) 00010000:00010000:1.0:1789131005.556318:0:7442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6400/0xf3fe2838e1fc29b3 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131005.556324:0:7442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6400/0xf3fe2838e1fc29b3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131005.556333:0:7442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff91dde1922d00) 00010000:00010000:1.0:1789131005.556335:0:7442:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789131005.556338:0:7442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6400/0xf3fe2838e1fc29b3 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131005.556343:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6400/0xf3fe2838e1fc29b3 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131005.556353:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789131005.556355:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789131005.556356:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789131005.643812:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131005.643888:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498263680 00000100:00100000:3.0:1789131005.643897:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498263680 00000100:00100000:3.0:1789131005.643971:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 107 00000100:00100000:3.0:1789131005.643981:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7b26940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+34:11604:x1876039498263680:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:3.0:1789131005.644006:0:6502:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789131005.644027:0:6502:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4c00/0xf3fe2838e1fc29ba lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269a91 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131005.644156:0:6502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5000/0xf3fe2838e1fc29c1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131005.644170:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5000/0xf3fe2838e1fc29c1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131005.644180:0:6502:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5000/0xf3fe2838e1fc29c1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131005.644191:0:6502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4600/0xf3fe2838e1fc29c8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131005.644198:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4600/0xf3fe2838e1fc29c8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131005.644204:0:6502:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4600/0xf3fe2838e1fc29c8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789131005.644526:0:6502:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x3:0x0], index 0: 0 00010000:00010000:3.0:1789131005.644866:0:6502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4200/0xf3fe2838e1fc29cf lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131005.644877:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4200/0xf3fe2838e1fc29cf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131005.644884:0:6502:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4200/0xf3fe2838e1fc29cf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131005.644927:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5000/0xf3fe2838e1fc29c1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131005.644947:0:6502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5000/0xf3fe2838e1fc29c1 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131005.644953:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5000/0xf3fe2838e1fc29c1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131005.644960:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddfd0b5000 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:3.0:1789131005.644964:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5000/0xf3fe2838e1fc29c1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131005.644972:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5000/0xf3fe2838e1fc29c1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131005.644984:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff91dded3a2b00) 00010000:00010000:3.0:1789131005.644987:0:6502:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789131005.644992:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5000/0xf3fe2838e1fc29c1 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131005.644998:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5000/0xf3fe2838e1fc29c1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789131005.645011:0:6502:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000036452557 reply state 00000000a55d65b0 transno 4294967378 ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4600/0xf3fe2838e1fc29c8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131005.645021:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4600/0xf3fe2838e1fc29c8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131005.645028:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff91ddc4c81200) 00010000:00010000:3.0:1789131005.645030:0:6502:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789131005.645033:0:6502:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789131005.645063:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4c00/0xf3fe2838e1fc29ba lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269a91 expref: 37 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131005.645084:0:6502:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4200/0xf3fe2838e1fc29cf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269a91 expref: 36 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131005.645091:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff91dded3a2d00) 00010000:00010000:3.0:1789131005.645094:0:6502:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789131005.645096:0:6502:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ddfd0b4200, rc 0) 00000100:00100000:3.0:1789131005.645226:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7b26940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+37:11604:x1876039498263680:12345-192.168.203.11@tcp:101:bash.0 Request processed in 1245us (1421us total) trans 4294967378 rc 0/0 00000100:00100000:3.0:1789131005.645234:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 107 00000100:00100000:3.0:1789131005.652262:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131005.652397:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498263808 00000100:00100000:2.0:1789131005.652406:0:9827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498263808 00000100:00100000:2.0:1789131005.652509:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 42 00000100:00100000:2.0:1789131005.652520:0:9827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc850a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+7:2387:x1876039498263808:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:2.0:1789131005.652537:0:9827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789131005.652557:0:9827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009d0325f4/0xf3fe2838e1fc29dd lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269a98 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789131005.652594:0:9827:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789131005.652615:0:9827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=361s v=(0 0) 00010000:00010000:2.0:1789131005.652619:0:9827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789131005.652629:0:9827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d0325f4/0xf3fe2838e1fc29dd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269a98 expref: 8 pid: 9827 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131005.652668:0:9827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009d0325f4/0xf3fe2838e1fc29dd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269a98 expref: 8 pid: 9827 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131005.652681:0:9827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dcc7f7f800, rc 0) 00000100:00100000:2.0:1789131005.652749:0:9827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc850a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+8:2387:x1876039498263808:12345-192.168.203.11@tcp:101:bash.0 Request processed in 230us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131005.652757:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 42 00000100:00080000:3.0:1789131005.653500:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789131005.659555:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131005.659752:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498263936 00000100:00100000:2.0:1789131005.659760:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498263936 00000100:00100000:2.0:1789131005.659819:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 43 00000100:00100000:2.0:1789131005.659828:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7b24b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+8:11604:x1876039498263936:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:2.0:1789131005.659843:0:8416:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789131005.659860:0:8416:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ba16950d/0xf3fe2838e1fc29e4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269a9f expref: -99 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131005.659891:0:8416:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009d0325f4/0xf3fe2838e1fc29dd lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269a98 expref: 9 pid: 9827 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131005.659901:0:8416:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789131005.659906:0:8416:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789131005.659911:0:8416:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba16950d/0xf3fe2838e1fc29e4 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269a9f expref: 9 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131005.659954:0:8416:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009d0325f4/0xf3fe2838e1fc29dd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269a98 expref: 9 pid: 9827 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131005.659975:0:8416:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009d0325f4/0xf3fe2838e1fc29dd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269a98 expref: 9 pid: 9827 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131005.659988:0:8416:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc6ffb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8416:1876039508839040:192.168.203.11@tcp:104: 00000100:00100000:2.0:1789131005.660086:0:8416:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddff7d73c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789131005.667410:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131005.667495:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498264064 00000100:00100000:3.0:1789131005.667504:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498264064 00010000:00010000:3.0:1789131005.667543:0:6485:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009d0325f4/0xf3fe2838e1fc29dd lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269a98 expref: 10 pid: 9827 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131005.667591:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 79 00000100:00100000:3.0:1789131005.667601:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7b27c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+10:2388:x1876039498264064:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789131005.667615:0:6485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789131005.667636:0:6485:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009d0325f4/0xf3fe2838e1fc29dd lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269a98 expref: 10 pid: 9827 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131005.667650:0:6485:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009d0325f4/0xf3fe2838e1fc29dd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269a98 expref: 10 pid: 9827 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131005.667691:0:6485:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789131005.667696:0:6485:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789131005.667705:0:6485:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ba16950d/0xf3fe2838e1fc29e4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269a9f expref: 10 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131005.667715:0:6485:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba16950d/0xf3fe2838e1fc29e4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269a9f expref: 10 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131005.667754:0:6485:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000ba16950d/0xf3fe2838e1fc29e4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269a9f expref: 10 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131005.667768:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddc2e87840 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6485:1876039508839168:192.168.203.11@tcp:105: 00000100:00100000:3.0:1789131005.667862:0:6485:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddd8364cc0 going to sleep for 11 seconds 00010000:00010000:2.0:1789131005.668098:0:8416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009d0325f4/0xf3fe2838e1fc29dd lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269a98 expref: 10 pid: 9827 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131005.668114:0:8416:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc6ffb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8416:1876039508839040:192.168.203.11@tcp:104: 00010000:00010000:2.0:1789131005.668151:0:8416:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ba16950d/0xf3fe2838e1fc29e4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269a9f expref: 9 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131005.668162:0:8416:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dcc7f7fe00, rc 0) 00000100:00100000:2.0:1789131005.668192:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7b24b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+9:11604:x1876039498263936:12345-192.168.203.11@tcp:101:bash.0 Request processed in 8365us (8645us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131005.668200:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 43 00000100:00100000:1.0:1789131005.671856:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddc2e87840 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6485:1876039508839168:192.168.203.11@tcp:105: 00010000:00010000:1.0:1789131005.671882:0:6485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789131005.671941:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7b27c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+8:2388:x1876039498264064:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 4340us (4538us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131005.671952:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 79 00000100:00100000:0.0:1789131005.677327:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131005.677439:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498264320 00000100:00100000:2.0:1789131005.677449:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498264320 00000100:00100000:2.0:1789131005.677534:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 25 00000100:00100000:2.0:1789131005.677543:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddca181a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+37:11604:x1876039498264320:12345-192.168.203.11@tcp:35:bash.0 00000100:00100000:2.0:1789131005.678007:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddca181a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+38:11604:x1876039498264320:12345-192.168.203.11@tcp:35:bash.0 Request processed in 462us (686us total) trans 4294967379 rc 0/0 00000100:00100000:2.0:1789131005.678016:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 25 00010000:00010000:0.0:1789131005.841844:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789131005.858436:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131005.858574:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498264448 00000100:00100000:0.0:1789131005.858584:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498264448 00000100:00100000:0.0:1789131005.858652:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 108 00000100:00100000:0.0:1789131005.858662:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc6ffb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+38:11620:x1876039498264448:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:0.0:1789131005.858684:0:9769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789131005.858709:0:9769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6e00/0xf3fe2838e1fc29eb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269aa6 expref: -99 pid: 9769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131005.858810:0:9769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6800/0xf3fe2838e1fc29f2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131005.858823:0:9769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6800/0xf3fe2838e1fc29f2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131005.858833:0:9769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6800/0xf3fe2838e1fc29f2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789131005.858881:0:9769:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1789131005.858884:0:9769:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789131005.858903:0:9769:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6800/0xf3fe2838e1fc29f2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131005.858940:0:9769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6e00/0xf3fe2838e1fc29eb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269aa6 expref: 40 pid: 9769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131005.858958:0:9769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6800/0xf3fe2838e1fc29f2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269aa6 expref: 39 pid: 9769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131005.858967:0:9769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff91dded3a2b00) 00010000:00010000:0.0:1789131005.858971:0:9769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789131005.858974:0:9769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91de01ad6800, rc 0) 00000100:00100000:0.0:1789131005.859034:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc6ffb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+39:11620:x1876039498264448:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 374us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131005.859042:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 108 00000100:00100000:1.0:1789131005.865964:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131005.868879:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498264704 00000100:00100000:0.0:1789131005.868893:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498264704 00000100:00100000:0.0:1789131005.868982:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 109 00000100:00100000:0.0:1789131005.868991:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7d9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+39:11620:x1876039498264704:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:0.0:1789131005.869010:0:6501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789131005.869035:0:6501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7e00/0xf3fe2838e1fc29f9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269aad expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131005.869141:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7c00/0xf3fe2838e1fc2a00 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131005.869172:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7c00/0xf3fe2838e1fc2a00 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131005.869183:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7c00/0xf3fe2838e1fc2a00 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789131005.869204:0:6501:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1789131005.869306:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7e00/0xf3fe2838e1fc29f9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269aad expref: 42 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131005.869324:0:6501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7c00/0xf3fe2838e1fc2a00 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269aad expref: 41 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131005.869332:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff91dded3a2d00) 00010000:00010000:0.0:1789131005.869334:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789131005.869338:0:6501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91de01ad7c00, rc 0) 00000100:00100000:0.0:1789131005.869409:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7d9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+41:11620:x1876039498264704:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 418us (3453us total) trans 4294967380 rc 0/0 00000100:00100000:0.0:1789131005.869417:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 109 00000100:00100000:2.0:1789131005.872606:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789131005.872824:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498264832 00000100:00100000:1.0:1789131005.872834:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498264832 00000100:00100000:1.0:1789131005.872897:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 7 00000100:00100000:1.0:1789131005.872909:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc6ff92c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+41:2388:x1876039498264832:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789131005.872936:0:8431:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789131005.872961:0:8431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7c00/0xf3fe2838e1fc2a00 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269aad expref: 41 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131005.872981:0:8431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff91dded3a2d00) 00010000:00010000:1.0:1789131005.872986:0:8431:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789131005.873042:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc6ff92c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+40:2388:x1876039498264832:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 135us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131005.873050:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 7 00000100:00100000:1.0:1789131005.876204:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131005.876356:0:14851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498265088 00000100:00100000:2.0:1789131005.876365:0:14851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498265088 00000100:00100000:2.0:1789131005.876418:0:14851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 110 00000100:00100000:2.0:1789131005.876428:0:14851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7d9b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+40:11620:x1876039498265088:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:2.0:1789131005.876452:0:14851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789131005.876523:0:14851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7ea00/0xf3fe2838e1fc2a0e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269ab4 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131005.876625:0:14851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e200/0xf3fe2838e1fc2a15 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131005.876639:0:14851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e200/0xf3fe2838e1fc2a15 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131005.876655:0:14851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e200/0xf3fe2838e1fc2a15 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789131005.876668:0:14851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1789131005.877099:0:14851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7ea00/0xf3fe2838e1fc2a0e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269ab4 expref: 43 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131005.877118:0:14851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e200/0xf3fe2838e1fc2a15 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269ab4 expref: 42 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131005.877138:0:14851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff91dded3a2d00) 00010000:00010000:2.0:1789131005.877141:0:14851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789131005.877144:0:14851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dcc7f7e200, rc 0) 00000100:00100000:2.0:1789131005.877201:0:14851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7d9b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+42:11620:x1876039498265088:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 774us (1005us total) trans 4294967381 rc 0/0 00000100:00100000:2.0:1789131005.877222:0:14851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 110 00000100:00100000:2.0:1789131005.885027:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131005.885223:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498265216 00000100:00100000:0.0:1789131005.885233:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498265216 00000100:00100000:0.0:1789131005.885343:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 44 00000100:00100000:0.0:1789131005.885355:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc6ff83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+8:2386:x1876039498265216:12345-192.168.203.11@tcp:1:lfs.0 00010000:00010000:0.0:1789131005.885397:0:8417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000786a2989/0xf3fe2838e1fc2a23 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131005.885417:0:8417:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ba16950d/0xf3fe2838e1fc29e4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269a9f expref: 8 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131005.885439:0:8417:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789131005.885443:0:8417:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789131005.885448:0:8417:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000786a2989/0xf3fe2838e1fc2a23 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131005.885521:0:8417:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ba16950d/0xf3fe2838e1fc29e4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269a9f expref: 8 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131005.885547:0:8417:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ba16950d/0xf3fe2838e1fc29e4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269a9f expref: 8 pid: 8416 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131005.885562:0:8417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7ad2d00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8417:1876039508839296:192.168.203.11@tcp:104: 00000100:00100000:0.0:1789131005.885636:0:8417:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddc33c49c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789131005.892138:0:8417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7ad2d00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8417:1876039508839296:192.168.203.11@tcp:104: 00010000:00010000:0.0:1789131005.892170:0:8417:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000786a2989/0xf3fe2838e1fc2a23 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131005.895256:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131005.900327:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498265344 00000100:00100000:3.0:1789131005.900343:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498265344 00002000:00100000:3.0:1789131005.900408:0:8422:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff91dcc6ffa580 x1876039498265344/t0(0) o4->b99c111d-b9b6-4590-88e4-9fefd4d4c3a4@192.168.203.11@tcp:721/0 lens 504/0 e 0 to 0 dl 1789131016 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789131005.900421:0:8422:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff91dcc6ffa580 with x1876039498265344 ext(0->8) 00010000:00010000:3.0:1789131005.900431:0:8422:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000ba16950d/0xf3fe2838e1fc29e4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269a9f expref: 9 pid: 8416 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131005.900448:0:8422:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000ba16950d/0xf3fe2838e1fc29e4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269a9f expref: 9 pid: 8416 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789131005.900473:0:8422:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff91dcc6ffa580 00000100:00100000:3.0:1789131005.900539:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1 00000100:00100000:3.0:1789131005.900550:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc6ffa580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+9:2387:x1876039498265344:12345-192.168.203.11@tcp:4:lfs.0 00000100:00100000:3.0:1789131005.901780:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc6ffa580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+11:2387:x1876039498265344:12345-192.168.203.11@tcp:4:lfs.0 Request processed in 1226us (6526us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1789131005.901790:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1 00002000:00100000:3.0:1789131005.901798:0:8422:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff91dcc6ffa580 x1876039498265344/t4294967303(0) o4->b99c111d-b9b6-4590-88e4-9fefd4d4c3a4@192.168.203.11@tcp:721/0 lens 504/448 e 0 to 0 dl 1789131016 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789131005.901808:0:8422:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff91dcc6ffa580 with x1876039498265344 ext(0->8) 00010000:00010000:3.0:1789131005.901816:0:8422:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000ba16950d/0xf3fe2838e1fc29e4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269a9f expref: 11 pid: 8416 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131005.901830:0:8422:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000ba16950d/0xf3fe2838e1fc29e4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269a9f expref: 11 pid: 8416 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789131005.901838:0:8422:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff91dcc6ffa580 00000100:00100000:2.0:1789131005.909717:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131005.909798:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498265472 00000100:00100000:3.0:1789131005.909809:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498265472 00010000:00010000:3.0:1789131005.909851:0:6487:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ba16950d/0xf3fe2838e1fc29e4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269a9f expref: 11 pid: 8416 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131005.909907:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 80 00000100:00100000:3.0:1789131005.909926:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc6ff9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+11:2388:x1876039498265472:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789131005.909942:0:6487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1789131005.909960:0:6487:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1789131005.909963:0:6487:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1789131005 00002000:00010000:3.0:1789131005.910201:0:6487:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 1789131005 00002000:00010000:3.0:1789131005.910203:0:6487:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 0 -> 1789131005 00002000:00010000:3.0:1789131005.910206:0:6487:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1789131005.910214:0:6487:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ba16950d/0xf3fe2838e1fc29e4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269a9f expref: 11 pid: 8416 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131005.910229:0:6487:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ba16950d/0xf3fe2838e1fc29e4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269a9f expref: 11 pid: 8416 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131005.910256:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba16950d/0xf3fe2838e1fc29e4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269a9f expref: 11 pid: 8416 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131005.910273:0:6487:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789131005.910277:0:6487:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789131005.910283:0:6487:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000786a2989/0xf3fe2838e1fc2a23 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131005.911491:0:6487:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000786a2989/0xf3fe2838e1fc2a23 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131005.911585:0:6487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789131005.911653:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc6ff9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+10:2388:x1876039498265472:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 1726us (1943us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131005.911663:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 80 00010000:00010000:0.0:1789131005.918199:0:8417:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000786a2989/0xf3fe2838e1fc2a23 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131005.918221:0:8417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000786a2989/0xf3fe2838e1fc2a23 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131005.918254:0:8417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000786a2989/0xf3fe2838e1fc2a23 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131005.918337:0:8417:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000786a2989/0xf3fe2838e1fc2a23 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131005.918402:0:8417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000786a2989/0xf3fe2838e1fc2a23 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131005.918410:0:8417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91de01ad7e00 already unused, calling callback (ffffffffc0c4e550) 00010000:00010000:0.0:1789131005.918414:0:8417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000786a2989/0xf3fe2838e1fc2a23 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131005.918423:0:8417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000786a2989/0xf3fe2838e1fc2a23 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131005.918442:0:8417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000786a2989/0xf3fe2838e1fc2a23 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131005.918450:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000786a2989/0xf3fe2838e1fc2a23 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131005.918660:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc6ff83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+9:2386:x1876039498265216:12345-192.168.203.11@tcp:1:lfs.0 Request processed in 33303us (33636us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131005.918687:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 44 00000100:00100000:1.0:1789131005.929318:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131005.929547:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498265728 00000100:00100000:3.0:1789131005.929556:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498265728 00000100:00100000:3.0:1789131005.929607:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 26 00000100:00100000:3.0:1789131005.929616:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dded1d6850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+42:11620:x1876039498265728:12345-192.168.203.11@tcp:35:lfs.0 00000004:00010000:3.0:1789131005.929692:0:6504:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e200/0xf3fe2838e1fc2a15 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269ab4 expref: 42 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789131005.929909:0:6504:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00000001:00080000:3.0:1789131005.929960:0:6504:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:3.0:1789131005.930531:0:6504:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00010000:00010000:3.0:1789131005.930569:0:6504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4c00/0xf3fe2838e1fc2a2a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131005.930584:0:6504:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4200/0xf3fe2838e1fc29cf lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269a91 expref: 46 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131005.930593:0:6504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4c00/0xf3fe2838e1fc2a2a lrc: 4/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131005.930626:0:6504:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4200/0xf3fe2838e1fc29cf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269a91 expref: 46 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131005.930640:0:6504:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4200/0xf3fe2838e1fc29cf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269a91 expref: 46 pid: 6502 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131005.930655:0:6504:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddc2e87840 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6504:1876039508839424:192.168.203.11@tcp:104: 00000100:00100000:3.0:1789131005.930754:0:6504:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddd83640c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789131005.942071:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131005.942201:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498265856 00000100:00100000:2.0:1789131005.942209:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498265856 00010000:00010000:2.0:1789131005.942249:0:8431:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4200/0xf3fe2838e1fc29cf lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269a91 expref: 47 pid: 6502 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131005.942347:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 81 00000100:00100000:2.0:1789131005.942358:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddfd066d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+47:2387:x1876039498265856:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789131005.942371:0:8431:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789131005.942378:0:8431:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4200/0xf3fe2838e1fc29cf lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269a91 expref: 47 pid: 6502 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131005.942390:0:8431:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4200/0xf3fe2838e1fc29cf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269a91 expref: 47 pid: 6502 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131005.942411:0:8431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff91dded3a2d00) 00010000:00010000:2.0:1789131005.942417:0:8431:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4c00/0xf3fe2838e1fc2a2a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131005.942426:0:8431:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4c00/0xf3fe2838e1fc2a2a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131005.942433:0:8431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4c00/0xf3fe2838e1fc2a2a lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131005.942506:0:8431:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789131005.942550:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddfd066d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+47:2387:x1876039498265856:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 194us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131005.942557:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 81 00010000:00010000:3.0:1789131005.944839:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4200/0xf3fe2838e1fc29cf lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269a91 expref: 46 pid: 6502 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131005.944863:0:6504:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddc2e87840 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6504:1876039508839424:192.168.203.11@tcp:104: 00010000:00010000:3.0:1789131005.945054:0:6504:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4c00/0xf3fe2838e1fc2a2a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131005.945078:0:6504:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4c00/0xf3fe2838e1fc2a2a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131005.945083:0:6504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4c00/0xf3fe2838e1fc2a2a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789131005.948090:0:6504:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000001:00080000:3.0:1789131005.948232:0:6504:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000100:00100000:3.0:1789131005.948330:0:6504:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddc2e87840 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6504:1876039508839552:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1789131005.948400:0:6504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131005.948441:0:6504:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddd8364840 going to sleep for 11 seconds 00000100:00100000:1.0:1789131005.948608:0:11069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508839552 00000100:00100000:1.0:1789131005.948615:0:11069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508839552 00000100:00100000:1.0:1789131005.948668:0:11069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1789131005.948676:0:11069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd1dada40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6504:x1876039508839552:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789131005.948802:0:11069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd1dada40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6504:x1876039508839552:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 126us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131005.948809:0:11069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1789131005.948849:0:6504:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddc2e87840 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6504:1876039508839552:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1789131005.948976:0:6504:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00000100:00100000:3.0:1789131005.949017:0:6504:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd1daf480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6504:1876039508839680:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1789131005.949046:0:6504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131005.949071:0:6504:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddd8364c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789131005.949103:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508839680 00000100:00100000:2.0:1789131005.949108:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508839680 00000100:00100000:2.0:1789131005.949147:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1789131005.949154:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd1daf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6504:x1876039508839680:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789131005.949489:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd1daf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:6504:x1876039508839680:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 334us (441us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1789131005.949496:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1789131005.950147:0:6504:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd1daf480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6504:1876039508839680:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1789131005.950197:0:6504:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00010000:00010000:3.0:1789131005.950234:0:6504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4c00/0xf3fe2838e1fc2a2a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131005.950244:0:6504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4c00/0xf3fe2838e1fc2a2a lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131005.950251:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4c00/0xf3fe2838e1fc2a2a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131005.950257:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddfd0b4c00 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:3.0:1789131005.950272:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4c00/0xf3fe2838e1fc2a2a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131005.950280:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4c00/0xf3fe2838e1fc2a2a lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131005.950295:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff91dded3a2d00) 00010000:00010000:3.0:1789131005.950298:0:6504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1789131005.950303:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4c00/0xf3fe2838e1fc2a2a lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131005.950310:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4c00/0xf3fe2838e1fc2a2a lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789131005.950412:0:6504:0:(mdd_object.c:4024:mdd_close()) Object [0x200000402:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1789131005.950508:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:3.0:1789131005.950550:0:6504:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 361868083737ns, next at 362868058118ns, rc = 0 00000001:00080000:3.0:1789131005.950558:0:6504:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967389 00010000:00010000:3.0:1789131005.950584:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff91dded3a2d00) 00010000:00010000:3.0:1789131005.950587:0:6504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789131005.950594:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e200/0xf3fe2838e1fc2a15 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269ab4 expref: 50 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131005.950713:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dded1d6850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+49:11620:x1876039498265728:12345-192.168.203.11@tcp:35:lfs.0 Request processed in 21097us (21402us total) trans 4294967390 rc 0/0 00000100:00100000:3.0:1789131005.950722:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 26 00000020:00080000:3.0:1789131005.950736:0:6504:0:(tgt_main.c:785:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1789131005.960052:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131005.968236:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498265984 00000100:00100000:0.0:1789131005.968310:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498265984 00000100:00100000:0.0:1789131005.969246:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 111 00000100:00100000:0.0:1789131005.969283:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddfd066580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+49:11620:x1876039498265984:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:0.0:1789131005.969307:0:9769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789131005.969328:0:9769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7e00/0xf3fe2838e1fc2a31 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269abb expref: -99 pid: 9769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131005.969381:0:9769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7e00/0xf3fe2838e1fc2a31 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269abb expref: 50 pid: 9769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131005.969396:0:9769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7e00/0xf3fe2838e1fc2a31 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269abb expref: 50 pid: 9769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131005.969413:0:9769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff91ddc4c81500) 00010000:00010000:0.0:1789131005.969416:0:9769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789131005.969420:0:9769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91de01ad7e00, rc 0) 00000100:00100000:0.0:1789131005.969490:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddfd066580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+50:11620:x1876039498265984:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 210us (9505us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131005.969497:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 111 00000100:00100000:1.0:1789131005.978583:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131005.978697:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498266240 00000100:00100000:0.0:1789131005.978707:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498266240 00000100:00100000:0.0:1789131005.978768:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 27 00000100:00100000:0.0:1789131005.978777:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddfd065a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+50:11620:x1876039498266240:12345-192.168.203.11@tcp:35:lfs.0 00000100:00100000:0.0:1789131005.978998:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddfd065a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+51:11620:x1876039498266240:12345-192.168.203.11@tcp:35:lfs.0 Request processed in 220us (424us total) trans 4294967391 rc 0/0 00000100:00100000:0.0:1789131005.979006:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 27 00000100:00100000:1.0:1789131006.089736:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131006.089898:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498266368 00000100:00100000:0.0:1789131006.089908:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498266368 00000100:00100000:0.0:1789131006.089989:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 112 00000100:00100000:0.0:1789131006.090013:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7893840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+51:11630:x1876039498266368:12345-192.168.203.11@tcp:34:lfs.0 00010000:00010000:0.0:1789131006.090089:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6e00/0xf3fe2838e1fc2a38 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131006.090105:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6e00/0xf3fe2838e1fc2a38 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131006.090119:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6e00/0xf3fe2838e1fc2a38 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131006.090131:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc2a3f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131006.090150:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc2a3f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131006.090157:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc2a3f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131006.090226:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6400/0xf3fe2838e1fc2a46 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131006.090235:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6400/0xf3fe2838e1fc2a46 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131006.090241:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6400/0xf3fe2838e1fc2a46 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789131006.090286:0:6501:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6400/0xf3fe2838e1fc2a46 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131006.090298:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6e00/0xf3fe2838e1fc2a38 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131006.090311:0:6501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6e00/0xf3fe2838e1fc2a38 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131006.090318:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6e00/0xf3fe2838e1fc2a38 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131006.090324:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91de01ad6e00 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:0.0:1789131006.090444:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6e00/0xf3fe2838e1fc2a38 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131006.090453:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6e00/0xf3fe2838e1fc2a38 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131006.090598:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff91dded3a2b00) 00010000:00010000:0.0:1789131006.090602:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789131006.090606:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6e00/0xf3fe2838e1fc2a38 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131006.090613:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6e00/0xf3fe2838e1fc2a38 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131006.090626:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc2a3f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131006.090631:0:6501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc2a3f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131006.090636:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc2a3f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131006.090641:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91de01ad7600 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:0.0:1789131006.090651:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc2a3f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131006.090657:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc2a3f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131006.090666:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff91ddc4c81200) 00010000:00010000:0.0:1789131006.090668:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789131006.090670:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc2a3f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131006.090675:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc2a3f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131006.090685:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6400/0xf3fe2838e1fc2a46 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131006.090690:0:6501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6400/0xf3fe2838e1fc2a46 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131006.090696:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6400/0xf3fe2838e1fc2a46 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131006.090701:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91de01ad6400 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:0.0:1789131006.090703:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6400/0xf3fe2838e1fc2a46 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131006.090709:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6400/0xf3fe2838e1fc2a46 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131006.090715:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff91ddc4c81500) 00010000:00010000:0.0:1789131006.090717:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789131006.090727:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6400/0xf3fe2838e1fc2a46 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131006.090732:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6400/0xf3fe2838e1fc2a46 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131006.091312:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7893840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+51:11630:x1876039498266368:12345-192.168.203.11@tcp:34:lfs.0 Request processed in 1296us (1581us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131006.091322:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 112 00000100:00100000:1.0:1789131006.145807:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131006.145893:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498266624 00000100:00100000:3.0:1789131006.145903:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498266624 00000100:00100000:3.0:1789131006.145980:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 113 00000100:00100000:3.0:1789131006.145990:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7890000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+51:11633:x1876039498266624:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:3.0:1789131006.146011:0:6502:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789131006.146031:0:6502:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4c00/0xf3fe2838e1fc2a4d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269ac2 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131006.146101:0:6502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4200/0xf3fe2838e1fc2a54 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131006.146114:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4200/0xf3fe2838e1fc2a54 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131006.146125:0:6502:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4200/0xf3fe2838e1fc2a54 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131006.146136:0:6502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5000/0xf3fe2838e1fc2a5b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131006.146143:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5000/0xf3fe2838e1fc2a5b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131006.146148:0:6502:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5000/0xf3fe2838e1fc2a5b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131006.146257:0:6502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5400/0xf3fe2838e1fc2a62 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131006.146266:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5400/0xf3fe2838e1fc2a62 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131006.146293:0:6502:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5400/0xf3fe2838e1fc2a62 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789131006.146303:0:6502:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:3.0:1789131006.146381:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4200/0xf3fe2838e1fc2a54 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131006.146389:0:6502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4200/0xf3fe2838e1fc2a54 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131006.146395:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4200/0xf3fe2838e1fc2a54 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131006.146400:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddfd0b4200 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:3.0:1789131006.146405:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4200/0xf3fe2838e1fc2a54 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131006.146411:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4200/0xf3fe2838e1fc2a54 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131006.146423:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff91dded3a2b00) 00010000:00010000:3.0:1789131006.146425:0:6502:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789131006.146429:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4200/0xf3fe2838e1fc2a54 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131006.146434:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4200/0xf3fe2838e1fc2a54 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131006.146446:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5000/0xf3fe2838e1fc2a5b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131006.146452:0:6502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5000/0xf3fe2838e1fc2a5b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131006.146520:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5000/0xf3fe2838e1fc2a5b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131006.146525:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddfd0b5000 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:3.0:1789131006.146528:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5000/0xf3fe2838e1fc2a5b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131006.146535:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5000/0xf3fe2838e1fc2a5b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131006.146543:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff91ddc4c81200) 00010000:00010000:3.0:1789131006.146546:0:6502:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789131006.146549:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5000/0xf3fe2838e1fc2a5b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131006.146555:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5000/0xf3fe2838e1fc2a5b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131006.146592:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4c00/0xf3fe2838e1fc2a4d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269ac2 expref: 54 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131006.146606:0:6502:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5400/0xf3fe2838e1fc2a62 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269ac2 expref: 53 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131006.146613:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff91ddc4c81500) 00010000:00010000:3.0:1789131006.146615:0:6502:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789131006.146617:0:6502:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ddfd0b5400, rc 0) 00000100:00100000:3.0:1789131006.146685:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7890000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+53:11633:x1876039498266624:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 696us (887us total) trans 4294967392 rc 0/0 00000100:00100000:3.0:1789131006.146702:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 113 00000100:00100000:1.0:1789131006.153046:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131006.153285:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498266752 00000100:00100000:3.0:1789131006.153295:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498266752 00000100:00100000:3.0:1789131006.153500:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 114 00000100:00100000:3.0:1789131006.153512:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc78930c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+53:11633:x1876039498266752:12345-192.168.203.11@tcp:54:lfs.0 00010000:00010000:3.0:1789131006.153587:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4200/0xf3fe2838e1fc2a70 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131006.153604:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4200/0xf3fe2838e1fc2a70 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131006.153615:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4200/0xf3fe2838e1fc2a70 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131006.153650:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4200/0xf3fe2838e1fc2a70 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131006.153657:0:6500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4200/0xf3fe2838e1fc2a70 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131006.153663:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4200/0xf3fe2838e1fc2a70 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131006.153669:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddfd0b4200 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:3.0:1789131006.153673:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4200/0xf3fe2838e1fc2a70 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131006.153680:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4200/0xf3fe2838e1fc2a70 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131006.153691:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff91ddc4c81500) 00010000:00010000:3.0:1789131006.153705:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789131006.153710:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4200/0xf3fe2838e1fc2a70 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131006.153716:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4200/0xf3fe2838e1fc2a70 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131006.153796:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc78930c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+53:11633:x1876039498266752:12345-192.168.203.11@tcp:54:lfs.0 Request processed in 285us (759us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131006.153804:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 114 00000100:00100000:1.0:1789131006.156997:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131006.157250:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498267008 00000100:00100000:0.0:1789131006.157260:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498267008 00000100:00100000:0.0:1789131006.157372:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 28 00000100:00100000:0.0:1789131006.157383:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7890b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+53:11633:x1876039498267008:12345-192.168.203.11@tcp:35:lfs.0 00000100:00100000:0.0:1789131006.157653:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7890b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+54:11633:x1876039498267008:12345-192.168.203.11@tcp:35:lfs.0 Request processed in 271us (664us total) trans 4294967393 rc 0/0 00000100:00100000:0.0:1789131006.157660:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 28 00000100:00100000:1.0:1789131006.290287:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131006.290392:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498267264 00000100:00100000:2.0:1789131006.290414:0:14273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498267264 00000100:00100000:2.0:1789131006.290790:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 115 00000100:00100000:2.0:1789131006.290801:0:14273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7c92940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+54:11643:x1876039498267264:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:2.0:1789131006.290823:0:14273:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789131006.290827:0:14273:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789131006.290852:0:14273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6800/0xf3fe2838e1fc29f2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269aa6 expref: 54 pid: 9769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131006.290871:0:14273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff91dded3a2b00) 00010000:00010000:2.0:1789131006.290876:0:14273:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789131006.290889:0:14273:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f600/0xf3fe2838e1fc2a77 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269ac9 expref: -99 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131006.291027:0:14273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e800/0xf3fe2838e1fc2a7e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131006.291047:0:14273:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e800/0xf3fe2838e1fc2a7e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131006.291057:0:14273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e800/0xf3fe2838e1fc2a7e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789131006.291070:0:14273:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1789131006.291238:0:14273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f600/0xf3fe2838e1fc2a77 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269ac9 expref: 56 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131006.291253:0:14273:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e800/0xf3fe2838e1fc2a7e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269ac9 expref: 55 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131006.291261:0:14273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff91ddc4c81500) 00010000:00010000:2.0:1789131006.291263:0:14273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789131006.291266:0:14273:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dcc7f7e800, rc 0) 00000100:00100000:2.0:1789131006.291327:0:14273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7c92940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+55:11643:x1876039498267264:12345-192.168.203.11@tcp:101:bash.0 Request processed in 528us (1047us total) trans 4294967394 rc 0/0 00000100:00100000:2.0:1789131006.291335:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 115 00000100:00100000:1.0:1789131006.298500:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789131006.298540:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131006.298620:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498267392 00000100:00100000:3.0:1789131006.298630:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498267392 00000100:00100000:3.0:1789131006.298692:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 116 00000100:00100000:3.0:1789131006.298702:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7c91a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+55:11643:x1876039498267392:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:3.0:1789131006.298727:0:6502:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789131006.298746:0:6502:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4200/0xf3fe2838e1fc2a8c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269ad0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131006.298782:0:6502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4c00/0xf3fe2838e1fc2a93 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131006.298797:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4c00/0xf3fe2838e1fc2a93 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131006.298807:0:6502:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4c00/0xf3fe2838e1fc2a93 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131006.298940:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4200/0xf3fe2838e1fc2a8c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269ad0 expref: 57 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131006.298973:0:6502:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4c00/0xf3fe2838e1fc2a93 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269ad0 expref: 56 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131006.298982:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff91ddc4c81500) 00010000:00010000:3.0:1789131006.298985:0:6502:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789131006.298988:0:6502:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ddfd0b4c00, rc 0) 00000100:00100000:3.0:1789131006.299055:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7c91a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+56:11643:x1876039498267392:12345-192.168.203.11@tcp:101:bash.0 Request processed in 354us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131006.299063:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 116 00000100:00100000:2.0:1789131006.299231:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498267520 00000100:00100000:2.0:1789131006.299236:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498267520 00000100:00100000:2.0:1789131006.299274:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 8 00000100:00100000:2.0:1789131006.299281:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc33ad850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+56:2387:x1876039498267520:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789131006.299292:0:6485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789131006.299305:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e800/0xf3fe2838e1fc2a7e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269ac9 expref: 56 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131006.299419:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff91ddc4c81500) 00010000:00010000:2.0:1789131006.299423:0:6485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789131006.299453:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc33ad850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+55:2387:x1876039498267520:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 172us (912us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131006.299496:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 8 00000100:00100000:1.0:1789131006.303305:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131006.303551:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498267776 00000100:00100000:0.0:1789131006.303562:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498267776 00000100:00100000:0.0:1789131006.303620:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 117 00000100:00100000:0.0:1789131006.303630:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff8e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+55:11643:x1876039498267776:12345-192.168.203.11@tcp:36:bash.0 00010000:00010000:0.0:1789131006.303678:0:9769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789131006.303704:0:9769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5400/0xf3fe2838e1fc2a62 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269ac2 expref: 55 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131006.303721:0:9769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff91ddc4c81500) 00010000:00010000:0.0:1789131006.303726:0:9769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789131006.303878:0:9769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc2a9a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131006.303892:0:9769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc2a9a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131006.303902:0:9769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc2a9a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789131006.303968:0:9769:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967395 00000004:00010000:0.0:1789131006.303993:0:9769:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000003bcccc0 reply state 0000000021e0b8c0 transno 4294967396 ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc2a9a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131006.304005:0:9769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc2a9a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131006.304012:0:9769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff91ddc4c81500) 00010000:00010000:0.0:1789131006.304015:0:9769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789131006.304017:0:9769:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789131006.304232:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff8e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+57:11643:x1876039498267776:12345-192.168.203.11@tcp:36:bash.0 Request processed in 603us (935us total) trans 4294967396 rc 0/0 00000100:00100000:0.0:1789131006.304240:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 117 00000020:00080000:0.0:1789131006.304246:0:9769:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789131006.308928:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131006.309005:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498267904 00000100:00100000:2.0:1789131006.309014:0:14273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498267904 00000100:00100000:2.0:1789131006.309070:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 118 00000100:00100000:2.0:1789131006.309080:0:14273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff8e30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+57:11643:x1876039498267904:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:2.0:1789131006.309106:0:14273:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789131006.309135:0:14273:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e800/0xf3fe2838e1fc2aa1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269ad7 expref: -99 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131006.309222:0:14273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f600/0xf3fe2838e1fc2aa8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131006.309236:0:14273:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f600/0xf3fe2838e1fc2aa8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131006.309246:0:14273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f600/0xf3fe2838e1fc2aa8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789131006.309272:0:14273:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1789131006.309276:0:14273:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789131006.309292:0:14273:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f600/0xf3fe2838e1fc2aa8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131006.309315:0:14273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e800/0xf3fe2838e1fc2aa1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269ad7 expref: 59 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131006.309355:0:14273:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f600/0xf3fe2838e1fc2aa8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269ad7 expref: 58 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131006.309364:0:14273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff91ddc4c81500) 00010000:00010000:2.0:1789131006.309367:0:14273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789131006.309370:0:14273:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dcc7f7f600, rc 0) 00000100:00100000:2.0:1789131006.309424:0:14273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff8e30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+58:11643:x1876039498267904:12345-192.168.203.11@tcp:101:bash.0 Request processed in 346us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131006.309431:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 118 00000100:00100000:1.0:1789131006.317903:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131006.318004:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498268160 00000100:00100000:2.0:1789131006.318015:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498268160 00000100:00100000:2.0:1789131006.318075:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 29 00000100:00100000:2.0:1789131006.318086:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff8e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+58:11643:x1876039498268160:12345-192.168.203.11@tcp:35:bash.0 00000100:00100000:2.0:1789131006.318499:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff8e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+59:11643:x1876039498268160:12345-192.168.203.11@tcp:35:bash.0 Request processed in 414us (605us total) trans 4294967397 rc 0/0 00000100:00100000:2.0:1789131006.318509:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 29 00000100:00100000:1.0:1789131006.403544:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131006.403621:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498268288 00000100:00100000:3.0:1789131006.403631:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498268288 00000100:00100000:3.0:1789131006.403682:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 119 00000100:00100000:3.0:1789131006.403692:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff8e1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+59:11649:x1876039498268288:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:3.0:1789131006.403716:0:6502:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789131006.403735:0:6502:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4200/0xf3fe2838e1fc2aaf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269ade expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131006.403792:0:6502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5000/0xf3fe2838e1fc2ab6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131006.403805:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5000/0xf3fe2838e1fc2ab6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131006.403815:0:6502:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5000/0xf3fe2838e1fc2ab6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789131006.403856:0:6502:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1789131006.403871:0:6502:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789131006.403890:0:6502:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5000/0xf3fe2838e1fc2ab6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131006.403925:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4200/0xf3fe2838e1fc2aaf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269ade expref: 61 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131006.403943:0:6502:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5000/0xf3fe2838e1fc2ab6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269ade expref: 60 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131006.403950:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff91dded3a2b00) 00010000:00010000:3.0:1789131006.403953:0:6502:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789131006.403957:0:6502:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ddfd0b5000, rc 0) 00000100:00100000:3.0:1789131006.404013:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff8e1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+60:11649:x1876039498268288:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 323us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131006.404021:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 119 00000100:00100000:1.0:1789131006.412127:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131006.412424:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498268416 00000100:00100000:3.0:1789131006.412434:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498268416 00000100:00100000:3.0:1789131006.412579:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 120 00000100:00100000:3.0:1789131006.412591:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddca22ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+60:11649:x1876039498268416:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:3.0:1789131006.412613:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789131006.412633:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4200/0xf3fe2838e1fc2abd lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269ae5 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131006.412693:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5c00/0xf3fe2838e1fc2ac4 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131006.412708:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5c00/0xf3fe2838e1fc2ac4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131006.412738:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5c00/0xf3fe2838e1fc2ac4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131006.412751:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5200/0xf3fe2838e1fc2acb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131006.412758:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5200/0xf3fe2838e1fc2acb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131006.412765:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5200/0xf3fe2838e1fc2acb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131006.412834:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4400/0xf3fe2838e1fc2ad2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131006.412845:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4400/0xf3fe2838e1fc2ad2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131006.412851:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4400/0xf3fe2838e1fc2ad2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789131006.412889:0:6500:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:3.0:1789131006.412894:0:6500:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789131006.412922:0:6500:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4400/0xf3fe2838e1fc2ad2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131006.412933:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4400/0xf3fe2838e1fc2ad2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131006.412941:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5c00/0xf3fe2838e1fc2ac4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131006.412957:0:6500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5c00/0xf3fe2838e1fc2ac4 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131006.412963:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5c00/0xf3fe2838e1fc2ac4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131006.412968:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddfd0b5c00 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:3.0:1789131006.412972:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5c00/0xf3fe2838e1fc2ac4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131006.412980:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5c00/0xf3fe2838e1fc2ac4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131006.412992:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff91dded3a2b00) 00010000:00010000:3.0:1789131006.412995:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789131006.412999:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5c00/0xf3fe2838e1fc2ac4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131006.413005:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5c00/0xf3fe2838e1fc2ac4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131006.413018:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5200/0xf3fe2838e1fc2acb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131006.413024:0:6500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5200/0xf3fe2838e1fc2acb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131006.413030:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5200/0xf3fe2838e1fc2acb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131006.413035:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddfd0b5200 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:3.0:1789131006.413043:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5200/0xf3fe2838e1fc2acb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131006.413050:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5200/0xf3fe2838e1fc2acb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131006.413058:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff91ddc4c81200) 00010000:00010000:3.0:1789131006.413061:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789131006.413064:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5200/0xf3fe2838e1fc2acb lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131006.413070:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5200/0xf3fe2838e1fc2acb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131006.413095:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4200/0xf3fe2838e1fc2abd lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269ae5 expref: 62 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131006.413107:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4400/0xf3fe2838e1fc2ad2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269ae5 expref: 61 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131006.413114:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff91ddc4c81500) 00010000:00010000:3.0:1789131006.413115:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789131006.413118:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ddfd0b4400, rc 0) 00000100:00100000:3.0:1789131006.413229:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddca22ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+61:11649:x1876039498268416:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 641us (1113us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131006.413236:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 120 00000100:00100000:0.0:1789131006.419600:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131006.419645:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131006.419860:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498268800 00000100:00100000:3.0:1789131006.419870:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498268800 00000100:00100000:3.0:1789131006.419947:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 9 00000100:00100000:3.0:1789131006.419957:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7ad2d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+61:2386:x1876039498268800:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789131006.419985:0:6486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789131006.420009:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4400/0xf3fe2838e1fc2ad2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269ae5 expref: 61 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131006.420026:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff91ddc4c81500) 00010000:00010000:3.0:1789131006.420030:0:6486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789131006.420087:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7ad2d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+60:2386:x1876039498268800:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 131us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131006.420094:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 9 00000100:00100000:2.0:1789131006.420490:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498268672 00000100:00100000:2.0:1789131006.420496:0:14273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498268672 00000100:00100000:2.0:1789131006.420529:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 121 00000100:00100000:2.0:1789131006.420536:0:14273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7ad30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+60:11649:x1876039498268672:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:2.0:1789131006.420551:0:14273:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789131006.420566:0:14273:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e800/0xf3fe2838e1fc2ad9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269aec expref: -99 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131006.420660:0:14273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e000/0xf3fe2838e1fc2ae0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131006.420681:0:14273:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f600/0xf3fe2838e1fc2aa8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269ad7 expref: 61 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131006.420689:0:14273:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e000/0xf3fe2838e1fc2ae0 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131006.420721:0:14273:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f600/0xf3fe2838e1fc2aa8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269ad7 expref: 61 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131006.420734:0:14273:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f600/0xf3fe2838e1fc2aa8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269ad7 expref: 61 pid: 14273 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131006.420747:0:14273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc6ffb840 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14273:1876039508839808:192.168.203.11@tcp:104: 00000100:00100000:2.0:1789131006.420865:0:14273:0:(client.c:2715:ptlrpc_set_wait()) set ffff91dcc6aad6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789131006.425752:0:14273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc6ffb840 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14273:1876039508839808:192.168.203.11@tcp:104: 00010000:00010000:2.0:1789131006.425780:0:14273:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e000/0xf3fe2838e1fc2ae0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131006.427862:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131006.428863:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498268928 00000100:00100000:3.0:1789131006.428874:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498268928 00010000:00010000:3.0:1789131006.428926:0:6487:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f600/0xf3fe2838e1fc2aa8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269ad7 expref: 62 pid: 14273 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131006.429078:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 82 00000100:00100000:2.0:1789131006.429092:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc5fe8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+62:2388:x1876039498268928:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789131006.429108:0:6485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789131006.429115:0:6485:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f600/0xf3fe2838e1fc2aa8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269ad7 expref: 62 pid: 14273 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131006.429222:0:6485:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f600/0xf3fe2838e1fc2aa8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269ad7 expref: 62 pid: 14273 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131006.429265:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f600/0xf3fe2838e1fc2aa8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269ad7 expref: 62 pid: 14273 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131006.429282:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff91ddc4c81500) 00010000:00010000:2.0:1789131006.429288:0:6485:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e000/0xf3fe2838e1fc2ae0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131006.429297:0:6485:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e000/0xf3fe2838e1fc2ae0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131006.429304:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e000/0xf3fe2838e1fc2ae0 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131006.429340:0:6485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789131006.429440:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc5fe8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+61:2388:x1876039498268928:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 350us (1586us total) trans 0 rc 0/0 00010000:00010000:1.0:1789131006.429446:0:14273:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e000/0xf3fe2838e1fc2ae0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131006.429448:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 82 00010000:00010000:1.0:1789131006.429454:0:14273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e000/0xf3fe2838e1fc2ae0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789131006.429504:0:14273:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:1.0:1789131006.429630:0:14273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e800/0xf3fe2838e1fc2ad9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269aec expref: 62 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131006.429645:0:14273:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e000/0xf3fe2838e1fc2ae0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269aec expref: 61 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131006.429659:0:14273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff91ddc4c81500) 00010000:00010000:1.0:1789131006.429662:0:14273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789131006.429664:0:14273:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dcc7f7e000, rc 0) 00000100:00100000:1.0:1789131006.429701:0:14273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7ad30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+61:11649:x1876039498268672:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 9166us (10056us total) trans 4294967398 rc 0/0 00000100:00100000:1.0:1789131006.429709:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 121 00000100:00100000:0.0:1789131006.434840:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131006.434938:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498269184 00000100:00100000:3.0:1789131006.434948:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498269184 00000100:00100000:3.0:1789131006.435026:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 10 00000100:00100000:3.0:1789131006.435037:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc845d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+61:11649:x1876039498269184:12345-192.168.203.11@tcp:103:lfs.0 00010000:00010000:3.0:1789131006.435050:0:6486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789131006.435073:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7e00/0xf3fe2838e1fc2a31 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269abb expref: 61 pid: 9769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131006.435090:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff91ddc4c81500) 00010000:00010000:3.0:1789131006.435095:0:6486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789131006.435157:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc845d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+60:11649:x1876039498269184:12345-192.168.203.11@tcp:103:lfs.0 Request processed in 122us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131006.435164:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 10 00000100:00100000:2.0:1789131006.440052:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131006.440189:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498269312 00000100:00100000:3.0:1789131006.440198:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498269312 00000100:00100000:3.0:1789131006.440253:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 122 00000100:00100000:3.0:1789131006.440264:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc6ffb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+60:11649:x1876039498269312:12345-192.168.203.11@tcp:58:lfs.0 00010000:00010000:3.0:1789131006.440388:0:6502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4400/0xf3fe2838e1fc2aee lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131006.440404:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4400/0xf3fe2838e1fc2aee lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131006.440416:0:6502:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4400/0xf3fe2838e1fc2aee lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789131006.440546:0:6502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:2.0:1789131006.440944:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc6ffb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+60:11649:x1876039498269312:12345-192.168.203.11@tcp:58:lfs.0 Request processed in 680us (898us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131006.440953:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 122 00000100:00100000:0.0:1789131006.444926:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131006.445227:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498269440 00000100:00100000:3.0:1789131006.445237:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498269440 00000100:00100000:3.0:1789131006.445298:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 123 00000100:00100000:3.0:1789131006.445308:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc845da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+60:11649:x1876039498269440:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:3.0:1789131006.445329:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789131006.445349:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4200/0xf3fe2838e1fc2af5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269af3 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131006.445399:0:6500:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4400/0xf3fe2838e1fc2aee lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131006.445410:0:6500:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4200/0xf3fe2838e1fc2af5 lrc: 4/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269af3 expref: 61 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131006.445431:0:6500:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4400/0xf3fe2838e1fc2aee lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131006.445495:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4200/0xf3fe2838e1fc2af5 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269af3 expref: 61 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131006.445509:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff91ddc4c81500) 00010000:00010000:3.0:1789131006.445513:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789131006.445517:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4200/0xf3fe2838e1fc2af5 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269af3 expref: 61 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131006.445526:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ddfd0b4200, rc 0) 00000100:00100000:2.0:1789131006.445793:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc845da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+61:11649:x1876039498269440:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 477us (879us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131006.445801:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 123 00000100:00100000:2.0:1789131006.545716:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789131006.545739:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd1dac3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1876039508839936:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789131006.545817:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131006.546065:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508839936 00000100:00100000:3.0:1789131006.546073:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508839936 00000100:00100000:3.0:1789131006.546139:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1789131006.546150:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc6ff92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3628:x1876039508839936:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789131006.546186:0:6505:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:3.0:1789131006.546242:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc6ff92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3628:x1876039508839936:12345-0@lo:41:osp-pre-0-1.0 Request processed in 94us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131006.546250:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1789131006.546430:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd1dac3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1876039508839936:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789131006.546578:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789131006.546589:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddca0c4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1876039508840064:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789131006.546624:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131006.546818:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508840064 00000100:00100000:3.0:1789131006.546823:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508840064 00000100:00100000:3.0:1789131006.546859:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1789131006.546866:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddca228000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3627:x1876039508840064:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789131006.546888:0:6506:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789131006.546942:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddca228000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3627:x1876039508840064:12345-0@lo:41:osp-pre-1-0.0 Request processed in 76us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131006.546949:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1789131006.547073:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddca0c4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1876039508840064:0@lo:41:osp-pre-1-0.0 00000040:00080000:3.0:1789131006.738154:0:14475:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789131006.738169:0:14475:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789131006.738204:0:14475:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:3.0:1789131006.738213:0:14475:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789131006.738348:0:14475:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd1dade00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14475:1876039508840192:192.168.203.11@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789131006.738491:0:14475:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddd8364a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789131006.749002:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131006.749166:0:14475:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd1dade00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14475:1876039508840192:192.168.203.11@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789131006.749514:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498269568 00000100:00100000:2.0:1789131006.749521:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498269568 00000100:00100000:2.0:1789131006.749580:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 124 00000100:00100000:2.0:1789131006.749591:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddca0c6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+61:11650:x1876039498269568:12345-192.168.203.11@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789131006.749639:0:6501:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789131006.749742:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddca0c6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+61:11650:x1876039498269568:12345-192.168.203.11@tcp:53:lhsmtool_posix.0 Request processed in 152us (747us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131006.749750:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 124 00000100:00100000:0.0:1789131006.762301:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789131006.762402:0:14851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498269696 00000100:00100000:1.0:1789131006.762421:0:14851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498269696 00000100:00100000:1.0:1789131006.763262:0:14851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 125 00000100:00100000:1.0:1789131006.763278:0:14851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddca0c4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+61:11650:x1876039498269696:12345-192.168.203.11@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1789131006.763351:0:14851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca600/0xf3fe2838e1fc2afc lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131006.763369:0:14851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca600/0xf3fe2838e1fc2afc lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131006.763381:0:14851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca600/0xf3fe2838e1fc2afc lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131006.763443:0:14851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cbe00/0xf3fe2838e1fc2b03 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131006.763453:0:14851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cbe00/0xf3fe2838e1fc2b03 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131006.763709:0:14851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cbe00/0xf3fe2838e1fc2b03 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131006.763736:0:14851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca200/0xf3fe2838e1fc2b0a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131006.763745:0:14851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca200/0xf3fe2838e1fc2b0a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131006.763753:0:14851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca200/0xf3fe2838e1fc2b0a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789131006.764212:0:14851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:1.0:1789131006.764219:0:14851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789131006.764235:0:14851:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca200/0xf3fe2838e1fc2b0a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131006.764247:0:14851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca600/0xf3fe2838e1fc2afc lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131006.764254:0:14851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca600/0xf3fe2838e1fc2afc lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131006.764260:0:14851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca600/0xf3fe2838e1fc2afc lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131006.764267:0:14851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc85ca600 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:1.0:1789131006.764271:0:14851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca600/0xf3fe2838e1fc2afc lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131006.764279:0:14851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca600/0xf3fe2838e1fc2afc lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131006.764301:0:14851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff91ddcf5ffa00) 00010000:00010000:1.0:1789131006.764304:0:14851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789131006.764309:0:14851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca600/0xf3fe2838e1fc2afc lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131006.764314:0:14851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca600/0xf3fe2838e1fc2afc lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131006.764329:0:14851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cbe00/0xf3fe2838e1fc2b03 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131006.764336:0:14851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cbe00/0xf3fe2838e1fc2b03 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131006.764341:0:14851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cbe00/0xf3fe2838e1fc2b03 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131006.764345:0:14851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc85cbe00 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:1.0:1789131006.764348:0:14851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cbe00/0xf3fe2838e1fc2b03 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131006.764353:0:14851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cbe00/0xf3fe2838e1fc2b03 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131006.764360:0:14851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x444bc3cd (ffff91dcc7d6b700) 00010000:00010000:1.0:1789131006.764362:0:14851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789131006.764365:0:14851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cbe00/0xf3fe2838e1fc2b03 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131006.764370:0:14851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cbe00/0xf3fe2838e1fc2b03 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131006.764395:0:14851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca200/0xf3fe2838e1fc2b0a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131006.764401:0:14851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca200/0xf3fe2838e1fc2b0a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131006.764420:0:14851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca200/0xf3fe2838e1fc2b0a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131006.764425:0:14851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc85ca200 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:1.0:1789131006.764428:0:14851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca200/0xf3fe2838e1fc2b0a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131006.764435:0:14851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca200/0xf3fe2838e1fc2b0a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131006.764443:0:14851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff91ddc4c81500) 00010000:00010000:1.0:1789131006.764446:0:14851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789131006.764448:0:14851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca200/0xf3fe2838e1fc2b0a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131006.764454:0:14851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca200/0xf3fe2838e1fc2b0a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131006.766084:0:14851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddca0c4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+61:11650:x1876039498269696:12345-192.168.203.11@tcp:34:lhsmtool_posix.0 Request processed in 2804us (3787us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131006.766095:0:14851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 125 00000100:00100000:0.0:1789131006.772803:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789131006.772897:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498269952 00000100:00100000:1.0:1789131006.772914:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498269952 00000100:00100000:1.0:1789131006.772970:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 126 00000100:00100000:1.0:1789131006.772993:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddffa82580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+61:11650:x1876039498269952:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789131006.773014:0:9769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789131006.773032:0:9769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca200/0xf3fe2838e1fc2b11 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269afa expref: -99 pid: 9769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131006.773141:0:9769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cbe00/0xf3fe2838e1fc2b18 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131006.773158:0:9769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cbe00/0xf3fe2838e1fc2b18 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131006.773169:0:9769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cbe00/0xf3fe2838e1fc2b18 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789131006.773181:0:9769:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:1.0:1789131006.773266:0:9769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cbe00/0xf3fe2838e1fc2b18 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131006.773274:0:9769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cbe00/0xf3fe2838e1fc2b18 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131006.773281:0:9769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cbe00/0xf3fe2838e1fc2b18 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131006.773287:0:9769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc85cbe00 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:1.0:1789131006.773292:0:9769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cbe00/0xf3fe2838e1fc2b18 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131006.773300:0:9769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cbe00/0xf3fe2838e1fc2b18 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131006.773312:0:9769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff91ddc4c81500) 00010000:00010000:1.0:1789131006.773322:0:9769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789131006.773328:0:9769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cbe00/0xf3fe2838e1fc2b18 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131006.773335:0:9769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cbe00/0xf3fe2838e1fc2b18 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131006.773377:0:9769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca200/0xf3fe2838e1fc2b11 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269afa expref: 63 pid: 9769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131006.773387:0:9769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff91ddcf5ffa00) 00010000:00010000:1.0:1789131006.773389:0:9769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789131006.773393:0:9769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca200/0xf3fe2838e1fc2b11 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269afa expref: 63 pid: 9769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131006.773403:0:9769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dcc85ca200, rc 0) 00000100:00100000:1.0:1789131006.773506:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddffa82580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+62:11650:x1876039498269952:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 514us (711us total) trans 4294967399 rc 301/301 00000100:00100000:1.0:1789131006.773515:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 126 00000100:00100000:0.0:1789131006.779389:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131006.779495:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498270080 00000100:00100000:2.0:1789131006.779516:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498270080 00000100:00100000:2.0:1789131006.779585:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 127 00000100:00100000:2.0:1789131006.779596:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff8a43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+62:11650:x1876039498270080:12345-192.168.203.11@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789131006.779629:0:6501:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789131006.779739:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff8a43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+62:11650:x1876039498270080:12345-192.168.203.11@tcp:53:lhsmtool_posix.0 Request processed in 144us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131006.779748:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 127 00000100:00100000:0.0:1789131006.785951:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131006.786219:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498270336 00000100:00100000:2.0:1789131006.786229:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498270336 00000100:00100000:2.0:1789131006.786287:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 128 00000100:00100000:2.0:1789131006.786297:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01a5de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+62:11650:x1876039498270336:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789131006.786316:0:6502:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789131006.786319:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789131006.786347:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5000/0xf3fe2838e1fc2ab6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269ade expref: 62 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131006.786384:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff91dded3a2b00) 00010000:00010000:2.0:1789131006.786390:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789131006.786415:0:6502:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f600/0xf3fe2838e1fc2b26 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269b01 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789131006.787025:0:6502:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x4:0x0], index 1: 0 00010000:00010000:2.0:1789131006.787170:0:6502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fc00/0xf3fe2838e1fc2b2d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131006.787184:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fc00/0xf3fe2838e1fc2b2d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131006.787194:0:6502:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fc00/0xf3fe2838e1fc2b2d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131006.787244:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f600/0xf3fe2838e1fc2b26 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269b01 expref: 64 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131006.787260:0:6502:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fc00/0xf3fe2838e1fc2b2d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269b01 expref: 63 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131006.787268:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff91dde1922f00) 00010000:00010000:2.0:1789131006.787271:0:6502:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789131006.787274:0:6502:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dcc7f7fc00, rc 0) 00000100:00100000:2.0:1789131006.787342:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01a5de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+63:11650:x1876039498270336:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 1046us (1401us total) trans 4294967400 rc 0/0 00000100:00100000:2.0:1789131006.787350:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 128 00000100:00100000:0.0:1789131006.793620:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789131006.793707:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498270592 00000100:00100000:1.0:1789131006.793718:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498270592 00000100:00100000:1.0:1789131006.793776:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 129 00000100:00100000:1.0:1789131006.793787:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff7c1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+63:11650:x1876039498270592:12345-192.168.203.11@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789131006.793840:0:9769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789131006.793866:0:9769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fc00/0xf3fe2838e1fc2b2d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269b01 expref: 63 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131006.793883:0:9769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff91dde1922f00) 00010000:00010000:1.0:1789131006.793927:0:9769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789131006.793948:0:9769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca200/0xf3fe2838e1fc2b3b lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131006.793962:0:9769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca200/0xf3fe2838e1fc2b3b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131006.793971:0:9769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca200/0xf3fe2838e1fc2b3b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131006.794022:0:9769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cbe00/0xf3fe2838e1fc2b42 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x3256d9a6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131006.794030:0:9769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cbe00/0xf3fe2838e1fc2b42 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x3256d9a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131006.794037:0:9769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cbe00/0xf3fe2838e1fc2b42 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x3256d9a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131006.794077:0:9769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca200/0xf3fe2838e1fc2b3b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131006.794084:0:9769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca200/0xf3fe2838e1fc2b3b lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131006.794091:0:9769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca200/0xf3fe2838e1fc2b3b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131006.794098:0:9769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc85ca200 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:1.0:1789131006.794103:0:9769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca200/0xf3fe2838e1fc2b3b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131006.794110:0:9769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca200/0xf3fe2838e1fc2b3b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131006.794127:0:9769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff91dded3a2b00) 00010000:00010000:1.0:1789131006.794130:0:9769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789131006.794134:0:9769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca200/0xf3fe2838e1fc2b3b lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131006.794141:0:9769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca200/0xf3fe2838e1fc2b3b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131006.794152:0:9769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cbe00/0xf3fe2838e1fc2b42 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x3256d9a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131006.794159:0:9769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cbe00/0xf3fe2838e1fc2b42 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x3256d9a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131006.794164:0:9769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cbe00/0xf3fe2838e1fc2b42 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x3256d9a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131006.794170:0:9769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc85cbe00 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:1.0:1789131006.794173:0:9769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cbe00/0xf3fe2838e1fc2b42 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x3256d9a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131006.794179:0:9769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cbe00/0xf3fe2838e1fc2b42 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x3256d9a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131006.794186:0:9769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x3256d9a6 (ffff91dcc7d6b700) 00010000:00010000:1.0:1789131006.794189:0:9769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789131006.794192:0:9769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cbe00/0xf3fe2838e1fc2b42 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x3256d9a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131006.794197:0:9769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cbe00/0xf3fe2838e1fc2b42 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x3256d9a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131006.794287:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff7c1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+62:11650:x1876039498270592:12345-192.168.203.11@tcp:36:lhsmtool_posix.0 Request processed in 501us (676us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789131006.794295:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 129 00000100:00100000:0.0:1789131006.798724:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131006.798941:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498270720 00000100:00100000:2.0:1789131006.798950:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498270720 00000100:00100000:2.0:1789131006.799006:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 130 00000100:00100000:2.0:1789131006.799015:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff7c2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+62:11650:x1876039498270720:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789131006.799034:0:6501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789131006.799057:0:6501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f600/0xf3fe2838e1fc2b49 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269b08 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131006.799091:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fa00/0xf3fe2838e1fc2b50 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131006.799103:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fa00/0xf3fe2838e1fc2b50 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131006.799113:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fa00/0xf3fe2838e1fc2b50 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131006.799223:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f600/0xf3fe2838e1fc2b49 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269b08 expref: 64 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131006.799240:0:6501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fa00/0xf3fe2838e1fc2b50 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269b08 expref: 63 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131006.799248:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff91dde1922b00) 00010000:00010000:2.0:1789131006.799251:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789131006.799254:0:6501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dcc7f7fa00, rc 0) 00000100:00100000:2.0:1789131006.799316:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff7c2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+63:11650:x1876039498270720:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 301us (601us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131006.799323:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 130 00000100:00100000:0.0:1789131006.803963:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789131006.804111:0:14851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498270976 00000100:00100000:1.0:1789131006.804131:0:14851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498270976 00000100:00100000:1.0:1789131006.804186:0:14851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 131 00000100:00100000:1.0:1789131006.804196:0:14851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff7c0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+63:11650:x1876039498270976:12345-192.168.203.11@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789131006.804276:0:14851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cbe00/0xf3fe2838e1fc2b57 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131006.804292:0:14851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cbe00/0xf3fe2838e1fc2b57 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131006.804303:0:14851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cbe00/0xf3fe2838e1fc2b57 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789131006.804497:0:14851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00080000:1.0:1789131006.804507:0:14851:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 362722048251ns, next at 363722045724ns, rc = 0 00000004:00010000:1.0:1789131006.804555:0:14851:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000eddaaa15 reply state 00000000754f107e transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cbe00/0xf3fe2838e1fc2b57 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131006.804568:0:14851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cbe00/0xf3fe2838e1fc2b57 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131006.804576:0:14851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff91dde1922b00) 00010000:00010000:1.0:1789131006.804579:0:14851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1789131006.804583:0:14851:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789131006.804671:0:14851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff7c0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+65:11650:x1876039498270976:12345-192.168.203.11@tcp:36:lhsmtool_posix.0 Request processed in 474us (716us total) trans 4294967401 rc 0/0 00000100:00100000:1.0:1789131006.804693:0:14851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 131 00000100:00100000:0.0:1789131006.812928:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789131006.813113:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498271104 00000100:00100000:1.0:1789131006.813123:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498271104 00000100:00100000:1.0:1789131006.813185:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 132 00000100:00100000:1.0:1789131006.813195:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8497c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+65:11650:x1876039498271104:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789131006.813218:0:9769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789131006.813239:0:9769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca200/0xf3fe2838e1fc2b5e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269b0f expref: -99 pid: 9769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131006.813295:0:9769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca200/0xf3fe2838e1fc2b5e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269b0f expref: 66 pid: 9769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131006.813308:0:9769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca200/0xf3fe2838e1fc2b5e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269b0f expref: 66 pid: 9769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131006.813327:0:9769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff91dde1922b00) 00010000:00010000:1.0:1789131006.813330:0:9769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789131006.813333:0:9769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dcc85ca200, rc 0) 00000100:00100000:1.0:1789131006.813391:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8497c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+66:11650:x1876039498271104:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 196us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131006.813398:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 132 00000100:00100000:0.0:1789131006.820692:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131006.820808:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498271232 00000100:00100000:2.0:1789131006.820817:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498271232 00000100:00100000:2.0:1789131006.820884:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 45 00000100:00080000:3.0:1789131006.820895:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789131006.820902:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8497840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+8:2385:x1876039498271232:12345-192.168.203.11@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1789131006.821096:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8497840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+9:2385:x1876039498271232:12345-192.168.203.11@tcp:2:lhsmtool_posix.0 Request processed in 196us (412us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1789131006.821104:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 45 00000100:00100000:0.0:1789131006.824142:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131006.824241:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498271488 00000100:00100000:2.0:1789131006.824250:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498271488 00000100:00100000:2.0:1789131006.824312:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 30 00000100:00100000:2.0:1789131006.824322:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8494000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+66:11650:x1876039498271488:12345-192.168.203.11@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789131006.824587:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8494000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+67:11650:x1876039498271488:12345-192.168.203.11@tcp:35:lhsmtool_posix.0 Request processed in 266us (453us total) trans 4294967402 rc 0/0 00000100:00100000:2.0:1789131006.824595:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 30 00000100:00100000:1.0:1789131006.831006:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131006.831376:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498271744 00000100:00100000:2.0:1789131006.831387:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498271744 00000100:00100000:2.0:1789131006.831453:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 133 00000100:00100000:2.0:1789131006.831503:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01b38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+67:11650:x1876039498271744:12345-192.168.203.11@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789131006.831617:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01b38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+67:11650:x1876039498271744:12345-192.168.203.11@tcp:57:lhsmtool_posix.0 Request processed in 117us (621us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131006.831625:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 133 00000100:00100000:0.0:1789131006.836065:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789131006.841727:0:14851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498271872 00000100:00100000:1.0:1789131006.841741:0:14851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498271872 00000100:00100000:1.0:1789131006.842202:0:14851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 134 00000100:00100000:1.0:1789131006.842217:0:14851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc84961c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+67:11650:x1876039498271872:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789131006.842252:0:14851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789131006.842273:0:14851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb800/0xf3fe2838e1fc2b65 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269b16 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131006.842340:0:14851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca800/0xf3fe2838e1fc2b6c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131006.842355:0:14851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca800/0xf3fe2838e1fc2b6c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131006.842366:0:14851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca800/0xf3fe2838e1fc2b6c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789131006.842511:0:14851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789131006.842681:0:14851:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca800/0xf3fe2838e1fc2b6c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131006.842708:0:14851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb800/0xf3fe2838e1fc2b65 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269b16 expref: 69 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131006.842725:0:14851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca800/0xf3fe2838e1fc2b6c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269b16 expref: 68 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131006.842734:0:14851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff91dde1922b00) 00010000:00010000:1.0:1789131006.842737:0:14851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789131006.842741:0:14851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dcc85ca800, rc 0) 00000100:00100000:1.0:1789131006.842812:0:14851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc84961c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+68:11650:x1876039498271872:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 598us (6754us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131006.842820:0:14851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 134 00000100:00100000:0.0:1789131006.846279:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131006.846360:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498272000 00000100:00100000:2.0:1789131006.846370:0:9827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498272000 00000100:00100000:2.0:1789131006.846434:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 46 00000100:00100000:2.0:1789131006.846444:0:9827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff750000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+9:2387:x1876039498272000:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789131006.846676:0:9827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789131006.846696:0:9827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000246a3056/0xf3fe2838e1fc2b73 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269b1d expref: -99 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789131006.846719:0:9827:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa3f8fe, blocks: 0x0 00010000:00010000:2.0:1789131006.846742:0:9827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=362s v=(0 0) 00010000:00010000:2.0:1789131006.846747:0:9827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789131006.846758:0:9827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000246a3056/0xf3fe2838e1fc2b73 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269b1d expref: 10 pid: 9827 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131006.846778:0:9827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000246a3056/0xf3fe2838e1fc2b73 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269b1d expref: 10 pid: 9827 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131006.846792:0:9827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dcc7f7f600, rc 0) 00000100:00100000:2.0:1789131006.846843:0:9827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff750000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+10:2387:x1876039498272000:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 400us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131006.846851:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 46 00010000:00010000:2.0:1789131006.866026:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789131006.866542:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789131006.866627:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498272256 00000100:00100000:1.0:1789131006.866636:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498272256 00000100:00100000:1.0:1789131006.866693:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 135 00000100:00100000:1.0:1789131006.866704:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff753480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+68:11650:x1876039498272256:12345-192.168.203.11@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789131006.866805:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff753480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+68:11650:x1876039498272256:12345-192.168.203.11@tcp:57:lhsmtool_posix.0 Request processed in 103us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131006.866812:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 135 00000100:00100000:0.0:1789131006.872686:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131006.873269:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498272384 00000100:00100000:3.0:1789131006.873280:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498272384 00000100:00100000:3.0:1789131006.873340:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 47 00000100:00100000:3.0:1789131006.873350:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddffc0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+10:11650:x1876039498272384:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789131006.873369:0:8414:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789131006.873387:0:8414:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ce16cb8d/0xf3fe2838e1fc2b7a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269b24 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131006.873429:0:8414:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000246a3056/0xf3fe2838e1fc2b73 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269b1d expref: 11 pid: 9827 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131006.873439:0:8414:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789131006.873443:0:8414:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789131006.873448:0:8414:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ce16cb8d/0xf3fe2838e1fc2b7a lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269b24 expref: 11 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131006.873522:0:8414:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000246a3056/0xf3fe2838e1fc2b73 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269b1d expref: 11 pid: 9827 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131006.873536:0:8414:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000246a3056/0xf3fe2838e1fc2b73 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269b1d expref: 11 pid: 9827 timeout: 462 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131006.873561:0:8414:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd1dade00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8414:1876039508840320:192.168.203.11@tcp:104: 00000100:00100000:3.0:1789131006.873662:0:8414:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddd8364a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789131006.896793:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789131006.896900:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498272512 00000100:00100000:1.0:1789131006.896916:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498272512 00010000:00010000:1.0:1789131006.896956:0:6487:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000246a3056/0xf3fe2838e1fc2b73 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269b1d expref: 12 pid: 9827 timeout: 462 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131006.896998:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 83 00000100:00100000:1.0:1789131006.897008:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff750f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+12:2388:x1876039498272512:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789131006.897024:0:6487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789131006.897043:0:6487:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000246a3056/0xf3fe2838e1fc2b73 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269b1d expref: 12 pid: 9827 timeout: 462 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131006.897057:0:6487:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000246a3056/0xf3fe2838e1fc2b73 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269b1d expref: 12 pid: 9827 timeout: 462 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131006.897082:0:6487:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789131006.897088:0:6487:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789131006.897096:0:6487:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ce16cb8d/0xf3fe2838e1fc2b7a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269b24 expref: 12 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131006.897376:0:6487:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ce16cb8d/0xf3fe2838e1fc2b7a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269b24 expref: 12 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131006.897652:0:6487:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ce16cb8d/0xf3fe2838e1fc2b7a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269b24 expref: 12 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131006.897670:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01b3b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6487:1876039508840448:192.168.203.11@tcp:105: 00000100:00100000:1.0:1789131006.897793:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddc4c14180 going to sleep for 11 seconds 00010000:00010000:3.0:1789131006.897894:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000246a3056/0xf3fe2838e1fc2b73 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269b1d expref: 12 pid: 9827 timeout: 462 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131006.897919:0:8414:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd1dade00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8414:1876039508840320:192.168.203.11@tcp:104: 00010000:00010000:3.0:1789131006.897943:0:8414:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ce16cb8d/0xf3fe2838e1fc2b7a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269b24 expref: 11 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131006.897953:0:8414:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ddfd0b5200, rc 0) 00000100:00100000:3.0:1789131006.897982:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddffc0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+11:11650:x1876039498272384:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 24634us (25305us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131006.897990:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 47 00000100:00100000:1.0:1789131006.904157:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131006.904241:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498272640 00000100:00100000:2.0:1789131006.904251:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498272640 00002000:00100000:2.0:1789131006.904297:0:8420:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff91de01b3a1c0 x1876039498272640/t0(0) o4->b99c111d-b9b6-4590-88e4-9fefd4d4c3a4@192.168.203.11@tcp:722/0 lens 504/0 e 0 to 0 dl 1789131017 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789131006.904309:0:8420:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff91de01b3a1c0 with x1876039498272640 ext(0->12) 00002000:00010000:2.0:1789131006.904315:0:8420:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91de01b3a1c0 00000100:00100000:2.0:1789131006.904349:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2 00000100:00100000:2.0:1789131006.904359:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01b3a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+11:2387:x1876039498272640:12345-192.168.203.11@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1789131006.905433:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01b3b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6487:1876039508840448:192.168.203.11@tcp:105: 00010000:00010000:3.0:1789131006.905455:0:6487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789131006.906155:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff750f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+13:2388:x1876039498272512:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 9146us (9369us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131006.906167:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 83 00000100:00100000:0.0:1789131006.906270:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01b3a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+12:2387:x1876039498272640:12345-192.168.203.11@tcp:4:lhsmtool_posix.0 Request processed in 1911us (2121us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1789131006.906282:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2 00002000:00100000:0.0:1789131006.906290:0:8420:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff91de01b3a1c0 x1876039498272640/t4294967309(0) o4->b99c111d-b9b6-4590-88e4-9fefd4d4c3a4@192.168.203.11@tcp:722/0 lens 504/448 e 0 to 0 dl 1789131017 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789131006.906300:0:8420:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff91de01b3a1c0 with x1876039498272640 ext(0->12) 00002000:00010000:0.0:1789131006.906306:0:8420:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91de01b3a1c0 00000100:00100000:0.0:1789131006.908966:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131006.909163:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498272768 00000100:00100000:2.0:1789131006.909172:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498272768 00000100:00100000:2.0:1789131006.909855:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 136 00000100:00100000:2.0:1789131006.909868:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff750000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+68:11650:x1876039498272768:12345-192.168.203.11@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1789131006.913851:0:6479:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967402 is committed 00000004:00080000:0.0:1789131006.913867:0:6479:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000004:00080000:0.0:1789131006.913960:0:6479:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:0.0:1789131006.913992:0:6479:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff91ddd8364840 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:0.0:1789131006.913997:0:6479:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff91ddff410b00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff91ddd8364cc0 00000020:00080000:0.0:1789131006.914000:0:6479:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff91ddff410800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff91ddff891600 00000004:00080000:0.0:1789131006.914030:0:6479:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00010000:00010000:2.0:1789131006.914082:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cac00/0xf3fe2838e1fc287f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131006.914094:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cac00/0xf3fe2838e1fc287f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131006.914101:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cac00/0xf3fe2838e1fc287f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131006.914107:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc85cac00 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:2.0:1789131006.914112:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cac00/0xf3fe2838e1fc287f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131006.914120:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cac00/0xf3fe2838e1fc287f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131006.914144:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff91dcc7d6a300) 00010000:00010000:2.0:1789131006.914148:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789131006.914153:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cac00/0xf3fe2838e1fc287f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131006.914159:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cac00/0xf3fe2838e1fc287f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131006.914200:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e400/0xf3fe2838e1fc2927 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131006.914207:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e400/0xf3fe2838e1fc2927 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131006.914213:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e400/0xf3fe2838e1fc2927 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131006.914218:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc7f7e400 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:2.0:1789131006.914221:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e400/0xf3fe2838e1fc2927 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131006.914228:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e400/0xf3fe2838e1fc2927 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131006.914236:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff91dde1922d00) 00010000:00010000:2.0:1789131006.914238:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789131006.914241:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e400/0xf3fe2838e1fc2927 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131006.914247:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e400/0xf3fe2838e1fc2927 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131006.914262:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6200/0xf3fe2838e1fc29a5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131006.914268:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6200/0xf3fe2838e1fc29a5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131006.914273:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6200/0xf3fe2838e1fc29a5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131006.914284:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91de01ad6200 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:2.0:1789131006.914286:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6200/0xf3fe2838e1fc29a5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131006.914292:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6200/0xf3fe2838e1fc29a5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131006.914300:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff91ddc4c81200) 00010000:00010000:2.0:1789131006.914303:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789131006.914305:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6200/0xf3fe2838e1fc29a5 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131006.914323:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6200/0xf3fe2838e1fc29a5 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131006.914335:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4600/0xf3fe2838e1fc29c8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131006.914341:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4600/0xf3fe2838e1fc29c8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131006.914360:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4600/0xf3fe2838e1fc29c8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131006.914365:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddfd0b4600 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:2.0:1789131006.914369:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4600/0xf3fe2838e1fc29c8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131006.914374:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4600/0xf3fe2838e1fc29c8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131006.914393:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff91ddc4c81200) 00010000:00010000:2.0:1789131006.914395:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789131006.914398:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4600/0xf3fe2838e1fc29c8 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131006.914404:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4600/0xf3fe2838e1fc29c8 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131006.914419:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc2a9a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131006.914425:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc2a9a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131006.914430:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc2a9a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131006.914435:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91de01ad7600 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:2.0:1789131006.914439:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc2a9a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131006.914445:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc2a9a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131006.914453:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff91ddc4c81500) 00010000:00010000:2.0:1789131006.914456:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789131006.914496:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc2a9a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131006.914503:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc2a9a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131006.914526:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cbe00/0xf3fe2838e1fc2b57 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131006.914531:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cbe00/0xf3fe2838e1fc2b57 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131006.914538:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cbe00/0xf3fe2838e1fc2b57 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131006.914543:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc85cbe00 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:2.0:1789131006.914546:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cbe00/0xf3fe2838e1fc2b57 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131006.914552:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cbe00/0xf3fe2838e1fc2b57 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131006.914559:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff91dde1922b00) 00010000:00010000:2.0:1789131006.914561:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789131006.914564:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cbe00/0xf3fe2838e1fc2b57 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131006.914570:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cbe00/0xf3fe2838e1fc2b57 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1789131006.914587:0:6532:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:3.0:1789131006.914658:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789131006.914677:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd1dae1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508840576:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1789131006.914740:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131006.915678:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508840576 00000100:00100000:2.0:1789131006.915690:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508840576 00000100:00100000:2.0:1789131006.915764:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789131006.915774:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd1dade00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3626:x1876039508840576:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1789131006.915797:0:8417:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3 count 1 00000100:00100000:1.0:1789131006.915828:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00002000:00010000:2.0:1789131006.915835:0:8417:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 9, mtime: 0x6aa3f8fd, atime: 0x6aa3f8fd, ctime: 0x6aa3f8fd, blocks: 0x8 00000100:00100000:1.0:1789131006.915839:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01b3a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508840704:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1789131006.915841:0:8417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f8a483ec/0xf3fe2838e1fc2b81 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131006.915855:0:8417:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=362s v=(0 0) 00010000:00010000:2.0:1789131006.915860:0:8417:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789131006.915865:0:8417:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f8a483ec/0xf3fe2838e1fc2b81 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131006.915879:0:8417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f8a483ec/0xf3fe2838e1fc2b81 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131006.915880:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789131006.915888:0:8417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f8a483ec/0xf3fe2838e1fc2b81 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131006.915896:0:8417:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f8a483ec/0xf3fe2838e1fc2b81 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131006.915925:0:8417:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789131006.916006:0:7442:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789131006.916012:0:7442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f8a483ec/0xf3fe2838e1fc2b81 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131006.916019:0:7442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc7f7ee00 already unused, calling callback (ffffffffc0c4e550) 00010000:00010000:1.0:1789131006.916023:0:7442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f8a483ec/0xf3fe2838e1fc2b81 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131006.916030:0:7442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f8a483ec/0xf3fe2838e1fc2b81 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131006.916054:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd1dade00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:3626:x1876039508840576:12345-0@lo:6:osp-syn-0-0.0 Request processed in 281us (1313us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1789131006.916062:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789131006.916077:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508840704 00000100:00100000:2.0:1789131006.916080:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508840704 00000100:00100000:2.0:1789131006.916104:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789131006.916110:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc84143c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3625:x1876039508840704:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1789131006.916122:0:8417:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3 count 1 00010000:00010000:2.0:1789131006.916148:0:8417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000246a3056/0xf3fe2838e1fc2b88 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131006.916162:0:8417:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002f64cbe7/0xf3fe2838e1fc2935 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269a7c expref: 11 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131006.916169:0:8417:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789131006.916172:0:8417:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789131006.916176:0:8417:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000246a3056/0xf3fe2838e1fc2b88 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131006.916202:0:8417:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002f64cbe7/0xf3fe2838e1fc2935 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269a7c expref: 11 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131006.916215:0:8417:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002f64cbe7/0xf3fe2838e1fc2935 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269a7c expref: 11 pid: 8414 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131006.916227:0:8417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc6ff9a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8417:1876039508840960:192.168.203.11@tcp:104: 00010000:00010000:1.0:1789131006.916248:0:7442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f8a483ec/0xf3fe2838e1fc2b81 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131006.916261:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f8a483ec/0xf3fe2838e1fc2b81 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131006.916279:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789131006.916281:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789131006.916282:0:8417:0:(client.c:2715:ptlrpc_set_wait()) set ffff91dcc6aad240 going to sleep for 11 seconds 00010000:00010000:1.0:1789131006.916283:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1789131006.916683:0:3626:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff91ddd1dae1c0/2, rc 0, transno 4294967305 00000100:00100000:1.0:1789131006.916690:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd1dae1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508840576:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789131006.916707:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01b3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1876039508840832:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1789131006.916737:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131006.916772:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508840832 00000100:00100000:1.0:1789131006.916776:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508840832 00000100:00100000:1.0:1789131006.916803:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789131006.916810:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8416d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3627:x1876039508840832:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1789131006.916881:0:8416:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00000020:00080000:0.0:1789131006.917427:0:6479:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff91ddd8364600 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:0.0:1789131006.917432:0:6479:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff91dcc783f100 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff91ddd8364f00 00000020:00080000:0.0:1789131006.917434:0:6479:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff91dcc783f300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff91ddc702a000 00000020:00080000:0.0:1789131006.917468:0:6479:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000020:00080000:2.0:1789131006.917510:0:6532:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:2.0:1789131006.917552:0:6532:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:0.0:1789131006.917668:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff750000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+16:11650:x1876039498272768:12345-192.168.203.11@tcp:44:lhsmtool_posix.0 Request processed in 7801us (8709us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131006.917677:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 136 00002000:00010000:1.0:1789131006.917772:0:8416:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1789131006 00002000:00010000:1.0:1789131006.917776:0:8416:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1789131006.917779:0:8416:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 1789131006 -> 1789131006 00002000:00010000:1.0:1789131006.917781:0:8416:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:1.0:1789131006.917830:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8416d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3627:x1876039508840832:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1020us (1091us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1789131006.917837:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000004:00080000:2.0:1789131006.917930:0:3627:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff91de01b3b480/2, rc 0, transno 4294967310 00000100:00100000:2.0:1789131006.917936:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01b3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1876039508840832:0@lo:2:osp-syn-1-0.0 00000100:00080000:3.0:1789131006.921744:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789131006.921753:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789131006.923697:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131006.924851:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498272896 00000100:00100000:2.0:1789131006.924863:0:9827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498272896 00000100:00100000:2.0:1789131006.924923:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 51 00000100:00100000:2.0:1789131006.924934:0:9827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd1dac780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+12:2388:x1876039498272896:12345-192.168.203.11@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1789131006.925308:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789131006.925328:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498273024 00000100:00100000:1.0:1789131006.925332:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498273024 00010000:00010000:1.0:1789131006.925360:0:6486:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002f64cbe7/0xf3fe2838e1fc2935 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269a7c expref: 13 pid: 8414 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131006.925387:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 84 00000100:00100000:1.0:1789131006.925394:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc84161c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+13:2387:x1876039498273024:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789131006.925404:0:6486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789131006.925410:0:6486:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002f64cbe7/0xf3fe2838e1fc2935 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269a7c expref: 13 pid: 8414 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131006.925423:0:6486:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002f64cbe7/0xf3fe2838e1fc2935 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269a7c expref: 13 pid: 8414 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131006.925447:0:6486:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789131006.925452:0:6486:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789131006.925475:0:6486:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000246a3056/0xf3fe2838e1fc2b88 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131006.925497:0:6486:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000246a3056/0xf3fe2838e1fc2b88 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131006.925517:0:6486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789131006.925586:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc84161c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+13:2387:x1876039498273024:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 192us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131006.925594:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 84 00010000:00010000:3.0:1789131006.925886:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002f64cbe7/0xf3fe2838e1fc2935 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269a7c expref: 12 pid: 8414 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131006.925926:0:8417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc6ff9a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8417:1876039508840960:192.168.203.11@tcp:104: 00010000:00010000:3.0:1789131006.925949:0:8417:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000246a3056/0xf3fe2838e1fc2b88 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131006.925960:0:8417:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000246a3056/0xf3fe2838e1fc2b88 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131006.925967:0:8417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000246a3056/0xf3fe2838e1fc2b88 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131006.925979:0:8417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000246a3056/0xf3fe2838e1fc2b88 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131006.925986:0:8417:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000246a3056/0xf3fe2838e1fc2b88 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131006.926010:0:8417:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789131006.926207:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc84143c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3625:x1876039508840704:12345-0@lo:6:osp-syn-1-0.0 Request processed in 10095us (10325us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1789131006.926215:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00010000:1.0:1789131006.926414:0:6489:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789131006.926420:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000246a3056/0xf3fe2838e1fc2b88 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131006.926440:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc7f7f600 already unused, calling callback (ffffffffc0c4e550) 00010000:00010000:1.0:1789131006.926445:0:6489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000246a3056/0xf3fe2838e1fc2b88 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131006.926454:0:6489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000246a3056/0xf3fe2838e1fc2b88 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131006.927578:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000246a3056/0xf3fe2838e1fc2b88 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131006.927593:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000246a3056/0xf3fe2838e1fc2b88 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131006.927619:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789131006.927621:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789131006.927623:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1789131006.927667:0:3625:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff91de01b3a580/2, rc 0, transno 4294967311 00000100:00100000:1.0:1789131006.927675:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01b3a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508840704:0@lo:6:osp-syn-1-0.0 00000001:00080000:3.0:1789131006.933791:0:9493:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:3.0:1789131006.933804:0:9493:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000100:00100000:2.0:1789131006.940555:0:9827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd1dac780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+6:2388:x1876039498272896:12345-192.168.203.11@tcp:16:lhsmtool_posix.0 Request processed in 15612us (16858us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131006.940569:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 51 00000100:00100000:1.0:1789131006.947867:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131006.947946:0:14851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498273280 00000100:00100000:2.0:1789131006.947956:0:14851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498273280 00000100:00100000:2.0:1789131006.948015:0:14851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 137 00000100:00100000:2.0:1789131006.948027:0:14851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc860a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+16:11650:x1876039498273280:12345-192.168.203.11@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789131006.948267:0:14851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789131006.948295:0:14851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca800/0xf3fe2838e1fc2b6c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269b16 expref: 16 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131006.948432:0:14851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff91dde1922b00) 00010000:00010000:2.0:1789131006.948438:0:14851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789131006.948547:0:14851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fc00/0xf3fe2838e1fc2b8f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131006.948561:0:14851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fc00/0xf3fe2838e1fc2b8f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131006.948640:0:14851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fc00/0xf3fe2838e1fc2b8f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789131006.948749:0:14851:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000006d21c626 reply state 00000000191efaf8 transno 4294967403 ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fc00/0xf3fe2838e1fc2b8f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131006.948762:0:14851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fc00/0xf3fe2838e1fc2b8f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131006.948768:0:14851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff91dde1922b00) 00010000:00010000:2.0:1789131006.948783:0:14851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789131006.948787:0:14851:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789131006.948929:0:14851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc860a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+17:11650:x1876039498273280:12345-192.168.203.11@tcp:36:lhsmtool_posix.0 Request processed in 903us (1069us total) trans 4294967403 rc 0/0 00000100:00100000:2.0:1789131006.948937:0:14851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 137 00000100:00100000:2.0:1789131006.954953:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789131006.955081:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498273408 00000100:00100000:1.0:1789131006.955090:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498273408 00000100:00100000:1.0:1789131006.955143:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 52 00000100:00100000:1.0:1789131006.955153:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc6ffb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+6:2385:x1876039498273408:12345-192.168.203.11@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1789131006.955299:0:8414:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1789131006.955302:0:8414:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 1789131006 -> 1789131005 00002000:00010000:1.0:1789131006.955456:0:8414:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 1789131005 00002000:00010000:1.0:1789131006.955525:0:8414:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 1789131006 -> 1789131005 00002000:00010000:1.0:1789131006.955528:0:8414:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1789131006.955628:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc6ffb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+7:2385:x1876039498273408:12345-192.168.203.11@tcp:2:lhsmtool_posix.0 Request processed in 475us (683us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1789131006.955637:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 52 00000100:00100000:0.0:1789131006.961083:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789131006.961211:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498273664 00000100:00100000:1.0:1789131006.961220:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498273664 00000100:00100000:1.0:1789131006.961280:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 138 00000100:00100000:1.0:1789131006.961291:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7c783c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+17:11650:x1876039498273664:12345-192.168.203.11@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1789131006.961369:0:9769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb200/0xf3fe2838e1fc2b96 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131006.961386:0:9769:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fa00/0xf3fe2838e1fc2b50 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269b08 expref: 17 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131006.961396:0:9769:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb200/0xf3fe2838e1fc2b96 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131006.961430:0:9769:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fa00/0xf3fe2838e1fc2b50 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269b08 expref: 17 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131006.961445:0:9769:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fa00/0xf3fe2838e1fc2b50 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269b08 expref: 17 pid: 6501 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131006.961498:0:9769:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8608000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9769:1876039508841088:192.168.203.11@tcp:104: 00000100:00100000:1.0:1789131006.961593:0:9769:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddc4c14180 going to sleep for 11 seconds 00000100:00100000:1.0:1789131006.964656:0:9769:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8608000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9769:1876039508841088:192.168.203.11@tcp:104: 00010000:00010000:1.0:1789131006.964695:0:9769:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb200/0xf3fe2838e1fc2b96 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131006.965777:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131006.965865:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498273792 00000100:00100000:2.0:1789131006.965873:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498273792 00010000:00010000:2.0:1789131006.965920:0:6485:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fa00/0xf3fe2838e1fc2b50 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269b08 expref: 18 pid: 6501 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131006.965962:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 85 00000100:00100000:2.0:1789131006.965972:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7c7a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+18:2388:x1876039498273792:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789131006.965986:0:6485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789131006.965993:0:6485:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fa00/0xf3fe2838e1fc2b50 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269b08 expref: 18 pid: 6501 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131006.966006:0:6485:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fa00/0xf3fe2838e1fc2b50 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269b08 expref: 18 pid: 6501 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131006.966027:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fa00/0xf3fe2838e1fc2b50 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269b08 expref: 18 pid: 6501 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131006.966042:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff91dde1922b00) 00010000:00010000:2.0:1789131006.966046:0:6485:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb200/0xf3fe2838e1fc2b96 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131006.966055:0:6485:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb200/0xf3fe2838e1fc2b96 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131006.966072:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb200/0xf3fe2838e1fc2b96 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131006.966103:0:6485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789131006.966162:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7c7a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+17:2388:x1876039498273792:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 191us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131006.966170:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 85 00010000:00010000:0.0:1789131006.966436:0:9769:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb200/0xf3fe2838e1fc2b96 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131006.966444:0:9769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb200/0xf3fe2838e1fc2b96 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131006.966521:0:9769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb200/0xf3fe2838e1fc2b96 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131006.966529:0:9769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb200/0xf3fe2838e1fc2b96 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131006.966535:0:9769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb200/0xf3fe2838e1fc2b96 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131006.966542:0:9769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc85cb200 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:0.0:1789131006.966546:0:9769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb200/0xf3fe2838e1fc2b96 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131006.966553:0:9769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb200/0xf3fe2838e1fc2b96 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131006.966562:0:9769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff91dde1922b00) 00010000:00010000:0.0:1789131006.966565:0:9769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1789131006.966568:0:9769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb200/0xf3fe2838e1fc2b96 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131006.966581:0:9769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb200/0xf3fe2838e1fc2b96 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131006.966629:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7c783c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+16:11650:x1876039498273664:12345-192.168.203.11@tcp:55:lhsmtool_posix.0 Request processed in 5340us (5556us total) trans 0 rc -22/-22 00000100:00100000:0.0:1789131006.966637:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 138 00000100:00100000:0.0:1789131006.970391:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131006.970716:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498273920 00000100:00100000:3.0:1789131006.970726:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498273920 00000100:00100000:2.0:1789131006.970882:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 53 00000100:00100000:2.0:1789131006.970893:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7fd12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+7:2387:x1876039498273920:12345-192.168.203.11@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1789131006.970946:0:8417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001b7cb00b/0xf3fe2838e1fc2b9d lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131006.970965:0:8417:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ce16cb8d/0xf3fe2838e1fc2b7a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269b24 expref: 7 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131006.970974:0:8417:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789131006.970979:0:8417:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789131006.970983:0:8417:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001b7cb00b/0xf3fe2838e1fc2b9d lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131006.971016:0:8417:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ce16cb8d/0xf3fe2838e1fc2b7a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269b24 expref: 7 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131006.971030:0:8417:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ce16cb8d/0xf3fe2838e1fc2b7a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269b24 expref: 7 pid: 8414 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131006.971064:0:8417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc6ff9a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8417:1876039508841216:192.168.203.11@tcp:104: 00000100:00100000:2.0:1789131006.971171:0:8417:0:(client.c:2715:ptlrpc_set_wait()) set ffff91dcc6aada80 going to sleep for 11 seconds 00000100:00100000:2.0:1789131006.973817:0:8417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc6ff9a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8417:1876039508841216:192.168.203.11@tcp:104: 00010000:00010000:2.0:1789131006.973845:0:8417:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001b7cb00b/0xf3fe2838e1fc2b9d lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131006.975879:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789131006.975952:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498274048 00000100:00100000:1.0:1789131006.975963:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498274048 00010000:00010000:1.0:1789131006.976001:0:6486:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ce16cb8d/0xf3fe2838e1fc2b7a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269b24 expref: 8 pid: 8414 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131006.976040:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 86 00000100:00100000:1.0:1789131006.976049:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc33ac850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+8:2387:x1876039498274048:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789131006.976064:0:6486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789131006.976083:0:6486:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ce16cb8d/0xf3fe2838e1fc2b7a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269b24 expref: 8 pid: 8414 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131006.976097:0:6486:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ce16cb8d/0xf3fe2838e1fc2b7a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269b24 expref: 8 pid: 8414 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131006.976126:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ce16cb8d/0xf3fe2838e1fc2b7a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269b24 expref: 8 pid: 8414 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131006.976141:0:6486:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789131006.976146:0:6486:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789131006.976152:0:6486:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001b7cb00b/0xf3fe2838e1fc2b9d lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131006.976162:0:6486:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001b7cb00b/0xf3fe2838e1fc2b9d lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131006.976217:0:6486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789131006.976274:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc33ac850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+7:2387:x1876039498274048:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 226us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131006.976282:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 86 00010000:00010000:3.0:1789131006.977073:0:8417:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001b7cb00b/0xf3fe2838e1fc2b9d lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131006.977093:0:8417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001b7cb00b/0xf3fe2838e1fc2b9d lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131006.977128:0:8417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001b7cb00b/0xf3fe2838e1fc2b9d lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131006.977138:0:8417:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001b7cb00b/0xf3fe2838e1fc2b9d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131006.977146:0:8417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001b7cb00b/0xf3fe2838e1fc2b9d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131006.977153:0:8417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc7f7e800 already unused, calling callback (ffffffffc0c4e550) 00010000:00010000:3.0:1789131006.977157:0:8417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001b7cb00b/0xf3fe2838e1fc2b9d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131006.977166:0:8417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001b7cb00b/0xf3fe2838e1fc2b9d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131006.977181:0:8417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001b7cb00b/0xf3fe2838e1fc2b9d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131006.977190:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001b7cb00b/0xf3fe2838e1fc2b9d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131006.977274:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7fd12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+6:2387:x1876039498273920:12345-192.168.203.11@tcp:1:lhsmtool_posix.0 Request processed in 6381us (6891us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131006.977283:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 53 00000100:00100000:0.0:1789131006.981449:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789131006.981588:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498274304 00000100:00100000:1.0:1789131006.981596:0:14273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498274304 00000100:00100000:1.0:1789131006.981638:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 139 00000100:00100000:1.0:1789131006.981647:0:14273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7fd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+16:11650:x1876039498274304:12345-192.168.203.11@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789131006.981715:0:14273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb200/0xf3fe2838e1fc2ba4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131006.981730:0:14273:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4c00/0xf3fe2838e1fc2a93 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269ad0 expref: 16 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131006.981739:0:14273:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb200/0xf3fe2838e1fc2ba4 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131006.981772:0:14273:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4c00/0xf3fe2838e1fc2a93 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269ad0 expref: 16 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131006.981785:0:14273:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4c00/0xf3fe2838e1fc2a93 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269ad0 expref: 16 pid: 6502 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131006.981799:0:14273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8608000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14273:1876039508841344:192.168.203.11@tcp:104: 00000100:00100000:1.0:1789131006.981875:0:14273:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddc4c14840 going to sleep for 11 seconds 00000100:00100000:1.0:1789131006.985389:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131006.985497:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498274432 00000100:00100000:3.0:1789131006.985516:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498274432 00010000:00010000:3.0:1789131006.985553:0:6485:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4c00/0xf3fe2838e1fc2a93 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269ad0 expref: 17 pid: 6502 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131006.985601:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 87 00000100:00100000:3.0:1789131006.985611:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc86092c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+17:2388:x1876039498274432:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789131006.985625:0:6485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789131006.985632:0:6485:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4c00/0xf3fe2838e1fc2a93 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269ad0 expref: 17 pid: 6502 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131006.985645:0:6485:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4c00/0xf3fe2838e1fc2a93 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269ad0 expref: 17 pid: 6502 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131006.985669:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff91ddc4c81500) 00010000:00010000:3.0:1789131006.985675:0:6485:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4200/0xf3fe2838e1fc2af5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269af3 expref: 17 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131006.985685:0:6485:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb200/0xf3fe2838e1fc2ba4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131006.985693:0:6485:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb200/0xf3fe2838e1fc2ba4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131006.985713:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb200/0xf3fe2838e1fc2ba4 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131006.985733:0:6485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789131006.985790:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc86092c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+17:2388:x1876039498274432:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 180us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131006.985799:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 87 00010000:00010000:2.0:1789131006.986243:0:14273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4c00/0xf3fe2838e1fc2a93 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269ad0 expref: 16 pid: 6502 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131006.986260:0:14273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8608000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14273:1876039508841344:192.168.203.11@tcp:104: 00010000:00010000:2.0:1789131006.986279:0:14273:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb200/0xf3fe2838e1fc2ba4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131006.986288:0:14273:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb200/0xf3fe2838e1fc2ba4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131006.986294:0:14273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb200/0xf3fe2838e1fc2ba4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131006.986451:0:14273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e200/0xf3fe2838e1fc2bab lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131006.986511:0:14273:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca200/0xf3fe2838e1fc2b5e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269b0f expref: 16 pid: 9769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131006.986520:0:14273:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e200/0xf3fe2838e1fc2bab lrc: 4/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131006.986552:0:14273:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca200/0xf3fe2838e1fc2b5e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269b0f expref: 16 pid: 9769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131006.986564:0:14273:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca200/0xf3fe2838e1fc2b5e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269b0f expref: 16 pid: 9769 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131006.986578:0:14273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc6ff9a40 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14273:1876039508841472:192.168.203.11@tcp:104: 00000100:00100000:2.0:1789131006.986633:0:14273:0:(client.c:2715:ptlrpc_set_wait()) set ffff91dcc6aad000 going to sleep for 11 seconds 00000100:00100000:1.0:1789131006.991355:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131006.991502:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498274560 00000100:00100000:3.0:1789131006.991520:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498274560 00010000:00010000:3.0:1789131006.991558:0:6486:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca200/0xf3fe2838e1fc2b5e lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269b0f expref: 17 pid: 9769 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131006.991604:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 88 00000100:00100000:3.0:1789131006.991613:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc86083c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+17:2388:x1876039498274560:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789131006.991627:0:6486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789131006.991634:0:6486:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca200/0xf3fe2838e1fc2b5e lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269b0f expref: 17 pid: 9769 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131006.991647:0:6486:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca200/0xf3fe2838e1fc2b5e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269b0f expref: 17 pid: 9769 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131006.991667:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff91dde1922b00) 00010000:00010000:3.0:1789131006.991672:0:6486:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e200/0xf3fe2838e1fc2bab lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131006.991681:0:6486:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e200/0xf3fe2838e1fc2bab lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131006.991703:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e200/0xf3fe2838e1fc2bab lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131006.991722:0:6486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789131006.991766:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc86083c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+17:2388:x1876039498274560:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 154us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131006.991774:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 88 00010000:00010000:2.0:1789131006.991928:0:14273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca200/0xf3fe2838e1fc2b5e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269b0f expref: 16 pid: 9769 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131006.991945:0:14273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc6ff9a40 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14273:1876039508841472:192.168.203.11@tcp:104: 00010000:00010000:2.0:1789131006.991965:0:14273:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e200/0xf3fe2838e1fc2bab lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131006.991973:0:14273:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e200/0xf3fe2838e1fc2bab lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131006.991978:0:14273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e200/0xf3fe2838e1fc2bab lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789131006.992081:0:14273:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000001:00080000:2.0:1789131006.992180:0:14273:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000001:00080000:2.0:1789131006.992210:0:14273:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000100:00100000:2.0:1789131006.992274:0:14273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc6ff9a40 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:14273:1876039508841600:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1789131006.992326:0:14273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131006.992362:0:14273:0:(client.c:2715:ptlrpc_set_wait()) set ffff91dcc6aad3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789131006.992813:0:11069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508841600 00000100:00100000:3.0:1789131006.992820:0:11069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508841600 00000100:00100000:3.0:1789131006.992856:0:11069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1789131006.992864:0:11069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc6ff9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:14273:x1876039508841600:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1789131006.992962:0:11069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc6ff9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:14273:x1876039508841600:12345-0@lo:1000:mdt00_004.0 Request processed in 99us (635us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131006.992969:0:11069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1789131006.993192:0:14273:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:0.0:1789131006.993198:0:14273:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967310 00000004:00080000:0.0:1789131006.993214:0:14273:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff91de01b3b480, transno 4294967310 00000100:00100000:0.0:1789131006.993235:0:14273:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff91de01b3a580 x1876039508840704/t4294967311(4294967311) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789131022 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789131006.993246:0:14273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc6ff9a40 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:14273:1876039508841600:0@lo:1000:mdt00_004.0 00000001:00080000:0.0:1789131006.993376:0:14273:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00000100:00100000:0.0:1789131006.993430:0:14273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7fd0b40 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:14273:1876039508841728:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1789131006.993504:0:14273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131006.993535:0:14273:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddc33c40c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789131006.994064:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508841728 00000100:00100000:2.0:1789131006.994071:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508841728 00000100:00100000:2.0:1789131006.994109:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1789131006.994129:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7fd3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:14273:x1876039508841728:12345-0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1789131006.994246:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7fd3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:14273:x1876039508841728:12345-0@lo:1000:mdt00_004.0 Request processed in 118us (741us total) trans 4294967313 rc 0/0 00000100:00100000:2.0:1789131006.994253:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1789131006.994295:0:14273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7fd0b40 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:14273:1876039508841728:0@lo:1000:mdt00_004.0 00010000:00010000:2.0:1789131006.994344:0:14273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e200/0xf3fe2838e1fc2bab lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131006.994354:0:14273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e200/0xf3fe2838e1fc2bab lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131006.994362:0:14273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e200/0xf3fe2838e1fc2bab lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131006.994368:0:14273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc7f7e200 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:2.0:1789131006.994373:0:14273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e200/0xf3fe2838e1fc2bab lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131006.994381:0:14273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e200/0xf3fe2838e1fc2bab lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131006.994394:0:14273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff91dde1922b00) 00010000:00010000:2.0:1789131006.994397:0:14273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789131006.994403:0:14273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e200/0xf3fe2838e1fc2bab lrc: 2/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131006.994410:0:14273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e200/0xf3fe2838e1fc2bab lrc: 0/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131006.994445:0:14273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4400/0xf3fe2838e1fc2aee lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131006.994452:0:14273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4400/0xf3fe2838e1fc2aee lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131006.994480:0:14273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4400/0xf3fe2838e1fc2aee lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131006.994486:0:14273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddfd0b4400 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:2.0:1789131006.994489:0:14273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4400/0xf3fe2838e1fc2aee lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131006.994496:0:14273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4400/0xf3fe2838e1fc2aee lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131006.994504:0:14273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff91ddc4c81500) 00010000:00010000:2.0:1789131006.994518:0:14273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789131006.994524:0:14273:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4200/0xf3fe2838e1fc2af5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269af3 expref: 19 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131006.994535:0:14273:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4200/0xf3fe2838e1fc2af5 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269af3 expref: 19 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131006.994543:0:14273:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4200/0xf3fe2838e1fc2af5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269af3 expref: 19 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131006.994579:0:14273:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4200/0xf3fe2838e1fc2af5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269af3 expref: 19 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131006.994604:0:14273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc6ff9e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14273:1876039508841856:192.168.203.11@tcp:105: 00000100:00100000:2.0:1789131006.994771:0:14273:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddc5333900 going to sleep for 11 seconds 00000100:00100000:2.0:1789131006.998447:0:14273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc6ff9e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14273:1876039508841856:192.168.203.11@tcp:105: 00010000:00010000:2.0:1789131006.998512:0:14273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4400/0xf3fe2838e1fc2aee lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131006.998523:0:14273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4400/0xf3fe2838e1fc2aee lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131006.998557:0:14273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fe00/0xf3fe2838e1fc2bb2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131006.998580:0:14273:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fe00/0xf3fe2838e1fc2bb2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131006.998592:0:14273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fe00/0xf3fe2838e1fc2bb2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131006.998604:0:14273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fe00/0xf3fe2838e1fc2bb2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131006.998610:0:14273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fe00/0xf3fe2838e1fc2bb2 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131006.998616:0:14273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fe00/0xf3fe2838e1fc2bb2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131006.998622:0:14273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc7f7fe00 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:2.0:1789131006.998626:0:14273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fe00/0xf3fe2838e1fc2bb2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131006.998651:0:14273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fe00/0xf3fe2838e1fc2bb2 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131006.998663:0:14273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff91ddc4c81500) 00010000:00010000:2.0:1789131006.998666:0:14273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789131006.998670:0:14273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fe00/0xf3fe2838e1fc2bb2 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131006.998677:0:14273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fe00/0xf3fe2838e1fc2bb2 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131006.998687:0:14273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb200/0xf3fe2838e1fc2ba4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131006.998693:0:14273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb200/0xf3fe2838e1fc2ba4 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131006.998699:0:14273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb200/0xf3fe2838e1fc2ba4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131006.998704:0:14273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc85cb200 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:2.0:1789131006.998707:0:14273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb200/0xf3fe2838e1fc2ba4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131006.998713:0:14273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb200/0xf3fe2838e1fc2ba4 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131006.998721:0:14273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff91ddc4c81500) 00010000:00010000:2.0:1789131006.998723:0:14273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789131006.998726:0:14273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb200/0xf3fe2838e1fc2ba4 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131006.998742:0:14273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb200/0xf3fe2838e1fc2ba4 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131006.998890:0:14273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7fd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+19:11650:x1876039498274304:12345-192.168.203.11@tcp:57:lhsmtool_posix.0 Request processed in 17241us (17448us total) trans 4294967408 rc 0/0 00000100:00100000:2.0:1789131006.998901:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 139 00000020:00080000:2.0:1789131006.998920:0:14273:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1789131006.999293:0:14475:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789131006.999299:0:14475:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789131006.999825:0:14475:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1789131006.999835:0:14475:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789131007.006847:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131007.006955:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498274688 00000100:00100000:0.0:1789131007.006965:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498274688 00000100:00100000:0.0:1789131007.007035:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 31 00000100:00100000:0.0:1789131007.007045:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc6ff9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+19:11649:x1876039498274688:12345-192.168.203.11@tcp:49:lfs.0 00000100:00100000:0.0:1789131007.007182:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc6ff9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+19:11649:x1876039498274688:12345-192.168.203.11@tcp:49:lfs.0 Request processed in 137us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131007.007207:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 31 00000100:00080000:3.0:1789131007.007277:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789131007.011361:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131007.011503:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498274944 00000100:00100000:2.0:1789131007.011524:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498274944 00000100:00100000:2.0:1789131007.011583:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 32 00000100:00100000:2.0:1789131007.011593:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dded1d6450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+19:11650:x1876039498274944:12345-192.168.203.11@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1789131007.011831:0:6504:0:(mdd_object.c:4024:mdd_close()) Object [0x200000402:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1789131007.011863:0:6504:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967409 00010000:00010000:2.0:1789131007.011896:0:6504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fe00/0xf3fe2838e1fc2bb9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131007.011924:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fe00/0xf3fe2838e1fc2bb9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131007.011935:0:6504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fe00/0xf3fe2838e1fc2bb9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131007.011943:0:6504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fe00/0xf3fe2838e1fc2bb9 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131007.011949:0:6504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fe00/0xf3fe2838e1fc2bb9 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131007.011974:0:6504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fe00/0xf3fe2838e1fc2bb9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131007.011987:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789131007.012079:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dded1d6450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+21:11650:x1876039498274944:12345-192.168.203.11@tcp:35:lhsmtool_posix.0 Request processed in 486us (725us total) trans 4294967410 rc 0/0 00000100:00100000:2.0:1789131007.012087:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 32 00000020:00080000:2.0:1789131007.012092:0:6504:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789131007.013414:0:6488:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789131007.013426:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fe00/0xf3fe2838e1fc2bb9 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131007.013436:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc7f7fe00 already unused, calling callback (ffffffffc0c4e550) 00010000:00010000:1.0:1789131007.013440:0:6488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fe00/0xf3fe2838e1fc2bb9 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131007.013449:0:6488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fe00/0xf3fe2838e1fc2bb9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131007.013503:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff91dde1922b00) 00010000:00010000:1.0:1789131007.013516:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789131007.013521:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fe00/0xf3fe2838e1fc2bb9 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131007.013528:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fe00/0xf3fe2838e1fc2bb9 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131007.013541:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789131007.013544:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789131007.013546:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789131007.015094:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131007.015394:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498275200 00000100:00100000:3.0:1789131007.015404:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498275200 00000100:00100000:3.0:1789131007.015485:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 140 00000100:00100000:3.0:1789131007.015497:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc860a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+21:11649:x1876039498275200:12345-192.168.203.11@tcp:58:lfs.0 00000040:00080000:3.0:1789131007.015680:0:6502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:3.0:1789131007.015757:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc860a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+21:11649:x1876039498275200:12345-192.168.203.11@tcp:58:lfs.0 Request processed in 261us (669us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131007.015765:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 140 00000100:00100000:3.0:1789131007.050188:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131007.050329:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498275328 00000100:00100000:2.0:1789131007.050339:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498275328 00000100:00100000:2.0:1789131007.050633:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 141 00000100:00100000:2.0:1789131007.050647:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd1dae940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+21:11652:x1876039498275328:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:2.0:1789131007.050672:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789131007.050694:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e200/0xf3fe2838e1fc2bc0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269b2b expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131007.050756:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f800/0xf3fe2838e1fc2bc7 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131007.050772:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f800/0xf3fe2838e1fc2bc7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131007.050785:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f800/0xf3fe2838e1fc2bc7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131007.050799:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e600/0xf3fe2838e1fc2bce lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131007.050807:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e600/0xf3fe2838e1fc2bce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131007.050829:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e600/0xf3fe2838e1fc2bce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131007.050899:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fe00/0xf3fe2838e1fc2bd5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131007.050922:0:6500:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e000/0xf3fe2838e1fc2ae0 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269aec expref: 22 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131007.050931:0:6500:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fe00/0xf3fe2838e1fc2bd5 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131007.050962:0:6500:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e000/0xf3fe2838e1fc2ae0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269aec expref: 22 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131007.050975:0:6500:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e000/0xf3fe2838e1fc2ae0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269aec expref: 22 pid: 14273 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131007.050988:0:6500:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc6ff9e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6500:1876039508841984:192.168.203.11@tcp:104: 00000100:00100000:2.0:1789131007.051132:0:6500:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddc33c49c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789131007.053630:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131007.053795:0:6500:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc6ff9e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6500:1876039508841984:192.168.203.11@tcp:104: 00010000:00010000:2.0:1789131007.053823:0:6500:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fe00/0xf3fe2838e1fc2bd5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131007.053996:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498275584 00000100:00100000:3.0:1789131007.054003:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498275584 00000100:00100000:3.0:1789131007.054052:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 33 00000100:00100000:3.0:1789131007.054061:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7fd0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+23:11030:x1876039498275584:12345-192.168.203.11@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1789131007.054315:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7fd0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+24:11030:x1876039498275584:12345-192.168.203.11@tcp:35:ldlm_bl.0 Request processed in 253us (692us total) trans 4294967411 rc 0/0 00000100:00100000:3.0:1789131007.054324:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 33 00000100:00100000:1.0:1789131007.056784:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131007.056870:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498275712 00000100:00100000:3.0:1789131007.056879:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498275712 00010000:00010000:3.0:1789131007.056925:0:6485:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e000/0xf3fe2838e1fc2ae0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269aec expref: 24 pid: 14273 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131007.056964:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 89 00000100:00100000:3.0:1789131007.056973:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8608000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+24:2388:x1876039498275712:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789131007.056987:0:6485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789131007.056996:0:6485:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e000/0xf3fe2838e1fc2ae0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269aec expref: 24 pid: 14273 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131007.057009:0:6485:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e000/0xf3fe2838e1fc2ae0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269aec expref: 24 pid: 14273 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131007.057030:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e000/0xf3fe2838e1fc2ae0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269aec expref: 24 pid: 14273 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131007.057047:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff91ddc4c81500) 00010000:00010000:3.0:1789131007.057052:0:6485:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fe00/0xf3fe2838e1fc2bd5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131007.057073:0:6485:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fe00/0xf3fe2838e1fc2bd5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131007.057080:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fe00/0xf3fe2838e1fc2bd5 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131007.057111:0:6485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789131007.057307:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8608000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+23:2388:x1876039498275712:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 334us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131007.057316:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 89 00010000:00010000:2.0:1789131007.057515:0:6500:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fe00/0xf3fe2838e1fc2bd5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131007.057524:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fe00/0xf3fe2838e1fc2bd5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789131007.057588:0:6500:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1789131007.057593:0:6500:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789131007.057613:0:6500:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fe00/0xf3fe2838e1fc2bd5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131007.057625:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fe00/0xf3fe2838e1fc2bd5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131007.057634:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f800/0xf3fe2838e1fc2bc7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131007.057641:0:6500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f800/0xf3fe2838e1fc2bc7 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131007.057649:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f800/0xf3fe2838e1fc2bc7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131007.057655:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc7f7f800 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:2.0:1789131007.057659:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f800/0xf3fe2838e1fc2bc7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131007.057667:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f800/0xf3fe2838e1fc2bc7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131007.057677:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff91dded3a2b00) 00010000:00010000:2.0:1789131007.057680:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789131007.057684:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f800/0xf3fe2838e1fc2bc7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131007.057690:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f800/0xf3fe2838e1fc2bc7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131007.057713:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e600/0xf3fe2838e1fc2bce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131007.057720:0:6500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e600/0xf3fe2838e1fc2bce lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131007.057726:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e600/0xf3fe2838e1fc2bce lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131007.057731:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc7f7e600 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:2.0:1789131007.057734:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e600/0xf3fe2838e1fc2bce lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131007.057740:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e600/0xf3fe2838e1fc2bce lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131007.057748:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff91dde1922d00) 00010000:00010000:2.0:1789131007.057751:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789131007.057754:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e600/0xf3fe2838e1fc2bce lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131007.057759:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e600/0xf3fe2838e1fc2bce lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131007.057792:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e200/0xf3fe2838e1fc2bc0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269b2b expref: 23 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131007.057805:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fe00/0xf3fe2838e1fc2bd5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269b2b expref: 22 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131007.057824:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff91ddc4c81500) 00010000:00010000:2.0:1789131007.057826:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789131007.057829:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dcc7f7fe00, rc 0) 00000100:00100000:2.0:1789131007.057859:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd1dae940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+22:11652:x1876039498275328:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 7215us (7678us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131007.057867:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 141 00000040:00080000:1.0:1789131007.761667:0:14941:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789131007.761678:0:14941:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789131007.761710:0:14941:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1789131007.761717:0:14941:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789131007.845795:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131007.845848:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789131007.845999:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498275968 00000100:00100000:1.0:1789131007.846008:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498275968 00000100:00100000:1.0:1789131007.846069:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 324 00000100:00100000:1.0:1789131007.846097:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7fd2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+22:2386:x1876039498275968:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1789131007.846176:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7fd2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+22:2386:x1876039498275968:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 91us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131007.846184:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 324 00000100:00100000:3.0:1789131007.846415:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498275840 00000100:00100000:3.0:1789131007.846420:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498275840 00000100:00100000:3.0:1789131007.846495:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 448 00000100:00100000:3.0:1789131007.846503:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddcf7c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+13:2386:x1876039498275840:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1789131007.846538:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddcf7c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+13:2386:x1876039498275840:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 36us (752us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131007.846543:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 448 00000100:00100000:0.0:1789131007.849624:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131007.849656:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131007.849685:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131007.849708:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131007.849726:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131007.849751:0:14851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498276480 00000100:00100000:0.0:1789131007.849759:0:14851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498276480 00000100:00100000:1.0:1789131007.849851:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498276224 00000100:00100000:1.0:1789131007.849856:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498276224 00000100:00100000:1.0:1789131007.849888:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498276352 00000100:00100000:1.0:1789131007.849891:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498276352 00000100:00100000:1.0:1789131007.849926:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 122 00000100:00100000:1.0:1789131007.849935:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7c6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+9:2385:x1876039498276224:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1789131007.850000:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7c6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+9:2385:x1876039498276224:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 65us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131007.850008:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 122 00000100:00100000:1.0:1789131007.850023:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 123 00000100:00100000:1.0:1789131007.850030:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7c6b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+6:2385:x1876039498276352:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1789131007.850054:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7c6b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+6:2385:x1876039498276352:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 25us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131007.850061:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 123 00000100:00100000:0.0:1789131007.850416:0:14851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498276096 00000100:00100000:0.0:1789131007.850421:0:14851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498276096 00000100:00100000:3.0:1789131007.850709:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498276608 00000100:00100000:3.0:1789131007.850714:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498276608 00000100:00100000:3.0:1789131007.850743:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 325 00000100:00100000:3.0:1789131007.850750:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7c692c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fde8d4a8-44db-4e6b-8249-c1c295e4901d+5:2385:x1876039498276480:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1789131007.850793:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7c692c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fde8d4a8-44db-4e6b-8249-c1c295e4901d+5:2385:x1876039498276480:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 44us (1137us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131007.850801:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 325 00000100:00100000:2.0:1789131007.850836:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 326 00000100:00100000:2.0:1789131007.850848:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7c6bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+5:2385:x1876039498276096:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1789131007.850878:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7c6bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+5:2385:x1876039498276096:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 34us (1192us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131007.850886:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 326 00000100:00100000:3.0:1789131007.850909:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 327 00000100:00100000:3.0:1789131007.850920:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7c68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fde8d4a8-44db-4e6b-8249-c1c295e4901d+5:2385:x1876039498276608:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1789131007.850960:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7c68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fde8d4a8-44db-4e6b-8249-c1c295e4901d+5:2385:x1876039498276608:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 43us (1233us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131007.850967:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 327 00000100:00080000:3.0:1789131007.850987:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789131007.850991:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789131007.850993:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789131007.890056:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789131008.017673:0:14475:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789131008.017683:0:14475:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789131008.017705:0:14475:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1789131008.017714:0:14475:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789131008.017845:0:14475:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd1dae580 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14475:1876039508842112:192.168.203.11@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789131008.018067:0:14475:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddd831e600 going to sleep for 11 seconds 00000100:00100000:3.0:1789131008.022395:0:14475:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd1dae580 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14475:1876039508842112:192.168.203.11@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789131008.031248:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131008.033716:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498276736 00000100:00100000:2.0:1789131008.033731:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498276736 00000100:00100000:2.0:1789131008.033872:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 142 00000100:00100000:2.0:1789131008.033884:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd1dae580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+22:11664:x1876039498276736:12345-192.168.203.11@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789131008.033932:0:6500:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789131008.034078:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd1dae580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+22:11664:x1876039498276736:12345-192.168.203.11@tcp:53:lhsmtool_posix.0 Request processed in 195us (2838us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131008.034094:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 142 00000100:00100000:1.0:1789131008.039368:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131008.039504:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498276992 00000100:00100000:0.0:1789131008.039515:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498276992 00000100:00100000:0.0:1789131008.039580:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 143 00000100:00100000:0.0:1789131008.039590:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7fd1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+22:11664:x1876039498276992:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789131008.039611:0:6501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789131008.039633:0:6501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7e00/0xf3fe2838e1fc2bdc lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269b32 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131008.039733:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7800/0xf3fe2838e1fc2be3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131008.039748:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7800/0xf3fe2838e1fc2be3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131008.039759:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7800/0xf3fe2838e1fc2be3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789131008.039784:0:6501:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:0.0:1789131008.039883:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7e00/0xf3fe2838e1fc2bdc lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269b32 expref: 25 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131008.039908:0:6501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7800/0xf3fe2838e1fc2be3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269b32 expref: 24 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131008.039917:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff91ddc4c81500) 00010000:00010000:0.0:1789131008.039920:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789131008.039923:0:6501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91de01ad7800, rc 0) 00000100:00100000:0.0:1789131008.039989:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7fd1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+24:11664:x1876039498276992:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 401us (630us total) trans 4294967412 rc 0/0 00000100:00100000:0.0:1789131008.039998:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 143 00000100:00100000:0.0:1789131008.044289:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131008.044379:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498277248 00000100:00100000:2.0:1789131008.044389:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498277248 00000100:00100000:2.0:1789131008.044448:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 144 00000100:00100000:2.0:1789131008.044490:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7c683c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+24:11664:x1876039498277248:12345-192.168.203.11@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789131008.044569:0:9769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f600/0xf3fe2838e1fc2bf1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131008.044599:0:9769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f600/0xf3fe2838e1fc2bf1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131008.044611:0:9769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f600/0xf3fe2838e1fc2bf1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131008.044749:0:9769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f600/0xf3fe2838e1fc2bf1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131008.044758:0:9769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f600/0xf3fe2838e1fc2bf1 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131008.044765:0:9769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f600/0xf3fe2838e1fc2bf1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131008.044771:0:9769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc7f7f600 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:2.0:1789131008.044776:0:9769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f600/0xf3fe2838e1fc2bf1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131008.044784:0:9769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f600/0xf3fe2838e1fc2bf1 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131008.044795:0:9769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff91ddc4c81500) 00010000:00010000:2.0:1789131008.044799:0:9769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789131008.044803:0:9769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f600/0xf3fe2838e1fc2bf1 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131008.044810:0:9769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f600/0xf3fe2838e1fc2bf1 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131008.044939:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7c683c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+25:11664:x1876039498277248:12345-192.168.203.11@tcp:57:lhsmtool_posix.0 Request processed in 481us (657us total) trans 4294967413 rc 0/0 00000100:00100000:2.0:1789131008.044954:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 144 00000040:00080000:3.0:1789131008.045644:0:14475:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789131008.045650:0:14475:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:1.0:1789131008.046494:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000040:00080000:3.0:1789131008.046727:0:14475:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1789131008.046737:0:14475:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789131008.047431:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498277376 00000100:00100000:0.0:1789131008.047441:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498277376 00000100:00100000:0.0:1789131008.047523:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 11 00000100:00100000:0.0:1789131008.047541:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01b3b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+25:2387:x1876039498277376:12345-192.168.203.11@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1789131008.047858:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00010000:00010000:0.0:1789131008.048068:0:6486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789131008.048093:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7800/0xf3fe2838e1fc2be3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269b32 expref: 25 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131008.048110:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff91ddc4c81500) 00010000:00010000:0.0:1789131008.048115:0:6486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789131008.048170:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01b3b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+24:2387:x1876039498277376:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 639us (1680us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131008.048195:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 11 00000100:00100000:1.0:1789131008.049885:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498277632 00000100:00100000:1.0:1789131008.049907:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498277632 00000100:00100000:1.0:1789131008.049998:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 34 00000100:00100000:1.0:1789131008.050008:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd1dad2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+24:11664:x1876039498277632:12345-192.168.203.11@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789131008.050244:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd1dad2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+25:11664:x1876039498277632:12345-192.168.203.11@tcp:35:lhsmtool_posix.0 Request processed in 237us (2385us total) trans 4294967414 rc 0/0 00000100:00100000:1.0:1789131008.050251:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 34 00000001:00080000:0.0:1789131008.088082:0:8410:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000001:00080000:0.0:1789131008.088100:0:8410:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000100:00100000:1.0:1789131008.594005:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc5fe8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1876039508842240:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789131008.594079:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131008.594160:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508842240 00000100:00100000:1.0:1789131008.594168:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508842240 00000100:00100000:1.0:1789131008.594220:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1789131008.594230:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc845d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3628:x1876039508842240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789131008.594257:0:8419:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1789131008.594300:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc845d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3628:x1876039508842240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131008.594308:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1789131008.594350:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc5fe8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1876039508842240:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789131008.594648:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789131008.594660:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7c6ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1876039508842368:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789131008.594693:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131008.594919:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508842368 00000100:00100000:0.0:1789131008.594924:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508842368 00000100:00100000:0.0:1789131008.594966:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1789131008.594974:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc6ff83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1876039508842368:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789131008.594986:0:14495:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1789131008.595024:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc6ff83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1876039508842368:12345-0@lo:13:osp-pre-1-1.0 Request processed in 52us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131008.595031:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1789131008.595105:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7c6ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1876039508842368:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1789131008.595372:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789131008.595579:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7ad1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3625:1876039508842880:0@lo:400:kworker.0 00000100:00100000:0.0:1789131008.595594:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01ad3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3627:1876039508842624:0@lo:400:kworker.0 00000100:00100000:1.0:1789131008.595621:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131008.595652:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131008.595664:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7c903c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508843392:0@lo:400:kworker.0 00000100:00100000:0.0:1789131008.595682:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7c921c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3627:1876039508843136:0@lo:400:kworker.0 00000100:00100000:1.0:1789131008.595696:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131008.595719:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131008.595721:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1789131008.595737:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd1dac3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3625:1876039508842496:0@lo:400:kworker.0 00000100:00100000:0.0:1789131008.595752:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff8e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3627:1876039508843648:0@lo:400:kworker.0 00000100:00100000:1.0:1789131008.595769:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131008.595791:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131008.595797:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc6bec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508843008:0@lo:400:kworker.0 00000100:00100000:0.0:1789131008.595821:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789131008.595829:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7ad2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508842752:0@lo:400:kworker.0 00000100:00100000:1.0:1789131008.595834:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131008.595858:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddca229a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508843520:0@lo:400:kworker.0 00000100:00100000:0.0:1789131008.595865:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131008.595887:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7c91680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3627:1876039508843264:0@lo:400:kworker.0 00000100:00100000:1.0:1789131008.595916:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131008.595937:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131008.595956:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508843392 00000100:00100000:1.0:1789131008.595961:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508843392 00000100:00100000:2.0:1789131008.595967:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508843008 00000100:00100000:0.0:1789131008.595967:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff8e03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3627:1876039508843776:0@lo:400:kworker.0 00000100:00100000:2.0:1789131008.595974:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508843008 00000100:00100000:0.0:1789131008.596000:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131008.596004:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508843520 00000100:00100000:1.0:1789131008.596009:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508843520 00000100:00100000:2.0:1789131008.596024:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508842752 00000100:00100000:2.0:1789131008.596029:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508842752 00000100:00100000:2.0:1789131008.596054:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1789131008.596061:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc84161c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1876039508843008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789131008.596093:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508842496 00000100:00100000:3.0:1789131008.596098:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508842496 00000100:00100000:2.0:1789131008.596116:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc84161c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1876039508843008:12345-0@lo:400:kworker.0 Request processed in 54us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131008.596127:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1789131008.596132:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 449 00000100:00100000:3.0:1789131008.596142:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddcf7c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+24:3625:x1876039508842496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131008.596147:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1789131008.596155:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc86a5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508842752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131008.596195:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc86a5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508842752:12345-0@lo:400:kworker.0 Request processed in 41us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131008.596202:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1789131008.596212:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddcf7c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+24:3625:x1876039508842496:12345-0@lo:400:kworker.0 Request processed in 70us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131008.596221:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 449 00000100:00100000:3.0:1789131008.596274:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1789131008.596281:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff750f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508843392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789131008.596311:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff750f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508843392:12345-0@lo:400:kworker.0 Request processed in 31us (617us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131008.596317:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1789131008.596332:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1789131008.596338:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7c7a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1876039508843520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789131008.596366:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7c7a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1876039508843520:12345-0@lo:400:kworker.0 Request processed in 29us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131008.596372:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00080000:3.0:1789131008.596398:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789131008.596407:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508842880 00000100:00100000:3.0:1789131008.596411:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508842880 00000100:00100000:0.0:1789131008.598780:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508842624 00000100:00100000:0.0:1789131008.598794:0:14273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508842624 00000100:00100000:1.0:1789131008.599918:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508843136 00000100:00100000:1.0:1789131008.599928:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508843136 00000100:00100000:2.0:1789131008.600234:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd1dac3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3625:1876039508842496:0@lo:400:kworker.0 00000100:00100000:2.0:1789131008.600253:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc6bec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508843008:0@lo:400:kworker.0 00000100:00100000:2.0:1789131008.600265:0:3625:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:2.0:1789131008.600270:0:3625:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967301 committed transno 4294967305 00000004:00080000:2.0:1789131008.600293:0:3625:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff91ddd286f480, transno 4294967302 00000004:00080000:2.0:1789131008.600318:0:3625:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967304 committed transno 4294967305 00000004:00080000:2.0:1789131008.600561:0:3625:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff91ddd1dae1c0, transno 4294967305 00000100:00100000:2.0:1789131008.600569:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddca229a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508843520:0@lo:400:kworker.0 00000100:00100000:2.0:1789131008.600666:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7c903c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508843392:0@lo:400:kworker.0 00000100:00100000:2.0:1789131008.600712:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7ad2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508842752:0@lo:400:kworker.0 00000100:00100000:2.0:1789131008.600747:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508843648 00000100:00100000:2.0:1789131008.600752:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508843648 00000100:00100000:3.0:1789131008.600951:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508843264 00000100:00100000:3.0:1789131008.600956:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508843264 00000100:00100000:0.0:1789131008.602298:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508843776 00000100:00100000:0.0:1789131008.602309:0:14273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508843776 00000100:00100000:3.0:1789131008.602342:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:3.0:1789131008.602360:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc5fe8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1876039508842880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789131008.602454:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc5fe8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1876039508842880:12345-0@lo:400:kworker.0 Request processed in 103us (6832us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131008.606677:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:0.0:1789131008.606706:0:14273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7c6ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1876039508842624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789131008.606716:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:3.0:1789131008.606761:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:3.0:1789131008.606773:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc86a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1876039508843264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789131008.606825:0:14273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7c6ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1876039508842624:12345-0@lo:400:kworker.0 Request processed in 132us (11172us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131008.606831:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc86a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1876039508843264:12345-0@lo:400:kworker.0 Request processed in 61us (10893us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131008.606838:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:0.0:1789131008.606858:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:0.0:1789131008.606867:0:14273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc12a92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3627:x1876039508843776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789131008.606873:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:1.0:1789131008.606886:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc86a61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1876039508843136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789131008.606920:0:14273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc12a92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3627:x1876039508843776:12345-0@lo:400:kworker.0 Request processed in 53us (10919us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131008.606927:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:1.0:1789131008.606946:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc86a61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1876039508843136:12345-0@lo:400:kworker.0 Request processed in 63us (11227us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131008.606955:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:2.0:1789131008.607083:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:2.0:1789131008.607093:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc86a5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3627:x1876039508843648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131008.607142:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc86a5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3627:x1876039508843648:12345-0@lo:400:kworker.0 Request processed in 51us (11354us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131008.607147:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00080000:2.0:1789131008.607172:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789131008.607177:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789131008.607430:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc7c91680 x1876039508843264/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789131024 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789131008.607444:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7c91680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3627:1876039508843264:0@lo:400:kworker.0 00010000:00080000:1.0:1789131008.607455:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91ddff8e03c0 x1876039508843776/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789131024 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789131008.607545:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff8e03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3627:1876039508843776:0@lo:400:kworker.0 00000100:00100000:1.0:1789131008.607559:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01ad3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3627:1876039508842624:0@lo:400:kworker.0 00000100:00100000:1.0:1789131008.607570:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7c921c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3627:1876039508843136:0@lo:400:kworker.0 00000100:00100000:1.0:1789131008.607715:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff8e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3627:1876039508843648:0@lo:400:kworker.0 00000100:00100000:1.0:1789131008.607754:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7ad1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3625:1876039508842880:0@lo:400:kworker.0 00000100:00100000:3.0:1789131008.607851:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00010000:00010000:2.0:1789131008.914563:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789131009.105843:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddc12a83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508843904:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789131009.105944:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131009.106095:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508843904 00000100:00100000:0.0:1789131009.106110:0:8418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508843904 00000100:00100000:0.0:1789131009.106165:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1789131009.106174:0:8418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01ad3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1876039508843904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789131009.106202:0:8418:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789131009.106273:0:8418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01ad3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1876039508843904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131009.106294:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1789131009.106306:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddc12a83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508843904:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789131009.619082:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789131009.619113:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc6ff9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508844032:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789131009.619211:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131009.619298:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508844032 00000100:00100000:2.0:1789131009.619308:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508844032 00000100:00100000:2.0:1789131009.619376:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1789131009.619388:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc6ff9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508844032:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789131009.619422:0:8419:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789131009.619516:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc6ff9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508844032:12345-0@lo:13:osp-pre-0-1.0 Request processed in 130us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131009.619526:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1789131009.619628:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc6ff9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508844032:0@lo:13:osp-pre-0-1.0 00000040:00080000:0.0:1789131009.700810:0:14992:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789131009.700819:0:14992:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789131009.700850:0:14992:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1789131009.700855:0:14992:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789131009.850103:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131009.850137:0:14851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498277888 00000100:00100000:3.0:1789131009.850145:0:14851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498277888 00000100:00100000:3.0:1789131009.850200:0:14851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 145 00000100:00100000:3.0:1789131009.850210:0:14851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff8e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+25:11685:x1876039498277888:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:3.0:1789131009.850234:0:14851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789131009.850255:0:14851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5c00/0xf3fe2838e1fc2bf8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269b39 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131009.850353:0:14851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5e00/0xf3fe2838e1fc2bff lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131009.850367:0:14851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5e00/0xf3fe2838e1fc2bff lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131009.850379:0:14851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5e00/0xf3fe2838e1fc2bff lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789131009.850390:0:14851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:3.0:1789131009.850506:0:14851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5c00/0xf3fe2838e1fc2bf8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269b39 expref: 28 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131009.850521:0:14851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5e00/0xf3fe2838e1fc2bff lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269b39 expref: 27 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131009.850530:0:14851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff91ddc4c81500) 00010000:00010000:3.0:1789131009.850533:0:14851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789131009.850536:0:14851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ddfd0b5e00, rc 0) 00000100:00100000:3.0:1789131009.850585:0:14851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff8e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+27:11685:x1876039498277888:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 377us (492us total) trans 4294967415 rc 0/0 00000100:00100000:3.0:1789131009.850602:0:14851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 145 00000100:00080000:2.0:1789131009.851394:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789131009.853676:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131009.853746:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498278016 00000100:00100000:3.0:1789131009.853756:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498278016 00000100:00100000:3.0:1789131009.853850:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 146 00000100:00100000:3.0:1789131009.853861:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc6ff9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+27:11685:x1876039498278016:12345-192.168.203.11@tcp:54:lfs.0 00010000:00010000:3.0:1789131009.853930:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc2c0d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131009.853946:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc2c0d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131009.853958:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc2c0d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131009.853990:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc2c0d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131009.853997:0:6501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc2c0d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131009.854004:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc2c0d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131009.854010:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddfd0b5a00 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:3.0:1789131009.854014:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc2c0d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131009.854021:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc2c0d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131009.854032:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff91ddc4c81500) 00010000:00010000:3.0:1789131009.854042:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789131009.854048:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc2c0d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131009.854054:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc2c0d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131009.854113:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc6ff9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+27:11685:x1876039498278016:12345-192.168.203.11@tcp:54:lfs.0 Request processed in 253us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131009.854120:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 146 00000100:00100000:3.0:1789131009.936038:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131009.937999:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498278144 00000100:00100000:0.0:1789131009.938012:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498278144 00000100:00100000:0.0:1789131009.938100:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 54 00000100:00100000:0.0:1789131009.938110:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff8e03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+6:2387:x1876039498278144:12345-192.168.203.11@tcp:101:cat.0 00010000:00010000:0.0:1789131009.938126:0:8417:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789131009.938144:0:8417:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ac7d66f9/0xf3fe2838e1fc2c14 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269b40 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789131009.938168:0:8417:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 13, mtime: 0x6aa3f8fd, atime: 0x6aa3f8fd, ctime: 0x6aa3f8fd, blocks: 0x8 00000100:00080000:2.0:1789131009.938187:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1789131009.938189:0:8417:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=365s v=(0 0) 00010000:00010000:0.0:1789131009.938195:0:8417:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789131009.938205:0:8417:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac7d66f9/0xf3fe2838e1fc2c14 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269b40 expref: 7 pid: 8417 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131009.938224:0:8417:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ac7d66f9/0xf3fe2838e1fc2c14 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269b40 expref: 7 pid: 8417 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131009.938237:0:8417:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91de01ad6200, rc 0) 00000100:00100000:0.0:1789131009.938301:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff8e03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+7:2387:x1876039498278144:12345-192.168.203.11@tcp:101:cat.0 Request processed in 192us (2272us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131009.938309:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 54 00010000:00010000:3.0:1789131009.944971:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789131009.948325:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131009.948492:0:8422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498278272 00000100:00100000:3.0:1789131009.948501:0:8422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498278272 00002000:00100000:3.0:1789131009.948550:0:8422:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->4095) req@ffff91ddc12a8780 x1876039498278272/t0(0) o3->b99c111d-b9b6-4590-88e4-9fefd4d4c3a4@192.168.203.11@tcp:725/0 lens 488/0 e 0 to 0 dl 1789131020 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789131009.948561:0:8422:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff91ddc12a8780 with x1876039498278272 ext(0->4095) 00002000:00010000:3.0:1789131009.948566:0:8422:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91ddc12a8780 00000100:00100000:3.0:1789131009.948597:0:8422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 3 00000100:00100000:3.0:1789131009.948606:0:8422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc12a8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+7:2386:x1876039498278272:12345-192.168.203.11@tcp:3:cat.0 00000100:00100000:3.0:1789131009.948861:0:8422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc12a8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+7:2386:x1876039498278272:12345-192.168.203.11@tcp:3:cat.0 Request processed in 254us (545us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1789131009.948870:0:8422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 3 00002000:00100000:3.0:1789131009.948876:0:8422:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->4095) req@ffff91ddc12a8780 x1876039498278272/t0(0) o3->b99c111d-b9b6-4590-88e4-9fefd4d4c3a4@192.168.203.11@tcp:725/0 lens 488/4536 e 0 to 0 dl 1789131020 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789131009.948894:0:8422:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff91ddc12a8780 with x1876039498278272 ext(0->4095) 00002000:00010000:3.0:1789131009.948898:0:8422:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91ddc12a8780 00010000:00010000:2.0:1789131010.963835:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789131011.665719:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789131011.665742:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01a5c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1876039508844160:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789131011.665820:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131011.666030:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508844160 00000100:00100000:3.0:1789131011.666038:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508844160 00000100:00100000:3.0:1789131011.666097:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1789131011.666108:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7ad2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3628:x1876039508844160:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789131011.666147:0:6506:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:3.0:1789131011.666208:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7ad2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3628:x1876039508844160:12345-0@lo:41:osp-pre-0-1.0 Request processed in 102us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131011.666215:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1789131011.666304:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01a5c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1876039508844160:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789131011.668777:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddc12a9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1876039508844288:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789131011.668844:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131011.672122:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508844288 00000100:00100000:3.0:1789131011.672135:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508844288 00000100:00100000:3.0:1789131011.672205:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1789131011.672216:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7ad1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3628:x1876039508844288:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789131011.672252:0:6505:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789131011.672330:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7ad1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3628:x1876039508844288:12345-0@lo:41:osp-pre-1-0.0 Request processed in 115us (3485us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131011.672337:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1789131011.672491:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddc12a9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1876039508844288:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789131011.987001:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789131012.177811:0:14475:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789131012.177821:0:14475:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789131012.177840:0:14475:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1789131012.177849:0:14475:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1789131012.629519:0:14478:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789131012.968299:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131012.968349:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131012.969527:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131012.969579:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131012.969624:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498278528 00000100:00100000:2.0:1789131012.969637:0:14273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498278528 00000100:00100000:2.0:1789131012.969733:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498279040 00000100:00100000:2.0:1789131012.969737:0:14273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498279040 00000100:00100000:2.0:1789131012.969768:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 334 00000100:00100000:2.0:1789131012.969781:0:14273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7c921c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+27:2388:x1876039498278528:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1789131012.970004:0:14273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7c921c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+27:2388:x1876039498278528:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 226us (1722us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131012.970014:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 334 00000100:00100000:2.0:1789131012.970039:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 335 00000100:00100000:2.0:1789131012.970046:0:14273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7c903c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fde8d4a8-44db-4e6b-8249-c1c295e4901d+5:2388:x1876039498279040:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1789131012.970083:0:14273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7c903c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fde8d4a8-44db-4e6b-8249-c1c295e4901d+5:2388:x1876039498279040:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 38us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131012.970089:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 335 00000100:00100000:2.0:1789131012.970113:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498278400 00000100:00100000:2.0:1789131012.970117:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498278400 00000100:00100000:2.0:1789131012.970145:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 450 00000100:00100000:2.0:1789131012.970153:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddcf7cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+13:2388:x1876039498278400:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1789131012.970184:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddcf7cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+13:2388:x1876039498278400:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 32us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131012.970190:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 450 00000100:00080000:2.0:1789131012.970219:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789131012.970872:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131012.970903:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131012.974652:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131012.974713:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498278656 00000100:00100000:2.0:1789131012.974725:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498278656 00000100:00100000:2.0:1789131012.974797:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498279168 00000100:00100000:2.0:1789131012.974801:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498279168 00000100:00100000:2.0:1789131012.974996:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 336 00000100:00100000:2.0:1789131012.975009:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddca229a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+5:2388:x1876039498278656:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1789131012.975326:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddca229a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+5:2388:x1876039498278656:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 318us (4464us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131012.975335:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 336 00000100:00100000:2.0:1789131012.975358:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 337 00000100:00100000:2.0:1789131012.975366:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd1dae1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fde8d4a8-44db-4e6b-8249-c1c295e4901d+5:2388:x1876039498279168:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1789131012.975551:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd1dae1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fde8d4a8-44db-4e6b-8249-c1c295e4901d+5:2388:x1876039498279168:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 186us (911us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131012.975558:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 337 00000100:00080000:2.0:1789131012.975588:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789131012.977197:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498278784 00000100:00100000:1.0:1789131012.977213:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498278784 00000100:00100000:1.0:1789131012.977304:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498278912 00000100:00100000:1.0:1789131012.977309:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498278912 00000100:00100000:1.0:1789131012.977346:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 126 00000100:00100000:1.0:1789131012.977358:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7c91680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+5:2388:x1876039498278784:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1789131012.977689:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7c91680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+5:2388:x1876039498278784:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 332us (9337us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131012.977698:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 126 00000100:00100000:1.0:1789131012.977718:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 127 00000100:00100000:1.0:1789131012.977773:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc6bec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+7:2388:x1876039498278912:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1789131012.977801:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc6bec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+7:2388:x1876039498278912:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 31us (6898us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131012.977808:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 127 00000100:00080000:3.0:1789131012.978578:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789131012.978584:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789131013.009832:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789131013.213589:0:9493:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967313 is committed 00000001:00080000:3.0:1789131013.213611:0:9493:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00000001:00080000:0.0:1789131013.214979:0:6479:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000020:00080000:0.0:1789131013.215039:0:6479:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff91ddc33c4d80 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:0.0:1789131013.215046:0:6479:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff91ddff894900 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff91ddc33c4180 00000020:00080000:0.0:1789131013.215063:0:6479:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff91ddff894100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff91dcc8409400 00000020:00080000:0.0:1789131013.215105:0:6479:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:3.0:1789131013.215198:0:6532:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:3.0:1789131013.215299:0:6532:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00010000:00010000:2.0:1789131013.215408:0:3612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fc00/0xf3fe2838e1fc2b8f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131013.215424:0:3612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fc00/0xf3fe2838e1fc2b8f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131013.215434:0:3612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fc00/0xf3fe2838e1fc2b8f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131013.215442:0:3612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc7f7fc00 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:2.0:1789131013.215448:0:3612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fc00/0xf3fe2838e1fc2b8f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131013.215618:0:3612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fc00/0xf3fe2838e1fc2b8f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131013.215643:0:3612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff91dde1922b00) 00010000:00010000:2.0:1789131013.215648:0:3612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789131013.215655:0:3612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fc00/0xf3fe2838e1fc2b8f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131013.215663:0:3612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fc00/0xf3fe2838e1fc2b8f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131013.713650:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789131013.713674:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd1df8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508844416:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789131013.713743:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131013.713798:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd1dac3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3626:1876039508844544:0@lo:400:kworker.0 00000100:00100000:1.0:1789131013.713830:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131013.713871:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7890b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3625:1876039508844928:0@lo:400:kworker.0 00000100:00100000:1.0:1789131013.713875:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7b24b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508845056:0@lo:400:kworker.0 00000100:00100000:2.0:1789131013.713922:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd1daf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3627:1876039508844672:0@lo:400:kworker.0 00000100:00100000:1.0:1789131013.713922:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131013.713925:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131013.713943:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddfd066d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508845568:0@lo:400:kworker.0 00000100:00100000:0.0:1789131013.714019:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd1dad680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1876039508844800:0@lo:400:kworker.0 00000100:00100000:2.0:1789131013.714109:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131013.714141:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7b27c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3627:1876039508845184:0@lo:400:kworker.0 00000100:00100000:2.0:1789131013.714166:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131013.714182:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8cde580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3627:1876039508845696:0@lo:400:kworker.0 00000100:00100000:2.0:1789131013.714203:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131013.714233:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508844416 00000100:00100000:2.0:1789131013.714241:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508844416 00000100:00100000:2.0:1789131013.714301:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1789131013.714309:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd1dfa1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508844416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789131013.714336:0:14495:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1789131013.714376:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd1dfa1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508844416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131013.714382:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1789131013.714403:0:11069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508845056 00000100:00100000:2.0:1789131013.714406:0:11069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508845056 00000100:00100000:2.0:1789131013.714428:0:11069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1789131013.714433:0:11069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd1dfb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508845056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131013.714482:0:11069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd1dfb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508845056:12345-0@lo:400:kworker.0 Request processed in 49us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131013.714488:0:11069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1789131013.714505:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508844928 00000100:00100000:2.0:1789131013.714509:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508844928 00000100:00100000:2.0:1789131013.714531:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508844672 00000100:00100000:2.0:1789131013.714533:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508844672 00000100:00100000:2.0:1789131013.714548:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508845184 00000100:00100000:2.0:1789131013.714550:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508845184 00000100:00100000:2.0:1789131013.714563:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508845696 00000100:00100000:2.0:1789131013.714565:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508845696 00000100:00100000:2.0:1789131013.714579:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:2.0:1789131013.714602:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01a5c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1876039508844928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131013.714654:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01a5c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1876039508844928:12345-0@lo:400:kworker.0 Request processed in 53us (736us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131013.714660:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:2.0:1789131013.714678:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:2.0:1789131013.714685:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8cde940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1876039508844672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131013.714717:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8cde940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1876039508844672:12345-0@lo:400:kworker.0 Request processed in 33us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131013.714723:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:2.0:1789131013.714735:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:2.0:1789131013.714741:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8cdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1876039508845184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789131013.714791:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7890b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3625:1876039508844928:0@lo:400:kworker.0 00000100:00100000:3.0:1789131013.714800:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddfd067840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508845440:0@lo:400:kworker.0 00000100:00100000:3.0:1789131013.714840:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131013.714885:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8cdf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508845952:0@lo:400:kworker.0 00000100:00100000:3.0:1789131013.714909:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131013.714929:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789131013.714936:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddc12a8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508846080:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789131013.715111:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8cdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1876039508845184:12345-0@lo:400:kworker.0 Request processed in 355us (929us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131013.715113:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131013.715121:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:2.0:1789131013.715138:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:2.0:1789131013.715146:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8cdc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3627:x1876039508845696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131013.715178:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8cdc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3627:x1876039508845696:12345-0@lo:400:kworker.0 Request processed in 35us (975us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131013.715185:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00080000:3.0:1789131013.715209:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789131013.715215:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789131013.715216:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508846080 00000100:00100000:2.0:1789131013.715221:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508846080 00000100:00100000:3.0:1789131013.715236:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508845440 00000100:00100000:3.0:1789131013.715242:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508845440 00000100:00100000:2.0:1789131013.715255:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1789131013.715264:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7890b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508846080:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789131013.715275:0:8419:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1789131013.715277:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508845952 00000100:00100000:3.0:1789131013.715282:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508845952 00000100:00100000:3.0:1789131013.715314:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1789131013.715317:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7890b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3625:x1876039508846080:12345-0@lo:13:osp-pre-1-1.0 Request processed in 54us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131013.715324:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd286f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508845440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131013.715337:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1789131013.715367:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd286f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508845440:12345-0@lo:400:kworker.0 Request processed in 44us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131013.715375:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1789131013.715381:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd1daf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3627:1876039508844672:0@lo:400:kworker.0 00000100:00100000:3.0:1789131013.715395:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1789131013.715398:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7b27c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3627:1876039508845184:0@lo:400:kworker.0 00000100:00100000:3.0:1789131013.715407:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd286c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508845952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131013.715412:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8cde580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3627:1876039508845696:0@lo:400:kworker.0 00000100:00100000:3.0:1789131013.715444:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd286c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508845952:12345-0@lo:400:kworker.0 Request processed in 41us (534us total) trans 0 rc 0/0 00000100:00080000:2.0:1789131013.715452:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789131013.715453:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00080000:2.0:1789131013.715478:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789131013.715519:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddc12a8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508846080:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789131013.715530:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8cdf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508845952:0@lo:400:kworker.0 00000100:00100000:3.0:1789131013.715549:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddfd067840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508845440:0@lo:400:kworker.0 00000100:00100000:3.0:1789131013.715587:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508844544 00000100:00100000:3.0:1789131013.715591:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508844544 00000100:00100000:3.0:1789131013.715617:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 451 00000100:00100000:3.0:1789131013.715625:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8606050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+24:3626:x1876039508844544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789131013.715656:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8606050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+24:3626:x1876039508844544:12345-0@lo:400:kworker.0 Request processed in 33us (1826us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131013.715663:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 451 00000100:00100000:0.0:1789131013.718151:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131013.718248:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddfd065a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3628:1876039508845312:0@lo:400:kworker.0 00000100:00100000:0.0:1789131013.718286:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131013.718320:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8cdda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3628:1876039508845824:0@lo:400:kworker.0 00000100:00100000:0.0:1789131013.718341:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131013.718391:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508845312 00000100:00100000:0.0:1789131013.718399:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508845312 00000100:00100000:0.0:1789131013.718446:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508845824 00000100:00100000:0.0:1789131013.718450:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508845824 00000100:00100000:0.0:1789131013.718492:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:0.0:1789131013.718499:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc12ab840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3628:x1876039508845312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789131013.718550:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc12ab840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3628:x1876039508845312:12345-0@lo:400:kworker.0 Request processed in 52us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131013.718558:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:1.0:1789131013.718663:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131013.718713:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd1dac3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3626:1876039508844544:0@lo:400:kworker.0 00000100:00100000:1.0:1789131013.718727:0:3626:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967313 gen 2 00000004:00080000:1.0:1789131013.718732:0:3626:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff91de01b3a580, transno 4294967311 00000004:00080000:1.0:1789131013.718741:0:3626:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967313 committed transno 4294967313 00000100:00100000:1.0:1789131013.718766:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd1df8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508844416:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789131013.718811:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7b24b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508845056:0@lo:400:kworker.0 00000100:00100000:1.0:1789131013.718929:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508845568 00000100:00100000:1.0:1789131013.718934:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508845568 00000100:00100000:1.0:1789131013.718963:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1789131013.718970:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd1df9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508845568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789131013.719008:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd1df9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508845568:12345-0@lo:400:kworker.0 Request processed in 38us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131013.719014:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1789131013.719055:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddfd066d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508845568:0@lo:400:kworker.0 00000100:00100000:1.0:1789131013.719092:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:1.0:1789131013.719100:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc12a8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3628:x1876039508845824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789131013.719129:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc12a8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3628:x1876039508845824:12345-0@lo:400:kworker.0 Request processed in 30us (787us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131013.719135:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00080000:1.0:1789131013.719152:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789131013.719156:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1789131013.719187:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91ddfd065a40 x1876039508845312/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789131029 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789131013.719199:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddfd065a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3628:1876039508845312:0@lo:400:kworker.0 00010000:00080000:1.0:1789131013.719210:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc8cdda40 x1876039508845824/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789131029 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789131013.719225:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8cdda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3628:1876039508845824:0@lo:400:kworker.0 00000100:00100000:2.0:1789131013.719755:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508844800 00000100:00100000:2.0:1789131013.719761:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508844800 00000100:00100000:2.0:1789131013.719909:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1789131013.719918:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc12abc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3628:x1876039508844800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131013.719983:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc12abc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3628:x1876039508844800:12345-0@lo:400:kworker.0 Request processed in 67us (1838us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131013.719990:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1789131013.720057:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd1dad680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1876039508844800:0@lo:400:kworker.0 00010000:00010000:2.0:1789131014.034817:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789131014.225811:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789131014.225849:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddc12a9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1876039508846208:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789131014.225964:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131014.227250:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508846208 00000100:00100000:2.0:1789131014.227263:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508846208 00000100:00100000:2.0:1789131014.227335:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1789131014.227345:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddfd065a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1876039508846208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789131014.227376:0:8419:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789131014.227491:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddfd065a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1876039508846208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 146us (1526us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131014.227498:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1789131014.227709:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddc12a9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1876039508846208:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789131014.744416:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddc12aa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1876039508846336:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789131014.744499:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131014.744574:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508846336 00000100:00100000:0.0:1789131014.744581:0:8418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508846336 00000100:00100000:0.0:1789131014.744625:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1789131014.744634:0:8418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc12ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1876039508846336:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789131014.744654:0:8418:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789131014.744698:0:8418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc12ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1876039508846336:12345-0@lo:13:osp-pre-0-1.0 Request processed in 65us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131014.744721:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1789131014.744768:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddc12aa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1876039508846336:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1789131015.058183:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789131015.134068:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131015.136569:0:14851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498279296 00000100:00100000:0.0:1789131015.137074:0:14851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498279296 00000100:00100000:0.0:1789131015.137178:0:14851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 147 00000100:00100000:0.0:1789131015.137191:0:14851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8cde580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+13:11337:x1876039498279296:12345-192.168.203.11@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1789131015.137311:0:14851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8cde580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+13:11337:x1876039498279296:12345-192.168.203.11@tcp:60:lhsmtool_posix.0 Request processed in 123us (3253us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131015.137319:0:14851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 147 00000100:00080000:1.0:1789131015.137422:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789131015.147669:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131015.147783:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498279424 00000100:00100000:2.0:1789131015.147817:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498279424 00000100:00100000:2.0:1789131015.147912:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 148 00000100:00100000:2.0:1789131015.147926:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd1df8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+5:11337:x1876039498279424:12345-192.168.203.11@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1789131015.148038:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd1df8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+5:11337:x1876039498279424:12345-192.168.203.11@tcp:60:lhsmtool_posix.0 Request processed in 116us (1467us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131015.148047:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 148 00000100:00080000:1.0:1789131015.148313:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789131015.157243:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789131015.157491:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498279680 00000100:00100000:1.0:1789131015.157501:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498279680 00000100:00100000:1.0:1789131015.157602:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 35 00000100:00100000:1.0:1789131015.157613:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddfd067840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+13:11337:x1876039498279680:12345-192.168.203.11@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789131015.157828:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddfd067840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+14:11337:x1876039498279680:12345-192.168.203.11@tcp:35:lhsmtool_posix.0 Request processed in 217us (594us total) trans 4294967416 rc 0/0 00000100:00100000:1.0:1789131015.157837:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 35 00000100:00100000:0.0:1789131015.370113:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131015.371910:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498279808 00000100:00100000:2.0:1789131015.371930:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498279808 00000100:00100000:2.0:1789131015.372049:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 149 00000100:00100000:2.0:1789131015.372063:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc12aa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fde8d4a8-44db-4e6b-8249-c1c295e4901d+5:12144:x1876039498279808:12345-192.168.203.11@tcp:101:lsof.0 00010000:00010000:2.0:1789131015.372091:0:6502:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789131015.372119:0:6502:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f600/0xf3fe2838e1fc2c1b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269b47 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131015.372205:0:6502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e400/0xf3fe2838e1fc2c22 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131015.372223:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e400/0xf3fe2838e1fc2c22 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131015.372239:0:6502:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e400/0xf3fe2838e1fc2c22 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789131015.372300:0:6502:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789131015.372305:0:6502:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789131015.372358:0:6502:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e400/0xf3fe2838e1fc2c22 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131015.372388:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f600/0xf3fe2838e1fc2c1b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269b47 expref: 7 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131015.372429:0:6502:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e400/0xf3fe2838e1fc2c22 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269b47 expref: 6 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131015.372438:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91dcc7d6ac00) 00010000:00010000:2.0:1789131015.372455:0:6502:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789131015.372519:0:6502:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dcc7f7e400, rc 0) 00000100:00100000:2.0:1789131015.372649:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc12aa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fde8d4a8-44db-4e6b-8249-c1c295e4901d+6:12144:x1876039498279808:12345-192.168.203.11@tcp:101:lsof.0 Request processed in 589us (2545us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131015.372657:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 149 00000100:00080000:1.0:1789131015.372774:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789131016.082110:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789131016.785810:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789131016.785854:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddc12a83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508846464:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789131016.785956:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131016.786018:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508846464 00000100:00100000:0.0:1789131016.786030:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508846464 00000100:00100000:2.0:1789131016.786061:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddfd066d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1876039508846592:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789131016.786090:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131016.788820:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508846592 00000100:00100000:0.0:1789131016.788847:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508846592 00000100:00100000:0.0:1789131016.788909:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1789131016.788921:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8cded00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508846464:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789131016.788972:0:6505:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789131016.789122:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1789131016.789135:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8cdfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1876039508846592:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789131016.789159:0:6506:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:0.0:1789131016.790765:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8cded00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508846464:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1837us (4800us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131016.790779:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1789131016.799355:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8cdfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1876039508846592:12345-0@lo:41:osp-pre-0-1.0 Request processed in 10207us (13247us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131016.799376:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1789131016.799566:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddfd066d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1876039508846592:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789131016.799594:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddc12a83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508846464:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789131017.105680:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789131018.081077:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131018.081127:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131018.081159:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131018.081181:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131018.081197:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131018.081579:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131018.081621:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131018.081808:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498279936 00000100:00100000:2.0:1789131018.081822:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498279936 00000100:00100000:2.0:1789131018.081892:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 452 00000100:00100000:2.0:1789131018.081904:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8604c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+13:2388:x1876039498279936:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1789131018.081990:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8604c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+13:2388:x1876039498279936:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 88us (925us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131018.081999:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 452 00000100:00100000:2.0:1789131018.082055:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498280448 00000100:00100000:2.0:1789131018.082060:0:9827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498280448 00000100:00100000:2.0:1789131018.082099:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498280320 00000100:00100000:2.0:1789131018.082102:0:9827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498280320 00000100:00100000:2.0:1789131018.082123:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 131 00000100:00100000:2.0:1789131018.082129:0:9827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc12a9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+6:2388:x1876039498280448:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1789131018.082159:0:9827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc12a9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+6:2388:x1876039498280448:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 30us (999us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131018.082166:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 131 00000100:00100000:2.0:1789131018.082176:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 132 00000100:00100000:2.0:1789131018.082182:0:9827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8d3de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+5:2388:x1876039498280320:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1789131018.082214:0:9827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8d3de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+5:2388:x1876039498280320:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 21us (626us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131018.082220:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 132 00000100:00100000:1.0:1789131018.087878:0:14851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498280192 00000100:00100000:1.0:1789131018.087896:0:14851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498280192 00000100:00100000:1.0:1789131018.087988:0:14851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498280704 00000100:00100000:1.0:1789131018.087992:0:14851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498280704 00000100:00100000:1.0:1789131018.088017:0:14851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498280064 00000100:00100000:1.0:1789131018.088049:0:14851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498280064 00000100:00100000:1.0:1789131018.088068:0:14851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498280576 00000100:00100000:1.0:1789131018.088071:0:14851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498280576 00000100:00100000:1.0:1789131018.088097:0:14851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 344 00000100:00100000:1.0:1789131018.088110:0:14851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc12a8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+5:2388:x1876039498280192:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1789131018.088405:0:14851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc12a8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+5:2388:x1876039498280192:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 296us (7276us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131018.088414:0:14851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 344 00000100:00100000:1.0:1789131018.088438:0:14851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 345 00000100:00100000:1.0:1789131018.088445:0:14851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7816940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fde8d4a8-44db-4e6b-8249-c1c295e4901d+5:2388:x1876039498280704:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1789131018.088567:0:14851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7816940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fde8d4a8-44db-4e6b-8249-c1c295e4901d+5:2388:x1876039498280704:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 121us (7384us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131018.088573:0:14851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 345 00000100:00100000:1.0:1789131018.088591:0:14851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 346 00000100:00100000:1.0:1789131018.088598:0:14851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7815a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+14:2388:x1876039498280064:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1789131018.088632:0:14851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7815a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+14:2388:x1876039498280064:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 34us (7433us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131018.088638:0:14851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 346 00000100:00100000:1.0:1789131018.088650:0:14851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 347 00000100:00100000:1.0:1789131018.088658:0:14851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8d3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fde8d4a8-44db-4e6b-8249-c1c295e4901d+6:2388:x1876039498280576:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1789131018.088751:0:14851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8d3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fde8d4a8-44db-4e6b-8249-c1c295e4901d+6:2388:x1876039498280576:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 92us (7129us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131018.088758:0:14851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 347 00000100:00080000:0.0:1789131018.089506:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789131018.089515:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789131018.089519:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789131018.089523:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1789131018.129944:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789131018.798039:0:15190:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 08:50:16 (1789131016) 00000100:00100000:2.0:1789131018.833710:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8cde1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3627:1876039508846720:0@lo:400:kworker.0 00000100:00100000:2.0:1789131018.833805:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131018.833880:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8cdf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1876039508847232:0@lo:400:kworker.0 00000100:00100000:2.0:1789131018.833913:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131018.833936:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8cdc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1876039508847744:0@lo:400:kworker.0 00000100:00100000:2.0:1789131018.833963:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131018.833983:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7b27c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1876039508848256:0@lo:400:kworker.0 00000100:00100000:2.0:1789131018.834006:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131018.834035:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1789131018.834042:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8cdcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3627:1876039508846848:0@lo:400:kworker.0 00000100:00100000:2.0:1789131018.834095:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131018.834121:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8cdde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3627:1876039508847360:0@lo:400:kworker.0 00000100:00100000:2.0:1789131018.834146:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131018.834166:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8cdda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3627:1876039508847872:0@lo:400:kworker.0 00000100:00100000:2.0:1789131018.834188:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131018.834219:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8cdd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508846976:0@lo:400:kworker.0 00000100:00100000:2.0:1789131018.834246:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131018.834267:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8cdf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3625:1876039508847488:0@lo:400:kworker.0 00000100:00100000:2.0:1789131018.834291:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131018.834305:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8cdf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3625:1876039508848000:0@lo:400:kworker.0 00000100:00100000:2.0:1789131018.834323:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131018.834337:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1789131018.834342:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8cdcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3625:1876039508847104:0@lo:400:kworker.0 00000100:00100000:2.0:1789131018.834360:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131018.834375:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8cdd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508847616:0@lo:400:kworker.0 00000100:00100000:2.0:1789131018.834395:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131018.834410:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7b24b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508848128:0@lo:400:kworker.0 00000100:00100000:2.0:1789131018.834433:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131018.834494:0:11069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508847232 00000100:00100000:2.0:1789131018.834503:0:11069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508847232 00000100:00100000:2.0:1789131018.834556:0:11069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508846976 00000100:00100000:2.0:1789131018.834559:0:11069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508846976 00000100:00100000:2.0:1789131018.834579:0:11069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1789131018.834589:0:11069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd1dad680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3627:x1876039508847232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131018.834653:0:11069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd1dad680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3627:x1876039508847232:12345-0@lo:400:kworker.0 Request processed in 65us (740us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131018.834668:0:11069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1789131018.834691:0:11069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1789131018.834697:0:11069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8d17840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508846976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131018.834732:0:11069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8d17840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508846976:12345-0@lo:400:kworker.0 Request processed in 36us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131018.834740:0:11069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1789131018.834759:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508847744 00000100:00100000:2.0:1789131018.834763:0:9827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508847744 00000100:00100000:2.0:1789131018.834790:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508848256 00000100:00100000:2.0:1789131018.834793:0:9827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508848256 00000100:00100000:2.0:1789131018.834806:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508847616 00000100:00100000:2.0:1789131018.834808:0:9827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508847616 00000100:00100000:2.0:1789131018.834833:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508848128 00000100:00100000:2.0:1789131018.834836:0:9827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508848128 00000100:00100000:2.0:1789131018.834850:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1789131018.834856:0:9827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd1dac3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3627:x1876039508847744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131018.834886:0:9827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd1dac3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3627:x1876039508847744:12345-0@lo:400:kworker.0 Request processed in 30us (922us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131018.834892:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1789131018.834902:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1789131018.834908:0:9827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd1daf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3627:x1876039508848256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131018.834934:0:9827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd1daf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3627:x1876039508848256:12345-0@lo:400:kworker.0 Request processed in 26us (927us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131018.834941:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1789131018.834952:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1789131018.834958:0:9827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8d143c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508847616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131018.834996:0:9827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8d143c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508847616:12345-0@lo:400:kworker.0 Request processed in 38us (600us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131018.835003:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1789131018.835015:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1789131018.835022:0:9827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8d16580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508848128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131018.835048:0:9827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8d16580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508848128:12345-0@lo:400:kworker.0 Request processed in 28us (614us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131018.835054:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1789131018.835079:0:14851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508846848 00000100:00100000:2.0:1789131018.835083:0:14851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508846848 00000100:00100000:2.0:1789131018.835105:0:14851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508847360 00000100:00100000:2.0:1789131018.835108:0:14851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508847360 00000100:00100000:2.0:1789131018.835121:0:14851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508847872 00000100:00100000:2.0:1789131018.835123:0:14851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508847872 00000100:00100000:2.0:1789131018.835133:0:14851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508847488 00000100:00100000:2.0:1789131018.835135:0:14851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508847488 00000100:00100000:2.0:1789131018.835146:0:14851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508848000 00000100:00100000:2.0:1789131018.835148:0:14851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508848000 00000100:00100000:2.0:1789131018.835160:0:14851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508847104 00000100:00100000:2.0:1789131018.835163:0:14851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508847104 00000100:00100000:2.0:1789131018.835174:0:14851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:2.0:1789131018.835179:0:14851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8d14f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1876039508846848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131018.835213:0:14851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8d14f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1876039508846848:12345-0@lo:400:kworker.0 Request processed in 33us (1117us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131018.835219:0:14851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:2.0:1789131018.835229:0:14851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:2.0:1789131018.835235:0:14851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8d15680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1876039508847360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131018.835258:0:14851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8d15680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1876039508847360:12345-0@lo:400:kworker.0 Request processed in 24us (1112us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131018.835271:0:14851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:2.0:1789131018.835284:0:14851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:2.0:1789131018.835289:0:14851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8d14b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3627:x1876039508847872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131018.835316:0:14851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8d14b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3627:x1876039508847872:12345-0@lo:400:kworker.0 Request processed in 27us (1127us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131018.835321:0:14851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:2.0:1789131018.835331:0:14851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:2.0:1789131018.835337:0:14851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8d15e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1876039508847488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131018.835359:0:14851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8d15e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1876039508847488:12345-0@lo:400:kworker.0 Request processed in 23us (1068us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131018.835365:0:14851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:2.0:1789131018.835374:0:14851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:2.0:1789131018.835379:0:14851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8d17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1876039508848000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131018.835401:0:14851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8d17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1876039508848000:12345-0@lo:400:kworker.0 Request processed in 22us (1076us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131018.835406:0:14851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:2.0:1789131018.835419:0:14851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:2.0:1789131018.835424:0:14851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8d152c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1876039508847104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131018.835451:0:14851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8d152c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1876039508847104:12345-0@lo:400:kworker.0 Request processed in 27us (1090us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131018.835485:0:14851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:2.0:1789131018.835526:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd1dfa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1876039508848384:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789131018.835562:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131018.835622:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8cdcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3625:1876039508847104:0@lo:400:kworker.0 00000100:00100000:2.0:1789131018.835644:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8cdd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508847616:0@lo:400:kworker.0 00000100:00100000:2.0:1789131018.835654:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7b24b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508848128:0@lo:400:kworker.0 00000100:00100000:2.0:1789131018.835665:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8cdd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508846976:0@lo:400:kworker.0 00010000:00080000:2.0:1789131018.835679:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc8cdf480 x1876039508847488/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789131034 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789131018.835690:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8cdf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3625:1876039508847488:0@lo:400:kworker.0 00010000:00080000:2.0:1789131018.835700:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc8cdf0c0 x1876039508848000/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789131034 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789131018.835710:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8cdf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3625:1876039508848000:0@lo:400:kworker.0 00000100:00100000:2.0:1789131018.835757:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8cdcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3627:1876039508846848:0@lo:400:kworker.0 00000100:00100000:2.0:1789131018.835767:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8cdde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3627:1876039508847360:0@lo:400:kworker.0 00000100:00100000:2.0:1789131018.835776:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8cdda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3627:1876039508847872:0@lo:400:kworker.0 00000100:00100000:2.0:1789131018.835787:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8cdf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1876039508847232:0@lo:400:kworker.0 00000100:00100000:2.0:1789131018.835797:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8cdc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1876039508847744:0@lo:400:kworker.0 00000100:00100000:2.0:1789131018.835807:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7b27c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1876039508848256:0@lo:400:kworker.0 00000100:00080000:0.0:1789131018.835963:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789131018.835970:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789131018.835973:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789131018.835975:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789131018.835987:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508848384 00000100:00100000:0.0:1789131018.835994:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508848384 00000100:00100000:0.0:1789131018.836025:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1789131018.836032:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8d15a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1876039508848384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789131018.836061:0:14495:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1789131018.836114:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8d15a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1876039508848384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131018.836121:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1789131018.836154:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd1dfa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1876039508848384:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789131018.836834:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789131018.836850:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8d3d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1876039508848512:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789131018.836899:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131018.836937:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508848512 00000100:00100000:0.0:1789131018.836942:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508848512 00000100:00100000:0.0:1789131018.836974:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1789131018.836982:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8d3c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1876039508848512:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789131018.836998:0:8419:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1789131018.837061:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8d3c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1876039508848512:12345-0@lo:13:osp-pre-1-1.0 Request processed in 80us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131018.837068:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1789131018.837107:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8d3d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1876039508848512:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789131018.837528:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508846720 00000100:00100000:3.0:1789131018.837534:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508846720 00000100:00100000:3.0:1789131018.837572:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 453 00000100:00100000:3.0:1789131018.837580:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8605050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+24:3627:x1876039508846720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789131018.837630:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8605050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+24:3627:x1876039508846720:12345-0@lo:400:kworker.0 Request processed in 52us (3827us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131018.837637:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 453 00000100:00100000:3.0:1789131018.839610:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8cde1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3627:1876039508846720:0@lo:400:kworker.0 00000001:00080000:3.0:1789131018.844355:0:6479:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967416 is committed 00000020:00080000:3.0:1789131018.844382:0:6479:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:2.0:1789131018.844450:0:6532:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:2.0:1789131018.844507:0:6532:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:1.0:1789131019.156907:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789131019.346173:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8d3d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508848640:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789131019.346274:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131019.346416:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508848640 00000100:00100000:0.0:1789131019.346427:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508848640 00000100:00100000:0.0:1789131019.346526:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1789131019.346539:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8d170c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508848640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789131019.346580:0:8419:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789131019.346644:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8d170c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508848640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131019.346652:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1789131019.347202:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8d3d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508848640:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789131019.857901:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8d3e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508848768:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789131019.858024:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131019.858205:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508848768 00000100:00100000:0.0:1789131019.858217:0:8418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508848768 00000100:00100000:0.0:1789131019.858302:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1789131019.858317:0:8418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddfd066d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508848768:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789131019.858351:0:8418:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789131019.858412:0:8418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddfd066d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508848768:12345-0@lo:13:osp-pre-0-1.0 Request processed in 98us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131019.858421:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1789131019.858580:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8d3e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508848768:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789131020.081155:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131020.081685:0:14851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498280960 00000100:00100000:2.0:1789131020.081717:0:14851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498280960 00000100:00100000:2.0:1789131020.081826:0:14851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 150 00000100:00100000:2.0:1789131020.081841:0:14851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8509a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+13:12411:x1876039498280960:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789131020.081875:0:14851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789131020.081903:0:14851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fa00/0xf3fe2838e1fc2c29 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269b4e expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131020.082005:0:14851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fc00/0xf3fe2838e1fc2c30 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131020.082035:0:14851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fc00/0xf3fe2838e1fc2c30 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131020.082051:0:14851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fc00/0xf3fe2838e1fc2c30 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131020.082069:0:14851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f800/0xf3fe2838e1fc2c37 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131020.082076:0:14851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f800/0xf3fe2838e1fc2c37 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131020.082083:0:14851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f800/0xf3fe2838e1fc2c37 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131020.082216:0:14851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e600/0xf3fe2838e1fc2c3e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131020.082225:0:14851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e600/0xf3fe2838e1fc2c3e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131020.082233:0:14851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e600/0xf3fe2838e1fc2c3e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789131020.082252:0:14851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1789131020.082613:0:14851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fc00/0xf3fe2838e1fc2c30 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131020.082623:0:14851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fc00/0xf3fe2838e1fc2c30 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131020.082631:0:14851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fc00/0xf3fe2838e1fc2c30 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131020.082749:0:14851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc7f7fc00 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:2.0:1789131020.082755:0:14851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fc00/0xf3fe2838e1fc2c30 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131020.082763:0:14851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fc00/0xf3fe2838e1fc2c30 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131020.082778:0:14851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff91ddcf5ff000) 00010000:00010000:2.0:1789131020.082782:0:14851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789131020.082787:0:14851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fc00/0xf3fe2838e1fc2c30 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131020.082794:0:14851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fc00/0xf3fe2838e1fc2c30 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131020.082808:0:14851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f800/0xf3fe2838e1fc2c37 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131020.082822:0:14851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f800/0xf3fe2838e1fc2c37 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131020.082840:0:14851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f800/0xf3fe2838e1fc2c37 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131020.082846:0:14851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc7f7f800 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:2.0:1789131020.082848:0:14851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f800/0xf3fe2838e1fc2c37 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131020.082853:0:14851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f800/0xf3fe2838e1fc2c37 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131020.082860:0:14851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff91dde1922b00) 00010000:00010000:2.0:1789131020.082863:0:14851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789131020.082865:0:14851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f800/0xf3fe2838e1fc2c37 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131020.082871:0:14851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f800/0xf3fe2838e1fc2c37 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789131020.083082:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789131020.084902:0:14851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fa00/0xf3fe2838e1fc2c29 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269b4e expref: 16 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131020.084943:0:14851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e600/0xf3fe2838e1fc2c3e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269b4e expref: 15 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131020.084953:0:14851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff91ddcf5ffa00) 00010000:00010000:2.0:1789131020.084956:0:14851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789131020.084961:0:14851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dcc7f7e600, rc 0) 00000100:00100000:2.0:1789131020.085079:0:14851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8509a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+15:12411:x1876039498280960:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 3240us (3936us total) trans 4294967417 rc 0/0 00000100:00100000:2.0:1789131020.085107:0:14851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 150 00000100:00100000:1.0:1789131020.107621:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131020.107894:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498281088 00000100:00100000:2.0:1789131020.107906:0:14273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498281088 00000100:00100000:2.0:1789131020.107981:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 151 00000100:00100000:2.0:1789131020.107995:0:14273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd1df8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+15:12411:x1876039498281088:12345-192.168.203.11@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1789131020.118608:0:14273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd1df8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+15:12411:x1876039498281088:12345-192.168.203.11@tcp:59:lhsmtool_posix.0 Request processed in 10597us (10985us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131020.118629:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 151 00000100:00100000:3.0:1789131020.121983:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131020.122894:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498281216 00000100:00100000:2.0:1789131020.122908:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498281216 00000100:00100000:2.0:1789131020.123004:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 12 00000100:00100000:2.0:1789131020.123017:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8509e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+15:2385:x1876039498281216:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789131020.123049:0:6485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789131020.123082:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e600/0xf3fe2838e1fc2c3e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269b4e expref: 15 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131020.123106:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff91ddcf5ffa00) 00010000:00010000:2.0:1789131020.123112:0:6485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789131020.123190:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8509e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+14:2385:x1876039498281216:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 176us (1222us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131020.123199:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 12 00000100:00100000:0.0:1789131020.124715:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131020.124860:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498281344 00000100:00100000:2.0:1789131020.124870:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498281344 00000100:00100000:2.0:1789131020.124944:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 152 00000100:00100000:2.0:1789131020.124957:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8d3da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+5:12411:x1876039498281344:12345-192.168.203.11@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1789131020.125113:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8d3da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+5:12411:x1876039498281344:12345-192.168.203.11@tcp:59:lhsmtool_posix.0 Request processed in 159us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131020.125123:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 152 00000100:00080000:1.0:1789131020.125232:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1789131020.179290:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789131020.380626:0:14475:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789131020.380636:0:14475:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789131020.382969:0:14475:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1789131020.382991:0:14475:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1789131020.818202:0:14478:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789131021.214830:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789131021.906042:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8d16940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1876039508848896:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789131021.906115:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131021.906204:0:11069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508848896 00000100:00100000:2.0:1789131021.906210:0:11069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508848896 00000100:00100000:2.0:1789131021.906257:0:11069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1789131021.906267:0:11069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8d14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3628:x1876039508848896:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789131021.906299:0:11069:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789131021.906345:0:11069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8d14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3628:x1876039508848896:12345-0@lo:41:osp-pre-1-0.0 Request processed in 80us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131021.906353:0:11069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1789131021.906402:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8d16940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1876039508848896:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789131021.906906:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8d3e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508849024:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789131021.906944:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131021.907027:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508849024 00000100:00100000:0.0:1789131021.907048:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508849024 00000100:00100000:0.0:1789131021.907125:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1789131021.907134:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd1dfa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508849024:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789131021.907155:0:6506:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:0.0:1789131021.907199:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd1dfa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508849024:12345-0@lo:41:osp-pre-0-1.0 Request processed in 66us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131021.907206:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1789131021.911210:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8d3e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508849024:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789131022.229293:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789131022.348037:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131022.348173:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498281472 00000100:00100000:3.0:1789131022.348183:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498281472 00000100:00100000:3.0:1789131022.348259:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 153 00000100:00100000:3.0:1789131022.348270:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8d3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+14:12453:x1876039498281472:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:3.0:1789131022.348292:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789131022.348330:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5800/0xf3fe2838e1fc2c4c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269b55 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131022.348390:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc2c53 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131022.348405:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc2c53 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131022.348416:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc2c53 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131022.348430:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5c00/0xf3fe2838e1fc2c5a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131022.348438:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5c00/0xf3fe2838e1fc2c5a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131022.348446:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5c00/0xf3fe2838e1fc2c5a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131022.348531:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc2c53 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131022.348539:0:6500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc2c53 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131022.348545:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc2c53 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131022.348550:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddfd0b5a00 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:3.0:1789131022.348554:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc2c53 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131022.348562:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc2c53 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131022.348573:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91dcc7d6ac00) 00010000:00010000:3.0:1789131022.348577:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789131022.348581:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc2c53 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131022.348587:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc2c53 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131022.348598:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5c00/0xf3fe2838e1fc2c5a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131022.348604:0:6500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5c00/0xf3fe2838e1fc2c5a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131022.348610:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5c00/0xf3fe2838e1fc2c5a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131022.348620:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddfd0b5c00 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:3.0:1789131022.348623:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5c00/0xf3fe2838e1fc2c5a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131022.348629:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5c00/0xf3fe2838e1fc2c5a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131022.348637:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff91dded3a2600) 00010000:00010000:3.0:1789131022.348639:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789131022.348642:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5c00/0xf3fe2838e1fc2c5a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131022.348648:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5c00/0xf3fe2838e1fc2c5a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131022.348679:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5800/0xf3fe2838e1fc2c4c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269b55 expref: 15 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131022.348689:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91dcc7d6ac00) 00010000:00010000:3.0:1789131022.348691:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789131022.348695:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5800/0xf3fe2838e1fc2c4c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269b55 expref: 15 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131022.348703:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ddfd0b5800, rc 0) 00000100:00100000:3.0:1789131022.348756:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8d3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+14:12453:x1876039498281472:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 488us (728us total) trans 0 rc 301/301 00000100:00100000:3.0:1789131022.348764:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 153 00000100:00080000:1.0:1789131022.349430:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789131022.367935:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131022.368673:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498281728 00000100:00100000:0.0:1789131022.368685:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498281728 00000100:00100000:0.0:1789131022.369905:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 154 00000100:00100000:0.0:1789131022.369919:0:14273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc12a83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+14:12453:x1876039498281728:12345-192.168.203.11@tcp:36:lfs.0 00010000:00010000:0.0:1789131022.369973:0:14273:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789131022.370000:0:14273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cba00/0xf3fe2838e1fc25a0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269979 expref: 14 pid: 9769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131022.370944:0:14273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91dcc7d6ac00) 00010000:00010000:0.0:1789131022.370951:0:14273:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789131022.371124:0:14273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7c00/0xf3fe2838e1fc2c61 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131022.371139:0:14273:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e400/0xf3fe2838e1fc2c22 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269b47 expref: 5 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131022.371148:0:14273:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7c00/0xf3fe2838e1fc2c61 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131022.371185:0:14273:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e400/0xf3fe2838e1fc2c22 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269b47 expref: 5 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131022.371208:0:14273:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e400/0xf3fe2838e1fc2c22 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269b47 expref: 5 pid: 6502 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131022.371223:0:14273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8d3c780 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14273:1876039508849152:192.168.203.11@tcp:104: 00000100:00100000:0.0:1789131022.371361:0:14273:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddd435c600 going to sleep for 11 seconds 00000100:00100000:0.0:1789131022.377893:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131022.378506:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498281856 00000100:00100000:3.0:1789131022.378536:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498281856 00010000:00010000:3.0:1789131022.378591:0:6486:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e400/0xf3fe2838e1fc2c22 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269b47 expref: 6 pid: 6502 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131022.378627:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 90 00000100:00100000:3.0:1789131022.378638:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8d3ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fde8d4a8-44db-4e6b-8249-c1c295e4901d+6:2388:x1876039498281856:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789131022.378652:0:6486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789131022.378658:0:6486:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e400/0xf3fe2838e1fc2c22 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269b47 expref: 6 pid: 6502 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131022.378671:0:6486:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e400/0xf3fe2838e1fc2c22 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269b47 expref: 6 pid: 6502 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131022.378693:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91dcc7d6ac00) 00010000:00010000:3.0:1789131022.378699:0:6486:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7c00/0xf3fe2838e1fc2c61 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131022.378709:0:6486:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7c00/0xf3fe2838e1fc2c61 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131022.378717:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7c00/0xf3fe2838e1fc2c61 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131022.378738:0:6486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789131022.378786:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8d3ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fde8d4a8-44db-4e6b-8249-c1c295e4901d+6:2388:x1876039498281856:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 150us (902us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131022.378806:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 90 00000100:00080000:0.0:1789131022.379060:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789131022.380283:0:14273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e400/0xf3fe2838e1fc2c22 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269b47 expref: 5 pid: 6502 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131022.380306:0:14273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8d3c780 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14273:1876039508849152:192.168.203.11@tcp:104: 00010000:00010000:1.0:1789131022.380327:0:14273:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7c00/0xf3fe2838e1fc2c61 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131022.380336:0:14273:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7c00/0xf3fe2838e1fc2c61 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131022.380342:0:14273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7c00/0xf3fe2838e1fc2c61 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131022.380367:0:14273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca000/0xf3fe2838e1fc2c68 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131022.380378:0:14273:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca000/0xf3fe2838e1fc2c68 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131022.380387:0:14273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca000/0xf3fe2838e1fc2c68 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131022.381736:0:14273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cbe00/0xf3fe2838e1fc2c6f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131022.381754:0:14273:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cbe00/0xf3fe2838e1fc2c6f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131022.381764:0:14273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cbe00/0xf3fe2838e1fc2c6f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789131022.381783:0:14273:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000c182e5cc reply state 0000000038e42fcf transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cbe00/0xf3fe2838e1fc2c6f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131022.383060:0:14273:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cbe00/0xf3fe2838e1fc2c6f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131022.383079:0:14273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff91dcc7d6bf00) 00010000:00010000:1.0:1789131022.383083:0:14273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789131022.383088:0:14273:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1789131022.383094:0:14273:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1789131022.383106:0:14273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7c00/0xf3fe2838e1fc2c61 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131022.383113:0:14273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7c00/0xf3fe2838e1fc2c61 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131022.383120:0:14273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7c00/0xf3fe2838e1fc2c61 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131022.383126:0:14273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91de01ad7c00 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:1.0:1789131022.383130:0:14273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7c00/0xf3fe2838e1fc2c61 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131022.383150:0:14273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7c00/0xf3fe2838e1fc2c61 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131022.383162:0:14273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91dcc7d6ac00) 00010000:00010000:1.0:1789131022.383165:0:14273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789131022.383169:0:14273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7c00/0xf3fe2838e1fc2c61 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131022.383175:0:14273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7c00/0xf3fe2838e1fc2c61 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789131022.383191:0:14273:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000c182e5cc reply state 0000000038e42fcf transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca000/0xf3fe2838e1fc2c68 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131022.383201:0:14273:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca000/0xf3fe2838e1fc2c68 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131022.383206:0:14273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff91dcc7d6b600) 00010000:00010000:1.0:1789131022.383208:0:14273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789131022.383210:0:14273:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1789131022.383349:0:14273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc12a83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+15:12453:x1876039498281728:12345-192.168.203.11@tcp:36:lfs.0 Request processed in 13429us (15418us total) trans 4294967418 rc 0/0 00000100:00100000:1.0:1789131022.383357:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 154 00000040:00080000:0.0:1789131022.422970:0:14475:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789131022.422979:0:14475:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789131022.423081:0:14475:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:0.0:1789131022.423088:0:14475:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789131022.486521:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131022.486563:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498281984 00000100:00100000:3.0:1789131022.486572:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498281984 00000100:00100000:3.0:1789131022.486641:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 155 00000100:00100000:3.0:1789131022.486651:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8d16940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+15:12461:x1876039498281984:12345-192.168.203.11@tcp:101:lctl.0 00010000:00010000:3.0:1789131022.486675:0:9769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789131022.486696:0:9769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5800/0xf3fe2838e1fc2c76 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269b5c expref: -99 pid: 9769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131022.486759:0:9769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5c00/0xf3fe2838e1fc2c7d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131022.486772:0:9769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5c00/0xf3fe2838e1fc2c7d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131022.486783:0:9769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5c00/0xf3fe2838e1fc2c7d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789131022.486838:0:9769:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789131022.486842:0:9769:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789131022.486864:0:9769:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5c00/0xf3fe2838e1fc2c7d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131022.486886:0:9769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5800/0xf3fe2838e1fc2c76 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269b5c expref: 17 pid: 9769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131022.486899:0:9769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5c00/0xf3fe2838e1fc2c7d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269b5c expref: 16 pid: 9769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131022.486907:0:9769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91dded3a2600) 00010000:00010000:3.0:1789131022.486910:0:9769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789131022.486914:0:9769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ddfd0b5c00, rc 0) 00000100:00100000:3.0:1789131022.486973:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8d16940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+16:12461:x1876039498281984:12345-192.168.203.11@tcp:101:lctl.0 Request processed in 323us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131022.486986:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 155 00000100:00100000:1.0:1789131022.549451:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131022.549633:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498282112 00000100:00100000:3.0:1789131022.549643:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498282112 00000100:00100000:3.0:1789131022.549690:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 156 00000100:00100000:3.0:1789131022.549700:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01b3a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+16:12467:x1876039498282112:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:3.0:1789131022.549718:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789131022.549736:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5800/0xf3fe2838e1fc2c84 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269b63 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131022.549811:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc2c8b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131022.549825:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc2c8b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131022.549836:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc2c8b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131022.549847:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4a00/0xf3fe2838e1fc2c92 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131022.549855:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4a00/0xf3fe2838e1fc2c92 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131022.549861:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4a00/0xf3fe2838e1fc2c92 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131022.549932:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4400/0xf3fe2838e1fc2c99 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131022.549956:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4400/0xf3fe2838e1fc2c99 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131022.549964:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4400/0xf3fe2838e1fc2c99 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789131022.549997:0:6500:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1789131022.550000:0:6500:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789131022.550032:0:6500:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4400/0xf3fe2838e1fc2c99 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131022.550044:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc2c8b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131022.550052:0:6500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc2c8b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131022.550058:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc2c8b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131022.550064:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddfd0b5a00 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:3.0:1789131022.550068:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc2c8b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131022.550075:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc2c8b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131022.550086:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91dded3a2600) 00010000:00010000:3.0:1789131022.550090:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789131022.550094:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc2c8b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131022.550110:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc2c8b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131022.550123:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4a00/0xf3fe2838e1fc2c92 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131022.550129:0:6500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4a00/0xf3fe2838e1fc2c92 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131022.550135:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4a00/0xf3fe2838e1fc2c92 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131022.550141:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddfd0b4a00 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:3.0:1789131022.550144:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4a00/0xf3fe2838e1fc2c92 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131022.550151:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4a00/0xf3fe2838e1fc2c92 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131022.550158:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff91dcc7d6b600) 00010000:00010000:3.0:1789131022.550161:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789131022.550163:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4a00/0xf3fe2838e1fc2c92 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131022.550169:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4a00/0xf3fe2838e1fc2c92 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131022.550194:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5800/0xf3fe2838e1fc2c84 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269b63 expref: 18 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131022.550208:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4400/0xf3fe2838e1fc2c99 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269b63 expref: 17 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131022.550221:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff91dcc7d6bf00) 00010000:00010000:3.0:1789131022.550223:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789131022.550226:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ddfd0b4400, rc 0) 00000100:00100000:3.0:1789131022.550290:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01b3a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+17:12467:x1876039498282112:12345-192.168.203.11@tcp:101:bash.0 Request processed in 591us (847us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131022.550298:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 156 00000100:00100000:2.0:1789131022.554511:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131022.556977:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498282368 00000100:00100000:0.0:1789131022.557001:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498282368 00000100:00100000:0.0:1789131022.557073:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 157 00000100:00100000:0.0:1789131022.557082:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8d14780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+17:12467:x1876039498282368:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:0.0:1789131022.557102:0:6501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789131022.557124:0:6501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc2ca0 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269b6a expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131022.557242:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6400/0xf3fe2838e1fc2ca7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131022.557258:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6400/0xf3fe2838e1fc2ca7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131022.557268:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6400/0xf3fe2838e1fc2ca7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131022.557300:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6e00/0xf3fe2838e1fc2cae lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131022.557309:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6e00/0xf3fe2838e1fc2cae lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131022.557315:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6e00/0xf3fe2838e1fc2cae lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789131022.557965:0:6501:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x4:0x0], index 0: 0 00010000:00010000:1.0:1789131022.558336:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca400/0xf3fe2838e1fc2cb5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131022.558349:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca400/0xf3fe2838e1fc2cb5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131022.558359:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca400/0xf3fe2838e1fc2cb5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131022.558402:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6400/0xf3fe2838e1fc2ca7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131022.558409:0:6501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6400/0xf3fe2838e1fc2ca7 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131022.558416:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6400/0xf3fe2838e1fc2ca7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131022.558422:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91de01ad6400 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:1.0:1789131022.558427:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6400/0xf3fe2838e1fc2ca7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131022.558434:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6400/0xf3fe2838e1fc2ca7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131022.558446:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff91dcc7d6bf00) 00010000:00010000:1.0:1789131022.558449:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789131022.558454:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6400/0xf3fe2838e1fc2ca7 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131022.558494:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6400/0xf3fe2838e1fc2ca7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789131022.558509:0:6501:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000094f76fea reply state 000000004c38de75 transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6e00/0xf3fe2838e1fc2cae lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131022.558520:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6e00/0xf3fe2838e1fc2cae lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131022.558527:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff91ddca4e4500) 00010000:00010000:1.0:1789131022.558534:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789131022.558538:0:6501:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789131022.558574:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc2ca0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269b6a expref: 20 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131022.558589:0:6501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca400/0xf3fe2838e1fc2cb5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269b6a expref: 19 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131022.558595:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff91dcc7d6b800) 00010000:00010000:1.0:1789131022.558597:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789131022.558600:0:6501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dcc85ca400, rc 0) 00000100:00100000:1.0:1789131022.558674:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8d14780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+20:12467:x1876039498282368:12345-192.168.203.11@tcp:101:bash.0 Request processed in 1593us (4172us total) trans 4294967419 rc 0/0 00000100:00100000:1.0:1789131022.558683:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 157 00000100:00100000:2.0:1789131022.565038:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131022.565410:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498282496 00000100:00100000:0.0:1789131022.565421:0:9827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498282496 00000100:00100000:0.0:1789131022.565535:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 55 00000100:00100000:0.0:1789131022.565547:0:9827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8d16d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+5:2388:x1876039498282496:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:0.0:1789131022.565563:0:9827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789131022.565584:0:9827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ed0aabd/0xf3fe2838e1fc2cc3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269b71 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789131022.565611:0:9827:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789131022.565630:0:9827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=378s v=(0 0) 00010000:00010000:0.0:1789131022.565635:0:9827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789131022.565644:0:9827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ed0aabd/0xf3fe2838e1fc2cc3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269b71 expref: 6 pid: 9827 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131022.565663:0:9827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009ed0aabd/0xf3fe2838e1fc2cc3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269b71 expref: 6 pid: 9827 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131022.565696:0:9827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91de01ad7400, rc 0) 00000100:00100000:0.0:1789131022.565754:0:9827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8d16d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+6:2388:x1876039498282496:12345-192.168.203.11@tcp:101:bash.0 Request processed in 210us (726us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131022.565762:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 55 00000100:00080000:1.0:1789131022.566756:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789131022.572727:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131022.572819:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498282624 00000100:00100000:0.0:1789131022.572829:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498282624 00000100:00100000:0.0:1789131022.572888:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 56 00000100:00100000:0.0:1789131022.572898:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8d17c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+6:12467:x1876039498282624:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:0.0:1789131022.572916:0:8416:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789131022.572934:0:8416:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000786a2989/0xf3fe2838e1fc2cca lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269b78 expref: -99 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131022.572966:0:8416:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009ed0aabd/0xf3fe2838e1fc2cc3 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269b71 expref: 7 pid: 9827 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131022.572976:0:8416:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789131022.572981:0:8416:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789131022.572986:0:8416:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000786a2989/0xf3fe2838e1fc2cca lrc: 4/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269b78 expref: 7 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131022.573039:0:8416:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009ed0aabd/0xf3fe2838e1fc2cc3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269b71 expref: 7 pid: 9827 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131022.573053:0:8416:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009ed0aabd/0xf3fe2838e1fc2cc3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269b71 expref: 7 pid: 9827 timeout: 478 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131022.573083:0:8416:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8d3fc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8416:1876039508849280:192.168.203.11@tcp:104: 00000100:00100000:0.0:1789131022.573186:0:8416:0:(client.c:2715:ptlrpc_set_wait()) set ffff91dde0ac0900 going to sleep for 11 seconds 00000100:00100000:3.0:1789131022.575996:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131022.576086:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498282752 00000100:00100000:2.0:1789131022.576095:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498282752 00010000:00010000:2.0:1789131022.576136:0:6485:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009ed0aabd/0xf3fe2838e1fc2cc3 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269b71 expref: 8 pid: 9827 timeout: 478 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131022.576180:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 91 00000100:00100000:2.0:1789131022.576190:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc33ac050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+8:2387:x1876039498282752:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789131022.576217:0:6485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789131022.576238:0:6485:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009ed0aabd/0xf3fe2838e1fc2cc3 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269b71 expref: 8 pid: 9827 timeout: 478 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131022.576253:0:6485:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009ed0aabd/0xf3fe2838e1fc2cc3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269b71 expref: 8 pid: 9827 timeout: 478 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131022.576283:0:6485:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789131022.576291:0:6485:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789131022.576300:0:6485:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000786a2989/0xf3fe2838e1fc2cca lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269b78 expref: 8 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131022.576310:0:6485:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000786a2989/0xf3fe2838e1fc2cca lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269b78 expref: 8 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131022.576349:0:6485:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000786a2989/0xf3fe2838e1fc2cca lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269b78 expref: 8 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131022.576362:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8d161c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6485:1876039508849408:192.168.203.11@tcp:105: 00000100:00100000:2.0:1789131022.576439:0:6485:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddd83640c0 going to sleep for 11 seconds 00010000:00010000:0.0:1789131022.578018:0:8416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ed0aabd/0xf3fe2838e1fc2cc3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269b71 expref: 8 pid: 9827 timeout: 478 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131022.578039:0:8416:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8d3fc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8416:1876039508849280:192.168.203.11@tcp:104: 00010000:00010000:0.0:1789131022.578065:0:8416:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000786a2989/0xf3fe2838e1fc2cca lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269b78 expref: 7 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131022.578077:0:8416:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91de01ad7e00, rc 0) 00000100:00100000:0.0:1789131022.578131:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8d17c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+7:12467:x1876039498282624:12345-192.168.203.11@tcp:101:bash.0 Request processed in 5235us (5413us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131022.578139:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 56 00000100:00100000:2.0:1789131022.579940:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8d161c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6485:1876039508849408:192.168.203.11@tcp:105: 00010000:00010000:2.0:1789131022.579965:0:6485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789131022.580014:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc33ac050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+6:2387:x1876039498282752:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 3826us (4031us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131022.580033:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 91 00000100:00100000:3.0:1789131022.581528:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789131022.581872:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498283008 00000100:00100000:1.0:1789131022.581882:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498283008 00000100:00100000:1.0:1789131022.581962:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 36 00000100:00100000:1.0:1789131022.581972:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8509e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+20:12467:x1876039498283008:12345-192.168.203.11@tcp:35:bash.0 00000100:00100000:1.0:1789131022.582357:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8509e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+21:12467:x1876039498283008:12345-192.168.203.11@tcp:35:bash.0 Request processed in 386us (837us total) trans 4294967420 rc 0/0 00000100:00100000:1.0:1789131022.582365:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 36 00000100:00100000:3.0:1789131022.685339:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131022.685418:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131022.685552:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498283264 00000100:00100000:0.0:1789131022.685561:0:9827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498283264 00000100:00100000:0.0:1789131022.685612:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 57 00000100:00100000:0.0:1789131022.685621:0:9827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc850a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+6:2386:x1876039498283264:12345-192.168.203.11@tcp:16:kworker.0 00000100:00100000:0.0:1789131022.685721:0:9827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc850a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+6:2386:x1876039498283264:12345-192.168.203.11@tcp:16:kworker.0 Request processed in 101us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131022.685728:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 57 00000100:00100000:2.0:1789131022.686312:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498283136 00000100:00100000:2.0:1789131022.686318:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498283136 00002000:00100000:2.0:1789131022.686346:0:8421:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff91dcc8494000 x1876039498283136/t0(0) o4->b99c111d-b9b6-4590-88e4-9fefd4d4c3a4@192.168.203.11@tcp:738/0 lens 504/0 e 0 to 0 dl 1789131033 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789131022.686356:0:8421:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff91dcc8494000 with x1876039498283136 ext(0->12) 00002000:00010000:2.0:1789131022.686361:0:8421:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91dcc8494000 00000100:00100000:2.0:1789131022.686384:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 4 00000100:00100000:2.0:1789131022.686391:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8494000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+6:2386:x1876039498283136:12345-192.168.203.11@tcp:4:bash.0 00000100:00100000:2.0:1789131022.689739:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8494000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+8:2386:x1876039498283136:12345-192.168.203.11@tcp:4:bash.0 Request processed in 3331us (4302us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1789131022.689760:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 4 00002000:00100000:2.0:1789131022.689779:0:8421:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff91dcc8494000 x1876039498283136/t4294967306(0) o4->b99c111d-b9b6-4590-88e4-9fefd4d4c3a4@192.168.203.11@tcp:738/0 lens 504/448 e 0 to 0 dl 1789131033 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789131022.689801:0:8421:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff91dcc8494000 with x1876039498283136 ext(0->12) 00002000:00010000:2.0:1789131022.689810:0:8421:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91dcc8494000 00000100:00100000:3.0:1789131022.713085:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131022.713259:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498283520 00000100:00100000:2.0:1789131022.713268:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498283520 00000100:00100000:2.0:1789131022.713329:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 158 00000100:00100000:2.0:1789131022.713339:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8497840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+21:12477:x1876039498283520:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:2.0:1789131022.713362:0:9769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789131022.713380:0:9769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e800/0xf3fe2838e1fc2cd1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269b7f expref: -99 pid: 9769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789131022.713522:0:9769:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1789131022.713879:0:9769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e800/0xf3fe2838e1fc2cd1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269b7f expref: 23 pid: 9769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131022.713913:0:9769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91dded3a2600) 00010000:00010000:2.0:1789131022.713916:0:9769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789131022.713923:0:9769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e800/0xf3fe2838e1fc2cd1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269b7f expref: 23 pid: 9769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131022.713937:0:9769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dcc7f7e800, rc 0) 00000100:00100000:2.0:1789131022.714002:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8497840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+22:12477:x1876039498283520:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 664us (926us total) trans 4294967421 rc 301/301 00000100:00100000:2.0:1789131022.714017:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 158 00000100:00100000:3.0:1789131022.719201:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131022.724385:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498283776 00000100:00100000:0.0:1789131022.724401:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498283776 00000100:00100000:0.0:1789131022.724646:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 37 00000100:00100000:0.0:1789131022.724669:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01b30780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+22:12477:x1876039498283776:12345-192.168.203.11@tcp:35:lfs.0 00000100:00100000:0.0:1789131022.724909:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01b30780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+23:12477:x1876039498283776:12345-192.168.203.11@tcp:35:lfs.0 Request processed in 240us (5716us total) trans 4294967422 rc 0/0 00000100:00100000:0.0:1789131022.724917:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 37 00000100:00100000:3.0:1789131022.864246:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131022.864373:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498283904 00000100:00100000:2.0:1789131022.864383:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498283904 00000100:00100000:2.0:1789131022.864446:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 159 00000100:00100000:2.0:1789131022.865141:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01b31680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+23:12483:x1876039498283904:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:2.0:1789131022.865172:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789131022.865194:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e800/0xf3fe2838e1fc2cdf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269b86 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131022.865274:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f600/0xf3fe2838e1fc2ce6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131022.865288:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f600/0xf3fe2838e1fc2ce6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131022.865299:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f600/0xf3fe2838e1fc2ce6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789131022.865340:0:6500:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1789131022.865356:0:6500:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789131022.865377:0:6500:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f600/0xf3fe2838e1fc2ce6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131022.865405:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e800/0xf3fe2838e1fc2cdf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269b86 expref: 25 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131022.865426:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f600/0xf3fe2838e1fc2ce6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269b86 expref: 24 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131022.865435:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff91dcc7d6bf00) 00010000:00010000:2.0:1789131022.865438:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789131022.865442:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dcc7f7f600, rc 0) 00000040:00080000:0.0:1789131022.866214:0:14478:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789131022.866768:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01b31680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+24:12483:x1876039498283904:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 2308us (2527us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131022.866778:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 159 00000100:00100000:3.0:1789131022.882030:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789131022.882502:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498284160 00000100:00100000:1.0:1789131022.882512:0:14273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498284160 00000100:00100000:1.0:1789131022.882648:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 160 00000100:00100000:1.0:1789131022.882659:0:14273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01b33840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+24:12483:x1876039498284160:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:1.0:1789131022.882678:0:14273:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789131022.882711:0:14273:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb800/0xf3fe2838e1fc2ced lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269b8d expref: -99 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131022.882832:0:14273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca600/0xf3fe2838e1fc2cf4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131022.882847:0:14273:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca600/0xf3fe2838e1fc2cf4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131022.882859:0:14273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca600/0xf3fe2838e1fc2cf4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789131022.882870:0:14273:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:1.0:1789131022.882972:0:14273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb800/0xf3fe2838e1fc2ced lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269b8d expref: 27 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131022.882992:0:14273:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca600/0xf3fe2838e1fc2cf4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269b8d expref: 26 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131022.883001:0:14273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff91dcc7d6b800) 00010000:00010000:1.0:1789131022.883014:0:14273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789131022.883018:0:14273:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dcc85ca600, rc 0) 00000100:00100000:1.0:1789131022.883088:0:14273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01b33840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+26:12483:x1876039498284160:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 431us (1076us total) trans 4294967423 rc 0/0 00000100:00100000:1.0:1789131022.883097:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 160 00000100:00100000:0.0:1789131022.892229:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789131022.892320:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498284416 00000100:00100000:1.0:1789131022.892331:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498284416 00000100:00100000:1.0:1789131022.892545:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 161 00000100:00100000:1.0:1789131022.892556:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8d3fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+26:12483:x1876039498284416:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:1.0:1789131022.892594:0:6502:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789131022.892612:0:6502:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb800/0xf3fe2838e1fc2d02 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269b94 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131022.892887:0:6502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cba00/0xf3fe2838e1fc2d09 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131022.892902:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cba00/0xf3fe2838e1fc2d09 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131022.892913:0:6502:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cba00/0xf3fe2838e1fc2d09 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789131022.892925:0:6502:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:1.0:1789131022.893019:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb800/0xf3fe2838e1fc2d02 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269b94 expref: 29 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131022.893037:0:6502:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cba00/0xf3fe2838e1fc2d09 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269b94 expref: 28 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131022.893044:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff91dcc7d6b800) 00010000:00010000:1.0:1789131022.893047:0:6502:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789131022.893050:0:6502:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dcc85cba00, rc 0) 00000100:00100000:1.0:1789131022.893204:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8d3fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+28:12483:x1876039498284416:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 649us (984us total) trans 4294967424 rc 0/0 00000100:00100000:1.0:1789131022.893213:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 161 00000100:00100000:3.0:1789131022.895947:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131022.896213:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498284544 00000100:00100000:0.0:1789131022.896223:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498284544 00000100:00100000:0.0:1789131022.896321:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 13 00000100:00100000:0.0:1789131022.896332:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01b303c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+28:2385:x1876039498284544:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789131022.896357:0:6486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789131022.896377:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca600/0xf3fe2838e1fc2cf4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269b8d expref: 28 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131022.896397:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff91dcc7d6b800) 00010000:00010000:0.0:1789131022.896401:0:6486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789131022.896455:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01b303c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+27:2385:x1876039498284544:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 124us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131022.896506:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 13 00000100:00100000:3.0:1789131022.899931:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131022.900035:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498284672 00000100:00100000:2.0:1789131022.900045:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498284672 00000100:00100000:2.0:1789131022.900113:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 58 00000100:00100000:2.0:1789131022.900123:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd286ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+8:2388:x1876039498284672:12345-192.168.203.11@tcp:1:lfs.0 00010000:00010000:2.0:1789131022.900175:0:8414:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001b7cb00b/0xf3fe2838e1fc2d17 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131022.900194:0:8414:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000786a2989/0xf3fe2838e1fc2cca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269b78 expref: 8 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131022.900203:0:8414:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789131022.900207:0:8414:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789131022.900225:0:8414:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001b7cb00b/0xf3fe2838e1fc2d17 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131022.900267:0:8414:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000786a2989/0xf3fe2838e1fc2cca lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269b78 expref: 8 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131022.900282:0:8414:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000786a2989/0xf3fe2838e1fc2cca lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269b78 expref: 8 pid: 8416 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131022.900296:0:8414:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8d161c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8414:1876039508849536:192.168.203.11@tcp:104: 00000100:00100000:2.0:1789131022.900385:0:8414:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddd8364cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789131022.909253:0:8414:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8d161c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8414:1876039508849536:192.168.203.11@tcp:104: 00010000:00010000:2.0:1789131022.909284:0:8414:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001b7cb00b/0xf3fe2838e1fc2d17 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131022.910410:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789131022.911834:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498284800 00000100:00100000:1.0:1789131022.911848:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498284800 00010000:00010000:1.0:1789131022.911892:0:8431:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000786a2989/0xf3fe2838e1fc2cca lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269b78 expref: 9 pid: 8416 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131022.911952:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 92 00000100:00100000:1.0:1789131022.911963:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd286bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+9:2387:x1876039498284800:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789131022.911979:0:8431:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1789131022.911998:0:8431:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1789131022.912001:0:8431:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1789131022 00002000:00010000:1.0:1789131022.912003:0:8431:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 0 -> 1789131022 00002000:00010000:1.0:1789131022.912005:0:8431:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1789131022.912012:0:8431:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000786a2989/0xf3fe2838e1fc2cca lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269b78 expref: 9 pid: 8416 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131022.912025:0:8431:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000786a2989/0xf3fe2838e1fc2cca lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269b78 expref: 9 pid: 8416 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131022.912047:0:8431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000786a2989/0xf3fe2838e1fc2cca lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269b78 expref: 9 pid: 8416 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131022.912064:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789131022.912068:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789131022.912074:0:8431:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001b7cb00b/0xf3fe2838e1fc2d17 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131022.912084:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001b7cb00b/0xf3fe2838e1fc2d17 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131022.912119:0:8431:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789131022.912186:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd286bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+8:2387:x1876039498284800:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 224us (1781us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131022.912195:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 92 00010000:00010000:2.0:1789131022.912228:0:8414:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001b7cb00b/0xf3fe2838e1fc2d17 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131022.912237:0:8414:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001b7cb00b/0xf3fe2838e1fc2d17 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131022.912255:0:8414:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001b7cb00b/0xf3fe2838e1fc2d17 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131022.912262:0:8414:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001b7cb00b/0xf3fe2838e1fc2d17 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131022.912281:0:8414:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001b7cb00b/0xf3fe2838e1fc2d17 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131022.912289:0:8414:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc7f7e800 already unused, calling callback (ffffffffc0c4e550) 00010000:00010000:2.0:1789131022.912293:0:8414:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001b7cb00b/0xf3fe2838e1fc2d17 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131022.912302:0:8414:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001b7cb00b/0xf3fe2838e1fc2d17 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131022.912314:0:8414:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001b7cb00b/0xf3fe2838e1fc2d17 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131022.912321:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001b7cb00b/0xf3fe2838e1fc2d17 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131022.912366:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd286ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+7:2388:x1876039498284672:12345-192.168.203.11@tcp:1:lfs.0 Request processed in 12245us (12444us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131022.912373:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 58 00000100:00100000:0.0:1789131022.920137:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789131022.920997:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498285056 00000100:00100000:1.0:1789131022.921008:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498285056 00000100:00100000:1.0:1789131022.921064:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 38 00000100:00100000:1.0:1789131022.921074:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dded1d2450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+27:12483:x1876039498285056:12345-192.168.203.11@tcp:35:lfs.0 00000004:00010000:1.0:1789131022.921134:0:6504:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cba00/0xf3fe2838e1fc2d09 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269b94 expref: 27 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789131022.921322:0:6504:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:1.0:1789131022.921355:0:6504:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:1.0:1789131022.921872:0:6504:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00010000:00010000:1.0:1789131022.921911:0:6504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb800/0xf3fe2838e1fc2d1e lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131022.921926:0:6504:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca400/0xf3fe2838e1fc2cb5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269b6a expref: 31 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131022.921935:0:6504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb800/0xf3fe2838e1fc2d1e lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131022.922409:0:6504:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca400/0xf3fe2838e1fc2cb5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269b6a expref: 31 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131022.922428:0:6504:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca400/0xf3fe2838e1fc2cb5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269b6a expref: 31 pid: 6501 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131022.922442:0:6504:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01b3b480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6504:1876039508849664:192.168.203.11@tcp:104: 00000100:00100000:1.0:1789131022.922693:0:6504:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddff8be240 going to sleep for 11 seconds 00000100:00100000:3.0:1789131022.928170:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131022.928270:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498285184 00000100:00100000:0.0:1789131022.928279:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498285184 00010000:00010000:0.0:1789131022.928318:0:6487:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca400/0xf3fe2838e1fc2cb5 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269b6a expref: 32 pid: 6501 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131022.928362:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 93 00000100:00100000:0.0:1789131022.928373:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd286a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+32:2387:x1876039498285184:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789131022.928403:0:6487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789131022.928410:0:6487:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca400/0xf3fe2838e1fc2cb5 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269b6a expref: 32 pid: 6501 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131022.928423:0:6487:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca400/0xf3fe2838e1fc2cb5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269b6a expref: 32 pid: 6501 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131022.928445:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff91dcc7d6b800) 00010000:00010000:0.0:1789131022.928450:0:6487:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb800/0xf3fe2838e1fc2d1e lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131022.928498:0:6487:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb800/0xf3fe2838e1fc2d1e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131022.928508:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb800/0xf3fe2838e1fc2d1e lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131022.928527:0:6487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789131022.928574:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd286a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+32:2387:x1876039498285184:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 202us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131022.928581:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 93 00010000:00010000:1.0:1789131022.928678:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca400/0xf3fe2838e1fc2cb5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269b6a expref: 31 pid: 6501 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131022.928698:0:6504:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01b3b480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6504:1876039508849664:192.168.203.11@tcp:104: 00010000:00010000:1.0:1789131022.928731:0:6504:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb800/0xf3fe2838e1fc2d1e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131022.928739:0:6504:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb800/0xf3fe2838e1fc2d1e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131022.928752:0:6504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb800/0xf3fe2838e1fc2d1e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789131022.928861:0:6504:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000001:00080000:1.0:1789131022.928995:0:6504:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:1.0:1789131022.929080:0:6504:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01b3b480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6504:1876039508849792:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789131022.930225:0:6504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131022.930254:0:6504:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddff8bee40 going to sleep for 11 seconds 00000100:00100000:0.0:1789131022.930426:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508849792 00000100:00100000:0.0:1789131022.930433:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508849792 00000100:00100000:0.0:1789131022.930509:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1789131022.930517:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddf5c3f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6504:x1876039508849792:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789131022.930605:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddf5c3f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6504:x1876039508849792:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 88us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131022.930612:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1789131022.930934:0:6504:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01b3b480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6504:1876039508849792:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1789131022.931072:0:6504:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00000100:00100000:0.0:1789131022.931263:0:6504:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8d3e1c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6504:1876039508849920:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789131022.931298:0:6504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131022.931324:0:6504:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddc3049b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789131022.931355:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508849920 00000100:00100000:2.0:1789131022.931360:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508849920 00000100:00100000:2.0:1789131022.931596:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1789131022.931605:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8d3cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6504:x1876039508849920:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00080000:1.0:1789131022.931884:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789131022.932168:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8d3cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6504:x1876039508849920:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 564us (869us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1789131022.932190:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1789131022.932278:0:6504:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8d3e1c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6504:1876039508849920:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1789131022.932321:0:6504:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:0.0:1789131022.932357:0:6504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb800/0xf3fe2838e1fc2d1e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131022.932366:0:6504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb800/0xf3fe2838e1fc2d1e lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131022.932374:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb800/0xf3fe2838e1fc2d1e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131022.932379:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc85cb800 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:0.0:1789131022.932384:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb800/0xf3fe2838e1fc2d1e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131022.932391:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb800/0xf3fe2838e1fc2d1e lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131022.932406:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff91dcc7d6b800) 00010000:00010000:0.0:1789131022.932409:0:6504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1789131022.932414:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb800/0xf3fe2838e1fc2d1e lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131022.932420:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb800/0xf3fe2838e1fc2d1e lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789131022.933133:0:6504:0:(mdd_object.c:4024:mdd_close()) Object [0x200000402:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1789131022.933196:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:0.0:1789131022.933207:0:6504:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 378850747430ns, next at 379850745424ns, rc = 0 00000001:00080000:0.0:1789131022.933214:0:6504:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967432 00010000:00010000:0.0:1789131022.933241:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff91dcc7d6b800) 00010000:00010000:0.0:1789131022.933244:0:6504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789131022.933252:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cba00/0xf3fe2838e1fc2d09 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269b94 expref: 35 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131022.933347:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dded1d2450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+34:12483:x1876039498285056:12345-192.168.203.11@tcp:35:lfs.0 Request processed in 12274us (13218us total) trans 4294967433 rc 0/0 00000100:00100000:0.0:1789131022.933356:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 38 00000020:00080000:0.0:1789131022.933360:0:6504:0:(tgt_main.c:785:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1789131022.936948:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131022.938080:0:14851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498285312 00000100:00100000:2.0:1789131022.938092:0:14851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498285312 00000100:00100000:2.0:1789131022.938160:0:14851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 162 00000100:00100000:2.0:1789131022.938170:0:14851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8d3d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+34:12483:x1876039498285312:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:2.0:1789131022.938194:0:14851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789131022.938217:0:14851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7ee00/0xf3fe2838e1fc2d25 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269b9b expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131022.938273:0:14851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7ee00/0xf3fe2838e1fc2d25 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269b9b expref: 35 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131022.938286:0:14851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7ee00/0xf3fe2838e1fc2d25 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269b9b expref: 35 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131022.938302:0:14851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff91dde1922b00) 00010000:00010000:2.0:1789131022.938307:0:14851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789131022.938311:0:14851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dcc7f7ee00, rc 0) 00000100:00100000:2.0:1789131022.938404:0:14851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8d3d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+35:12483:x1876039498285312:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 235us (1465us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131022.938411:0:14851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 162 00000100:00100000:0.0:1789131022.942864:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131022.943071:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498285568 00000100:00100000:2.0:1789131022.943081:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498285568 00000100:00100000:2.0:1789131022.943167:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 39 00000100:00100000:2.0:1789131022.943178:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8d3cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+35:12483:x1876039498285568:12345-192.168.203.11@tcp:35:lfs.0 00000100:00100000:2.0:1789131022.943393:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8d3cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+36:12483:x1876039498285568:12345-192.168.203.11@tcp:35:lfs.0 Request processed in 216us (537us total) trans 4294967434 rc 0/0 00000100:00100000:2.0:1789131022.943416:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 39 00000100:00100000:0.0:1789131023.092169:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131023.099040:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498285824 00000100:00100000:2.0:1789131023.099055:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498285824 00000100:00100000:3.0:1789131023.107026:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 163 00000100:00100000:3.0:1789131023.107041:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8d3f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+36:12493:x1876039498285824:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:3.0:1789131023.107065:0:6501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789131023.107085:0:6501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4a00/0xf3fe2838e1fc2d2c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269ba2 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789131023.107175:0:6501:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1789131023.107292:0:6501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4a00/0xf3fe2838e1fc2d2c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269ba2 expref: 38 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131023.107305:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91dded3a2600) 00010000:00010000:3.0:1789131023.107308:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789131023.107314:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4a00/0xf3fe2838e1fc2d2c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269ba2 expref: 38 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131023.107327:0:6501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ddfd0b4a00, rc 0) 00000100:00100000:3.0:1789131023.107399:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8d3f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+37:12493:x1876039498285824:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 361us (15239us total) trans 4294967435 rc 301/301 00000100:00100000:3.0:1789131023.107408:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 163 00000100:00100000:1.0:1789131023.124344:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131023.124434:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498285952 00000100:00100000:2.0:1789131023.124444:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498285952 00000100:00100000:2.0:1789131023.124527:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 164 00000100:00100000:2.0:1789131023.124538:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01b3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+37:12493:x1876039498285952:12345-192.168.203.11@tcp:34:lfs.0 00010000:00010000:2.0:1789131023.124614:0:9769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e800/0xf3fe2838e1fc2d3a lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131023.124631:0:9769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e800/0xf3fe2838e1fc2d3a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131023.124644:0:9769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e800/0xf3fe2838e1fc2d3a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131023.124657:0:9769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e600/0xf3fe2838e1fc2d41 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131023.124664:0:9769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e600/0xf3fe2838e1fc2d41 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131023.124671:0:9769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e600/0xf3fe2838e1fc2d41 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131023.124759:0:9769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fa00/0xf3fe2838e1fc2d48 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131023.124768:0:9769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fa00/0xf3fe2838e1fc2d48 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131023.124804:0:9769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fa00/0xf3fe2838e1fc2d48 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789131023.124854:0:9769:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fa00/0xf3fe2838e1fc2d48 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131023.124867:0:9769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e800/0xf3fe2838e1fc2d3a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131023.124874:0:9769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e800/0xf3fe2838e1fc2d3a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131023.124881:0:9769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e800/0xf3fe2838e1fc2d3a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131023.124888:0:9769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc7f7e800 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:2.0:1789131023.124892:0:9769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e800/0xf3fe2838e1fc2d3a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131023.124899:0:9769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e800/0xf3fe2838e1fc2d3a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131023.124910:0:9769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff91dcc7d6bf00) 00010000:00010000:2.0:1789131023.124913:0:9769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789131023.124918:0:9769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e800/0xf3fe2838e1fc2d3a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131023.124925:0:9769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e800/0xf3fe2838e1fc2d3a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131023.124938:0:9769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e600/0xf3fe2838e1fc2d41 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131023.124951:0:9769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e600/0xf3fe2838e1fc2d41 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131023.124957:0:9769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e600/0xf3fe2838e1fc2d41 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131023.124962:0:9769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc7f7e600 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:2.0:1789131023.124965:0:9769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e600/0xf3fe2838e1fc2d41 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131023.124972:0:9769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e600/0xf3fe2838e1fc2d41 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131023.124981:0:9769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff91ddca4e4500) 00010000:00010000:2.0:1789131023.124984:0:9769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789131023.124987:0:9769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e600/0xf3fe2838e1fc2d41 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131023.124993:0:9769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e600/0xf3fe2838e1fc2d41 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131023.125003:0:9769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fa00/0xf3fe2838e1fc2d48 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131023.125009:0:9769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fa00/0xf3fe2838e1fc2d48 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131023.125015:0:9769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fa00/0xf3fe2838e1fc2d48 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131023.125020:0:9769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc7f7fa00 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:2.0:1789131023.125029:0:9769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fa00/0xf3fe2838e1fc2d48 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131023.125036:0:9769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fa00/0xf3fe2838e1fc2d48 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131023.125045:0:9769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff91dde1922b00) 00010000:00010000:2.0:1789131023.125047:0:9769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789131023.125050:0:9769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fa00/0xf3fe2838e1fc2d48 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131023.125057:0:9769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fa00/0xf3fe2838e1fc2d48 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131023.125135:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01b3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+37:12493:x1876039498285952:12345-192.168.203.11@tcp:34:lfs.0 Request processed in 597us (797us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131023.125143:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 164 00000100:00100000:0.0:1789131023.128057:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789131023.128146:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498286208 00000100:00100000:1.0:1789131023.128156:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498286208 00000100:00100000:1.0:1789131023.128212:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 40 00000100:00100000:1.0:1789131023.128222:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8d3ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+37:12493:x1876039498286208:12345-192.168.203.11@tcp:35:lfs.0 00000100:00100000:1.0:1789131023.128440:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8d3ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+38:12493:x1876039498286208:12345-192.168.203.11@tcp:35:lfs.0 Request processed in 218us (392us total) trans 4294967436 rc 0/0 00000100:00100000:1.0:1789131023.128449:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 40 00000100:00100000:3.0:1789131023.181342:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131023.183580:0:14851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498286464 00000100:00100000:2.0:1789131023.183594:0:14851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498286464 00000100:00100000:2.0:1789131023.183863:0:14851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 165 00000100:00100000:2.0:1789131023.183875:0:14851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd2869e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+38:12496:x1876039498286464:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:2.0:1789131023.183900:0:14851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789131023.183921:0:14851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fa00/0xf3fe2838e1fc2d4f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269ba9 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131023.183997:0:14851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e600/0xf3fe2838e1fc2d56 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131023.184011:0:14851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e600/0xf3fe2838e1fc2d56 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131023.184041:0:14851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e600/0xf3fe2838e1fc2d56 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131023.184055:0:14851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e800/0xf3fe2838e1fc2d5d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131023.184062:0:14851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e800/0xf3fe2838e1fc2d5d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131023.184068:0:14851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e800/0xf3fe2838e1fc2d5d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131023.184175:0:14851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f800/0xf3fe2838e1fc2d64 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131023.184184:0:14851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f800/0xf3fe2838e1fc2d64 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131023.184191:0:14851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f800/0xf3fe2838e1fc2d64 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789131023.184202:0:14851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1789131023.184281:0:14851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e600/0xf3fe2838e1fc2d56 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131023.184289:0:14851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e600/0xf3fe2838e1fc2d56 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131023.184297:0:14851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e600/0xf3fe2838e1fc2d56 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131023.184302:0:14851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc7f7e600 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:2.0:1789131023.184314:0:14851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e600/0xf3fe2838e1fc2d56 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131023.184322:0:14851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e600/0xf3fe2838e1fc2d56 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131023.184335:0:14851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff91dcc7d6bf00) 00010000:00010000:2.0:1789131023.184338:0:14851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789131023.184343:0:14851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e600/0xf3fe2838e1fc2d56 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131023.184351:0:14851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e600/0xf3fe2838e1fc2d56 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131023.184365:0:14851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e800/0xf3fe2838e1fc2d5d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131023.184371:0:14851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e800/0xf3fe2838e1fc2d5d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131023.184377:0:14851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e800/0xf3fe2838e1fc2d5d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131023.184382:0:14851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc7f7e800 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:2.0:1789131023.184385:0:14851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e800/0xf3fe2838e1fc2d5d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131023.184390:0:14851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e800/0xf3fe2838e1fc2d5d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131023.184398:0:14851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff91ddca4e4500) 00010000:00010000:2.0:1789131023.184401:0:14851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789131023.184410:0:14851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e800/0xf3fe2838e1fc2d5d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131023.184417:0:14851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e800/0xf3fe2838e1fc2d5d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131023.184516:0:14851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fa00/0xf3fe2838e1fc2d4f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269ba9 expref: 41 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131023.184532:0:14851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f800/0xf3fe2838e1fc2d64 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269ba9 expref: 40 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131023.184540:0:14851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff91dde1922b00) 00010000:00010000:2.0:1789131023.184542:0:14851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789131023.184545:0:14851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dcc7f7f800, rc 0) 00000100:00100000:2.0:1789131023.184622:0:14851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd2869e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+40:12496:x1876039498286464:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 749us (3289us total) trans 4294967437 rc 0/0 00000100:00100000:2.0:1789131023.184631:0:14851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 165 00000100:00100000:0.0:1789131023.195678:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789131023.196076:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498286592 00000100:00100000:1.0:1789131023.196086:0:14273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498286592 00000100:00100000:1.0:1789131023.196143:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 166 00000100:00100000:1.0:1789131023.196153:0:14273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8d3f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+40:12496:x1876039498286592:12345-192.168.203.11@tcp:54:lfs.0 00010000:00010000:1.0:1789131023.196215:0:14273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cac00/0xf3fe2838e1fc2d72 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131023.196231:0:14273:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cac00/0xf3fe2838e1fc2d72 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131023.196243:0:14273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cac00/0xf3fe2838e1fc2d72 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131023.196273:0:14273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cac00/0xf3fe2838e1fc2d72 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131023.196280:0:14273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cac00/0xf3fe2838e1fc2d72 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131023.196287:0:14273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cac00/0xf3fe2838e1fc2d72 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131023.196293:0:14273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc85cac00 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:1.0:1789131023.196297:0:14273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cac00/0xf3fe2838e1fc2d72 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131023.196304:0:14273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cac00/0xf3fe2838e1fc2d72 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131023.196314:0:14273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff91dde1922b00) 00010000:00010000:1.0:1789131023.196317:0:14273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789131023.196333:0:14273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cac00/0xf3fe2838e1fc2d72 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131023.196340:0:14273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cac00/0xf3fe2838e1fc2d72 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131023.196537:0:14273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8d3f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+40:12496:x1876039498286592:12345-192.168.203.11@tcp:54:lfs.0 Request processed in 385us (868us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131023.196546:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 166 00000100:00100000:1.0:1789131023.198599:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789131023.198731:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789131023.198776:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789131023.198827:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789131023.198863:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498286976 00000100:00100000:1.0:1789131023.198872:0:9827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498286976 00000100:00100000:1.0:1789131023.198933:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 137 00000100:00100000:1.0:1789131023.198945:0:9827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01b39680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+6:2387:x1876039498286976:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1789131023.199020:0:9827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01b39680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+6:2387:x1876039498286976:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 76us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131023.199030:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 137 00000100:00080000:1.0:1789131023.199055:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789131023.199074:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498286848 00000100:00100000:1.0:1789131023.199078:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498286848 00000100:00100000:1.0:1789131023.199122:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498287232 00000100:00100000:1.0:1789131023.199126:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498287232 00000100:00100000:1.0:1789131023.199163:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 354 00000100:00100000:1.0:1789131023.199173:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01b38780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+5:2388:x1876039498286848:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1789131023.199208:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01b38780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+5:2388:x1876039498286848:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 37us (618us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131023.199229:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 354 00000100:00100000:1.0:1789131023.199252:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 355 00000100:00100000:1.0:1789131023.199262:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7fd0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fde8d4a8-44db-4e6b-8249-c1c295e4901d+5:2387:x1876039498287232:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1789131023.199295:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7fd0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fde8d4a8-44db-4e6b-8249-c1c295e4901d+5:2387:x1876039498287232:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 35us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131023.199302:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 355 00000100:00080000:1.0:1789131023.199325:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789131023.199363:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498286720 00000100:00100000:1.0:1789131023.199368:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498286720 00000100:00100000:1.0:1789131023.199403:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 454 00000100:00100000:1.0:1789131023.199412:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8607450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+13:2387:x1876039498286720:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1789131023.199444:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8607450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+13:2387:x1876039498286720:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 34us (716us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131023.199452:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 454 00000100:00100000:0.0:1789131023.204842:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789131023.206140:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498287104 00000100:00100000:1.0:1789131023.206152:0:14273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498287104 00000100:00100000:1.0:1789131023.206216:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 356 00000100:00100000:1.0:1789131023.206227:0:14273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8d3c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fde8d4a8-44db-4e6b-8249-c1c295e4901d+5:2388:x1876039498287104:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1789131023.206300:0:14273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8d3c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fde8d4a8-44db-4e6b-8249-c1c295e4901d+5:2388:x1876039498287104:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 74us (1466us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131023.206308:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 356 00000100:00100000:1.0:1789131023.211300:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131023.211413:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498287488 00000100:00100000:0.0:1789131023.211422:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498287488 00000100:00100000:0.0:1789131023.211513:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 41 00000100:00100000:0.0:1789131023.211523:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7fd03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+40:12496:x1876039498287488:12345-192.168.203.11@tcp:35:lfs.0 00000100:00100000:0.0:1789131023.212095:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7fd03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+41:12496:x1876039498287488:12345-192.168.203.11@tcp:35:lfs.0 Request processed in 571us (802us total) trans 4294967438 rc 0/0 00000100:00100000:0.0:1789131023.212103:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 41 00010000:00010000:2.0:1789131023.251703:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789131023.456239:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789131023.457309:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498287744 00000100:00100000:1.0:1789131023.457322:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498287744 00000100:00100000:1.0:1789131023.457391:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 167 00000100:00100000:1.0:1789131023.457414:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8d3e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+41:12527:x1876039498287744:12345-192.168.203.11@tcp:101:cat.0 00010000:00010000:1.0:1789131023.457437:0:6502:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789131023.457483:0:6502:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cac00/0xf3fe2838e1fc2d79 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269bb0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131023.457583:0:6502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb600/0xf3fe2838e1fc2d80 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131023.457598:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb600/0xf3fe2838e1fc2d80 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131023.457610:0:6502:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb600/0xf3fe2838e1fc2d80 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789131023.457622:0:6502:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:1.0:1789131023.457723:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cac00/0xf3fe2838e1fc2d79 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269bb0 expref: 44 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131023.457744:0:6502:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb600/0xf3fe2838e1fc2d80 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269bb0 expref: 43 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131023.457753:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff91dde1922b00) 00010000:00010000:1.0:1789131023.457756:0:6502:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789131023.457760:0:6502:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dcc85cb600, rc 0) 00000100:00100000:1.0:1789131023.457837:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8d3e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+43:12527:x1876039498287744:12345-192.168.203.11@tcp:101:cat.0 Request processed in 425us (1616us total) trans 4294967439 rc 0/0 00000100:00100000:1.0:1789131023.457845:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 167 00000100:00100000:3.0:1789131023.460987:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131023.461074:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498288000 00000100:00100000:2.0:1789131023.461084:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498288000 00000100:00100000:2.0:1789131023.461149:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 42 00000100:00100000:2.0:1789131023.461159:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd286b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+43:12527:x1876039498288000:12345-192.168.203.11@tcp:35:cat.0 00000100:00100000:2.0:1789131023.461369:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd286b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+44:12527:x1876039498288000:12345-192.168.203.11@tcp:35:cat.0 Request processed in 210us (388us total) trans 4294967440 rc 0/0 00000100:00100000:2.0:1789131023.461377:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 42 00000100:00100000:0.0:1789131023.464163:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131023.464367:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498288128 00000100:00100000:2.0:1789131023.464376:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498288128 00000100:00100000:2.0:1789131023.464449:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 14 00000100:00100000:2.0:1789131023.464483:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8d3e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+44:2388:x1876039498288128:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789131023.464498:0:6485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789131023.464521:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb600/0xf3fe2838e1fc2d80 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269bb0 expref: 44 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131023.464541:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff91dde1922b00) 00010000:00010000:2.0:1789131023.464547:0:6485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789131023.464602:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8d3e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+43:2388:x1876039498288128:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 143us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131023.464610:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 14 00000100:00100000:0.0:1789131023.572142:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789131023.572321:0:14851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498288384 00000100:00100000:1.0:1789131023.572330:0:14851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498288384 00000100:00100000:1.0:1789131023.572409:0:14851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 168 00000100:00100000:1.0:1789131023.572420:0:14851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8d3d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+43:12533:x1876039498288384:12345-192.168.203.11@tcp:101:dd.0 00010000:00010000:1.0:1789131023.572443:0:14851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789131023.572446:0:14851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789131023.572523:0:14851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f600/0xf3fe2838e1fc2ce6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269b86 expref: 43 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131023.572542:0:14851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff91dcc7d6bf00) 00010000:00010000:1.0:1789131023.572547:0:14851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789131023.572561:0:14851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cac00/0xf3fe2838e1fc2d8e lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269bb7 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131023.572664:0:14851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cae00/0xf3fe2838e1fc2d95 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131023.572677:0:14851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f800/0xf3fe2838e1fc2d64 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269ba9 expref: 43 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131023.572686:0:14851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cae00/0xf3fe2838e1fc2d95 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131023.572716:0:14851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f800/0xf3fe2838e1fc2d64 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269ba9 expref: 43 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131023.572729:0:14851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f800/0xf3fe2838e1fc2d64 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269ba9 expref: 43 pid: 14851 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131023.572742:0:14851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7fd1e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:14851:1876039508850048:192.168.203.11@tcp:104: 00000100:00100000:1.0:1789131023.572851:0:14851:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddff8be9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789131023.576997:0:14851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7fd1e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:14851:1876039508850048:192.168.203.11@tcp:104: 00010000:00010000:1.0:1789131023.577025:0:14851:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cae00/0xf3fe2838e1fc2d95 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131023.577638:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789131023.577705:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498288512 00000100:00100000:1.0:1789131023.577712:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498288512 00010000:00010000:1.0:1789131023.577743:0:6487:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f800/0xf3fe2838e1fc2d64 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269ba9 expref: 44 pid: 14851 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131023.577783:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 94 00000100:00100000:1.0:1789131023.577803:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01b30780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+44:2387:x1876039498288512:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789131023.577816:0:6487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789131023.577823:0:6487:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f800/0xf3fe2838e1fc2d64 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269ba9 expref: 44 pid: 14851 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131023.577835:0:6487:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f800/0xf3fe2838e1fc2d64 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269ba9 expref: 44 pid: 14851 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131023.577857:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f800/0xf3fe2838e1fc2d64 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269ba9 expref: 44 pid: 14851 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131023.577882:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff91dde1922b00) 00010000:00010000:1.0:1789131023.577887:0:6487:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cae00/0xf3fe2838e1fc2d95 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131023.577897:0:6487:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cae00/0xf3fe2838e1fc2d95 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131023.577922:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cae00/0xf3fe2838e1fc2d95 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131023.577951:0:6487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789131023.578002:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01b30780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+43:2387:x1876039498288512:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 200us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131023.578010:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 94 00010000:00010000:2.0:1789131023.578116:0:14851:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cae00/0xf3fe2838e1fc2d95 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131023.578124:0:14851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cae00/0xf3fe2838e1fc2d95 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789131023.578141:0:14851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1789131023.578275:0:14851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cac00/0xf3fe2838e1fc2d8e lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269bb7 expref: 44 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131023.578293:0:14851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cae00/0xf3fe2838e1fc2d95 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269bb7 expref: 43 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131023.578300:0:14851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff91dde1922b00) 00010000:00010000:2.0:1789131023.578303:0:14851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789131023.578305:0:14851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dcc85cae00, rc 0) 00000100:00100000:2.0:1789131023.578329:0:14851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8d3d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+43:12533:x1876039498288384:12345-192.168.203.11@tcp:101:dd.0 Request processed in 5912us (6198us total) trans 4294967441 rc 0/0 00000100:00100000:2.0:1789131023.578341:0:14851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 168 00000100:00100000:3.0:1789131023.580897:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789131023.581032:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498288640 00000100:00100000:1.0:1789131023.581040:0:14273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498288640 00000100:00100000:1.0:1789131023.581092:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 169 00000100:00100000:1.0:1789131023.581102:0:14273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd2868f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+43:12533:x1876039498288640:12345-192.168.203.11@tcp:101:dd.0 00010000:00010000:1.0:1789131023.581123:0:14273:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789131023.581142:0:14273:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb200/0xf3fe2838e1fc2da3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269bbe expref: -99 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131023.581192:0:14273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca200/0xf3fe2838e1fc2daa lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131023.581206:0:14273:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca200/0xf3fe2838e1fc2daa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131023.581218:0:14273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca200/0xf3fe2838e1fc2daa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131023.581331:0:14273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb200/0xf3fe2838e1fc2da3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269bbe expref: 45 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131023.581349:0:14273:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca200/0xf3fe2838e1fc2daa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269bbe expref: 44 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131023.581364:0:14273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff91dde1922b00) 00010000:00010000:1.0:1789131023.581368:0:14273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789131023.581371:0:14273:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dcc85ca200, rc 0) 00000100:00100000:1.0:1789131023.581429:0:14273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd2868f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+44:12533:x1876039498288640:12345-192.168.203.11@tcp:101:dd.0 Request processed in 329us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131023.581437:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 169 00000100:00100000:0.0:1789131023.586514:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131023.586812:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498288896 00000100:00100000:3.0:1789131023.586821:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498288896 00000100:00100000:3.0:1789131023.586880:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 170 00000100:00100000:3.0:1789131023.586890:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc5feb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+44:12533:x1876039498288896:12345-192.168.203.11@tcp:36:dd.0 00010000:00010000:3.0:1789131023.587259:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5800/0xf3fe2838e1fc2db1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131023.587276:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5800/0xf3fe2838e1fc2db1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131023.587287:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5800/0xf3fe2838e1fc2db1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789131023.587333:0:6500:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967442 00000004:00010000:3.0:1789131023.587370:0:6500:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000005c4be2e6 reply state 00000000e4dad248 transno 4294967443 ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5800/0xf3fe2838e1fc2db1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131023.587383:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5800/0xf3fe2838e1fc2db1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131023.587391:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff91dde1922b00) 00010000:00010000:3.0:1789131023.587393:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789131023.587397:0:6500:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789131023.587665:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc5feb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+47:12533:x1876039498288896:12345-192.168.203.11@tcp:36:dd.0 Request processed in 775us (1158us total) trans 4294967443 rc 0/0 00000100:00100000:3.0:1789131023.587674:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 170 00000020:00080000:3.0:1789131023.587679:0:6500:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789131023.853867:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131023.854014:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498289024 00000100:00100000:3.0:1789131023.854023:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498289024 00000100:00100000:3.0:1789131023.854083:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 171 00000100:00100000:3.0:1789131023.854093:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc5fea940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+47:12547:x1876039498289024:12345-192.168.203.11@tcp:101:stat.0 00010000:00010000:3.0:1789131023.854114:0:9769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789131023.854133:0:9769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4a00/0xf3fe2838e1fc2db8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269bc5 expref: -99 pid: 9769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131023.854194:0:9769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc2dbf lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131023.854215:0:9769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc2dbf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131023.854225:0:9769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc2dbf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131023.854236:0:9769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4c00/0xf3fe2838e1fc2dc6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131023.854255:0:9769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4c00/0xf3fe2838e1fc2dc6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131023.854262:0:9769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4c00/0xf3fe2838e1fc2dc6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131023.854597:0:9769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5200/0xf3fe2838e1fc2dcd lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131023.854609:0:9769:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cae00/0xf3fe2838e1fc2d95 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269bb7 expref: 48 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131023.854617:0:9769:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5200/0xf3fe2838e1fc2dcd lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131023.854651:0:9769:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cae00/0xf3fe2838e1fc2d95 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269bb7 expref: 48 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131023.854665:0:9769:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cae00/0xf3fe2838e1fc2d95 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269bb7 expref: 48 pid: 14851 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131023.854678:0:9769:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd286b840 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9769:1876039508850176:192.168.203.11@tcp:104: 00000100:00100000:3.0:1789131023.854770:0:9769:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddc3293c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789131023.860228:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789131023.860512:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498289280 00000100:00100000:1.0:1789131023.860521:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498289280 00000100:00100000:1.0:1789131023.860594:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 43 00000100:00100000:1.0:1789131023.860604:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddca0fa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+49:11030:x1876039498289280:12345-192.168.203.11@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1789131023.861447:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddca0fa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+50:11030:x1876039498289280:12345-192.168.203.11@tcp:35:ldlm_bl.0 Request processed in 841us (1224us total) trans 4294967444 rc 0/0 00000100:00100000:1.0:1789131023.861456:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 43 00000100:00100000:3.0:1789131023.862055:0:9769:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd286b840 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9769:1876039508850176:192.168.203.11@tcp:104: 00010000:00010000:3.0:1789131023.862080:0:9769:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5200/0xf3fe2838e1fc2dcd lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131023.869693:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131023.869798:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498289408 00000100:00100000:2.0:1789131023.869807:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498289408 00010000:00010000:2.0:1789131023.869848:0:6485:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cae00/0xf3fe2838e1fc2d95 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269bb7 expref: 50 pid: 14851 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131023.869900:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 95 00000100:00100000:2.0:1789131023.869910:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddca0fb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+50:2388:x1876039498289408:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789131023.869924:0:6485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789131023.869931:0:6485:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cae00/0xf3fe2838e1fc2d95 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269bb7 expref: 50 pid: 14851 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131023.869945:0:6485:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cae00/0xf3fe2838e1fc2d95 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269bb7 expref: 50 pid: 14851 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131023.869968:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cae00/0xf3fe2838e1fc2d95 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269bb7 expref: 50 pid: 14851 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131023.869987:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff91dde1922b00) 00010000:00010000:2.0:1789131023.869992:0:6485:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5200/0xf3fe2838e1fc2dcd lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131023.870013:0:6485:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5200/0xf3fe2838e1fc2dcd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131023.870021:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5200/0xf3fe2838e1fc2dcd lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131023.870066:0:6485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789131023.870121:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddca0fb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+49:2388:x1876039498289408:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 212us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131023.870129:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 95 00010000:00010000:3.0:1789131023.870771:0:9769:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5200/0xf3fe2838e1fc2dcd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131023.870799:0:9769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5200/0xf3fe2838e1fc2dcd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789131023.870853:0:9769:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1789131023.870857:0:9769:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789131023.871559:0:9769:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5200/0xf3fe2838e1fc2dcd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131023.871577:0:9769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5200/0xf3fe2838e1fc2dcd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131023.871586:0:9769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc2dbf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131023.871593:0:9769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc2dbf lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131023.871600:0:9769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc2dbf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131023.871606:0:9769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddfd0b5a00 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:3.0:1789131023.871610:0:9769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc2dbf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131023.871617:0:9769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc2dbf lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131023.871629:0:9769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff91dcc7d6bf00) 00010000:00010000:3.0:1789131023.871633:0:9769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789131023.871637:0:9769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc2dbf lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131023.871654:0:9769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc2dbf lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131023.871668:0:9769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4c00/0xf3fe2838e1fc2dc6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131023.871674:0:9769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4c00/0xf3fe2838e1fc2dc6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131023.871679:0:9769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4c00/0xf3fe2838e1fc2dc6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131023.871684:0:9769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddfd0b4c00 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:3.0:1789131023.871686:0:9769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4c00/0xf3fe2838e1fc2dc6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131023.871691:0:9769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4c00/0xf3fe2838e1fc2dc6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131023.871699:0:9769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff91ddca4e4500) 00010000:00010000:3.0:1789131023.871701:0:9769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789131023.871704:0:9769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4c00/0xf3fe2838e1fc2dc6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131023.871709:0:9769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4c00/0xf3fe2838e1fc2dc6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131023.871743:0:9769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4a00/0xf3fe2838e1fc2db8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269bc5 expref: 49 pid: 9769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131023.871757:0:9769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5200/0xf3fe2838e1fc2dcd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269bc5 expref: 48 pid: 9769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131023.871772:0:9769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff91dde1922b00) 00010000:00010000:3.0:1789131023.871774:0:9769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789131023.871777:0:9769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ddfd0b5200, rc 0) 00000100:00100000:3.0:1789131023.871853:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc5fea940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+48:12547:x1876039498289024:12345-192.168.203.11@tcp:101:stat.0 Request processed in 17761us (17994us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131023.874809:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 171 00000100:00100000:2.0:1789131023.953753:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8d14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1876039508850560:0@lo:400:kworker.0 00000100:00100000:2.0:1789131023.953838:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131023.953911:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc86083c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3628:1876039508851072:0@lo:400:kworker.0 00000100:00100000:2.0:1789131023.953940:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131023.953965:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7b27c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3628:1876039508851584:0@lo:400:kworker.0 00000100:00100000:2.0:1789131023.953987:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131023.954294:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1789131023.954302:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8d17840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3628:1876039508850432:0@lo:400:kworker.0 00000100:00100000:2.0:1789131023.954328:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131023.954348:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc86092c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3628:1876039508850944:0@lo:400:kworker.0 00000100:00100000:2.0:1789131023.954370:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131023.954387:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7b25e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3628:1876039508851456:0@lo:400:kworker.0 00000100:00100000:2.0:1789131023.954410:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131023.954443:0:11069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508850560 00000100:00100000:2.0:1789131023.954450:0:11069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508850560 00000100:00100000:2.0:1789131023.954532:0:11069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1789131023.954541:0:11069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8cdfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3628:x1876039508850560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131023.954594:0:11069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8cdfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3628:x1876039508850560:12345-0@lo:400:kworker.0 Request processed in 54us (755us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131023.954601:0:11069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1789131023.954668:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8d14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1876039508850560:0@lo:400:kworker.0 00000100:00100000:2.0:1789131023.954691:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508851072 00000100:00100000:2.0:1789131023.954695:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508851072 00000100:00100000:2.0:1789131023.954725:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508851584 00000100:00100000:2.0:1789131023.954728:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508851584 00000100:00100000:2.0:1789131023.954741:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508850432 00000100:00100000:2.0:1789131023.954743:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508850432 00000100:00100000:2.0:1789131023.954753:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508850944 00000100:00100000:2.0:1789131023.954756:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508850944 00000100:00100000:2.0:1789131023.954769:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508851456 00000100:00100000:2.0:1789131023.954772:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508851456 00000100:00100000:2.0:1789131023.954797:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:2.0:1789131023.954804:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8cde1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3628:x1876039508851072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131023.954849:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8cde1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3628:x1876039508851072:12345-0@lo:400:kworker.0 Request processed in 46us (908us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131023.954856:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:3.0:1789131023.954966:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8d161c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3626:1876039508850304:0@lo:400:kworker.0 00000100:00100000:3.0:1789131023.955016:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131023.955042:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8608f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508850816:0@lo:400:kworker.0 00000100:00100000:3.0:1789131023.955065:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131023.955083:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7b261c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508851328:0@lo:400:kworker.0 00000100:00100000:3.0:1789131023.955106:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131023.955125:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8cded00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508851840:0@lo:400:kworker.0 00000100:00100000:3.0:1789131023.955147:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131023.955167:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1789131023.955173:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc860b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3626:1876039508850688:0@lo:400:kworker.0 00000100:00100000:3.0:1789131023.955195:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131023.955207:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8608000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1876039508851200:0@lo:400:kworker.0 00000100:00100000:3.0:1789131023.955226:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131023.955240:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7b24b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1876039508851712:0@lo:400:kworker.0 00000100:00100000:3.0:1789131023.955259:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131023.955284:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508850304 00000100:00100000:3.0:1789131023.955287:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508850304 00000100:00100000:3.0:1789131023.955320:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 455 00000100:00100000:3.0:1789131023.955327:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8607850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+24:3626:x1876039508850304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789131023.955366:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8607850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+24:3626:x1876039508850304:12345-0@lo:400:kworker.0 Request processed in 38us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131023.955372:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 455 00000100:00100000:3.0:1789131023.955399:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508850816 00000100:00100000:3.0:1789131023.955402:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508850816 00000100:00100000:3.0:1789131023.955422:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1789131023.955428:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd286b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508850816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789131023.955478:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd286b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508850816:12345-0@lo:400:kworker.0 Request processed in 29us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131023.955486:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1789131023.955515:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8d161c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3626:1876039508850304:0@lo:400:kworker.0 00000100:00100000:3.0:1789131023.955524:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8608f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508850816:0@lo:400:kworker.0 00000100:00100000:3.0:1789131023.955543:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508851328 00000100:00100000:3.0:1789131023.955546:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508851328 00000100:00100000:3.0:1789131023.955564:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508851840 00000100:00100000:3.0:1789131023.955567:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508851840 00000100:00100000:3.0:1789131023.955580:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508851200 00000100:00100000:3.0:1789131023.955583:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508851200 00000100:00100000:3.0:1789131023.955595:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508851712 00000100:00100000:3.0:1789131023.955598:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508851712 00000100:00100000:3.0:1789131023.955611:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1789131023.955617:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd28692c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3626:x1876039508851328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789131023.955653:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd28692c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3626:x1876039508851328:12345-0@lo:400:kworker.0 Request processed in 36us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131023.955659:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1789131023.955678:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1789131023.955684:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddca1821c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508851840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789131023.955715:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddca1821c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508851840:12345-0@lo:400:kworker.0 Request processed in 31us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131023.955720:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1789131023.955731:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1789131023.955736:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc2e85e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1876039508851200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789131023.955762:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc2e85e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1876039508851200:12345-0@lo:400:kworker.0 Request processed in 26us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131023.955768:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1789131023.955778:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1789131023.955796:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc2e87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1876039508851712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789131023.955825:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc2e87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1876039508851712:12345-0@lo:400:kworker.0 Request processed in 41us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131023.955831:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1789131023.955856:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8608000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1876039508851200:0@lo:400:kworker.0 00000100:00100000:3.0:1789131023.955881:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7b24b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1876039508851712:0@lo:400:kworker.0 00000100:00100000:3.0:1789131023.955890:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7b261c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508851328:0@lo:400:kworker.0 00000100:00100000:3.0:1789131023.955899:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8cded00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508851840:0@lo:400:kworker.0 00000100:00100000:3.0:1789131023.955925:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508850688 00000100:00100000:3.0:1789131023.955928:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508850688 00000100:00100000:3.0:1789131023.955947:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:3.0:1789131023.955953:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8cdc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3628:x1876039508851584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789131023.955985:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8cdc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3628:x1876039508851584:12345-0@lo:400:kworker.0 Request processed in 32us (1997us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131023.955999:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:3.0:1789131023.956013:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:3.0:1789131023.956019:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8cdf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1876039508850432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789131023.956051:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8cdf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1876039508850432:12345-0@lo:400:kworker.0 Request processed in 33us (1723us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131023.956056:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:3.0:1789131023.956068:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:3.0:1789131023.956074:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8cdda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3628:x1876039508850944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789131023.956099:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8cdda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3628:x1876039508850944:12345-0@lo:400:kworker.0 Request processed in 26us (1729us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131023.956105:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:3.0:1789131023.956117:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:3.0:1789131023.956123:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8cdde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3628:x1876039508851456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789131023.956151:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8cdde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3628:x1876039508851456:12345-0@lo:400:kworker.0 Request processed in 28us (1740us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131023.956156:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:3.0:1789131023.956167:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:3.0:1789131023.956173:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddca181a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1876039508850688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789131023.956203:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddca181a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1876039508850688:12345-0@lo:400:kworker.0 Request processed in 31us (1007us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131023.956208:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:3.0:1789131023.956233:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc860b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3626:1876039508850688:0@lo:400:kworker.0 00000100:00100000:3.0:1789131023.956300:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8d17840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3628:1876039508850432:0@lo:400:kworker.0 00000100:00100000:3.0:1789131023.956321:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc86092c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3628:1876039508850944:0@lo:400:kworker.0 00000100:00100000:3.0:1789131023.956331:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7b25e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3628:1876039508851456:0@lo:400:kworker.0 00010000:00080000:3.0:1789131023.956342:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc86083c0 x1876039508851072/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789131039 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789131023.956352:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc86083c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3628:1876039508851072:0@lo:400:kworker.0 00010000:00080000:3.0:1789131023.956361:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc7b27c00 x1876039508851584/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789131039 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789131023.956368:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7b27c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3628:1876039508851584:0@lo:400:kworker.0 00000100:00080000:1.0:1789131023.957985:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789131023.958006:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789131023.958010:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789131023.958012:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789131023.959414:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789131023.959432:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7fd1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1876039508851968:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789131023.959535:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131023.961202:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789131023.961220:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddc2e852c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508852096:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789131023.961275:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131023.961349:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508851968 00000100:00100000:2.0:1789131023.961356:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508851968 00000100:00100000:2.0:1789131023.961400:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508852096 00000100:00100000:2.0:1789131023.961403:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508852096 00000100:00100000:2.0:1789131023.961419:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1789131023.961427:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7fd3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1876039508851968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789131023.961838:0:14495:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1789131023.961897:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7fd3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1876039508851968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 469us (2360us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131023.961904:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1789131023.961934:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1789131023.961941:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8cdcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508852096:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789131023.961951:0:14495:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1789131023.961986:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8cdcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508852096:12345-0@lo:13:osp-pre-1-1.0 Request processed in 45us (710us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131023.961992:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1789131023.962174:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddc2e852c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508852096:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789131023.963778:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7fd1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1876039508851968:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789131024.008752:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131024.008885:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498289664 00000100:00100000:3.0:1789131024.008899:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498289664 00000100:00100000:3.0:1789131024.009056:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 172 00000100:00100000:3.0:1789131024.009070:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddca0fbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+48:12553:x1876039498289664:12345-192.168.203.11@tcp:36:truncate.0 00010000:00010000:3.0:1789131024.009151:0:9769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789131024.009187:0:9769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5200/0xf3fe2838e1fc2dcd lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269bc5 expref: 48 pid: 9769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131024.009212:0:9769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff91dde1922b00) 00010000:00010000:3.0:1789131024.009219:0:9769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789131024.009444:0:9769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4a00/0xf3fe2838e1fc2dd4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131024.009530:0:9769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4a00/0xf3fe2838e1fc2dd4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131024.009544:0:9769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4a00/0xf3fe2838e1fc2dd4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789131024.009587:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:3.0:1789131024.009617:0:9769:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967445 00000004:00010000:3.0:1789131024.009643:0:9769:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000bdd71952 reply state 000000001df11793 transno 4294967446 ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4a00/0xf3fe2838e1fc2dd4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131024.009657:0:9769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4a00/0xf3fe2838e1fc2dd4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131024.009663:0:9769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff91dde1922b00) 00010000:00010000:3.0:1789131024.009666:0:9769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789131024.009669:0:9769:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789131024.009798:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddca0fbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+50:12553:x1876039498289664:12345-192.168.203.11@tcp:36:truncate.0 Request processed in 730us (1060us total) trans 4294967446 rc 0/0 00000100:00100000:3.0:1789131024.009807:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 172 00000020:00080000:3.0:1789131024.009813:0:9769:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789131024.273720:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789131024.283709:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131024.284181:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498289792 00000100:00100000:3.0:1789131024.284193:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498289792 00000100:00100000:3.0:1789131024.284319:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 173 00000100:00100000:3.0:1789131024.284330:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01a5cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+50:12567:x1876039498289792:12345-192.168.203.11@tcp:101:stat.0 00010000:00010000:3.0:1789131024.284355:0:6501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789131024.284375:0:6501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5200/0xf3fe2838e1fc2ddb lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269bcc expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131024.284437:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4c00/0xf3fe2838e1fc2de2 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131024.284506:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4c00/0xf3fe2838e1fc2de2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131024.284538:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4c00/0xf3fe2838e1fc2de2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131024.284551:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc2de9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131024.284558:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc2de9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131024.284565:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc2de9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131024.284634:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4600/0xf3fe2838e1fc2df0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131024.284643:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4600/0xf3fe2838e1fc2df0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131024.284650:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4600/0xf3fe2838e1fc2df0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789131024.284688:0:6501:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00000004:00200000:3.0:1789131024.284693:0:6501:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789131024.284712:0:6501:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4600/0xf3fe2838e1fc2df0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131024.284724:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4600/0xf3fe2838e1fc2df0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131024.284732:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4c00/0xf3fe2838e1fc2de2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131024.284747:0:6501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4c00/0xf3fe2838e1fc2de2 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131024.284754:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4c00/0xf3fe2838e1fc2de2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131024.284760:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddfd0b4c00 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:3.0:1789131024.284764:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4c00/0xf3fe2838e1fc2de2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131024.284771:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4c00/0xf3fe2838e1fc2de2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131024.284794:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff91dcc7d6bf00) 00010000:00010000:3.0:1789131024.284797:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789131024.284801:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4c00/0xf3fe2838e1fc2de2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131024.284807:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4c00/0xf3fe2838e1fc2de2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131024.284820:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc2de9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131024.284826:0:6501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc2de9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131024.284832:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc2de9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131024.284837:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddfd0b5a00 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:3.0:1789131024.284845:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc2de9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131024.284852:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc2de9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131024.284859:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff91ddca4e4500) 00010000:00010000:3.0:1789131024.284862:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789131024.284865:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc2de9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131024.284871:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc2de9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131024.284899:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5200/0xf3fe2838e1fc2ddb lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269bcc expref: 52 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131024.284911:0:6501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4600/0xf3fe2838e1fc2df0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269bcc expref: 51 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131024.284917:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff91dde1922b00) 00010000:00010000:3.0:1789131024.284919:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789131024.284922:0:6501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ddfd0b4600, rc 0) 00000100:00100000:3.0:1789131024.284986:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01a5cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+51:12567:x1876039498289792:12345-192.168.203.11@tcp:101:stat.0 Request processed in 657us (1286us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131024.285008:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 173 00000100:00100000:1.0:1789131024.430277:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131024.430500:0:14851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498290048 00000100:00100000:3.0:1789131024.430509:0:14851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498290048 00000100:00100000:3.0:1789131024.430570:0:14851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 174 00000100:00100000:3.0:1789131024.430581:0:14851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7fd1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+51:12577:x1876039498290048:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:3.0:1789131024.430626:0:14851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789131024.430647:0:14851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5200/0xf3fe2838e1fc2df7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269bd3 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789131024.430753:0:14851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1789131024.430859:0:14851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5200/0xf3fe2838e1fc2df7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269bd3 expref: 53 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131024.430874:0:14851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91dded3a2600) 00010000:00010000:3.0:1789131024.430877:0:14851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789131024.430882:0:14851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5200/0xf3fe2838e1fc2df7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269bd3 expref: 53 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131024.430896:0:14851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ddfd0b5200, rc 0) 00000100:00100000:3.0:1789131024.430959:0:14851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7fd1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+52:12577:x1876039498290048:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 380us (693us total) trans 4294967447 rc 301/301 00000100:00100000:3.0:1789131024.431375:0:14851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 174 00000100:00100000:0.0:1789131024.439682:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131024.439774:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498290304 00000100:00100000:2.0:1789131024.439794:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498290304 00000100:00100000:2.0:1789131024.439849:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 44 00000100:00100000:2.0:1789131024.439858:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dded1d3050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+52:12577:x1876039498290304:12345-192.168.203.11@tcp:35:lfs.0 00000100:00100000:2.0:1789131024.440104:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dded1d3050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+53:12577:x1876039498290304:12345-192.168.203.11@tcp:35:lfs.0 Request processed in 246us (430us total) trans 4294967448 rc 0/0 00000100:00100000:2.0:1789131024.440114:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 44 00000004:00080000:0.0:1789131024.468642:0:8862:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 380386180487ns, next at 381386177670ns, rc = 0 00000100:00100000:3.0:1789131024.468717:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789131024.468742:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01a5f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508852224:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789131024.468825:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131024.469112:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508852224 00000100:00100000:0.0:1789131024.469121:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508852224 00000100:00100000:0.0:1789131024.469189:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1789131024.469199:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc2e843c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3626:x1876039508852224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789131024.469225:0:14495:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:0.0:1789131024.469280:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc2e843c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3626:x1876039508852224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131024.469288:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1789131024.469331:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01a5f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508852224:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789131024.469437:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789131024.495558:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131024.495804:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498290560 00000100:00100000:3.0:1789131024.495824:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498290560 00000100:00100000:3.0:1789131024.495879:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 175 00000100:00100000:3.0:1789131024.495899:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01a5f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+53:12583:x1876039498290560:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:3.0:1789131024.495924:0:9769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789131024.495943:0:9769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5200/0xf3fe2838e1fc2e05 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269bda expref: -99 pid: 9769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131024.496074:0:9769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc2e0c lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131024.496090:0:9769:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4600/0xf3fe2838e1fc2df0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269bcc expref: 54 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131024.496100:0:9769:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc2e0c lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131024.496133:0:9769:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4600/0xf3fe2838e1fc2df0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269bcc expref: 54 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131024.496146:0:9769:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4600/0xf3fe2838e1fc2df0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269bcc expref: 54 pid: 6501 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131024.496159:0:9769:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddc2e85a40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9769:1876039508852352:192.168.203.11@tcp:104: 00000100:00100000:3.0:1789131024.496265:0:9769:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddc3293180 going to sleep for 11 seconds 00000100:00100000:0.0:1789131024.507176:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789131024.507619:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498290688 00000100:00100000:1.0:1789131024.507642:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498290688 00010000:00010000:1.0:1789131024.507683:0:6487:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4600/0xf3fe2838e1fc2df0 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269bcc expref: 55 pid: 6501 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131024.507729:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 96 00000100:00100000:1.0:1789131024.507740:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc33ae850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+55:2387:x1876039498290688:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789131024.507754:0:6487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789131024.507761:0:6487:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4600/0xf3fe2838e1fc2df0 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269bcc expref: 55 pid: 6501 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131024.507774:0:6487:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4600/0xf3fe2838e1fc2df0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269bcc expref: 55 pid: 6501 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131024.507806:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff91dde1922b00) 00010000:00010000:1.0:1789131024.507812:0:6487:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc2e0c lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131024.507822:0:6487:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc2e0c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131024.507830:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc2e0c lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131024.507848:0:6487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789131024.507910:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc33ae850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+55:2387:x1876039498290688:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 173us (743us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131024.507918:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 96 00010000:00010000:3.0:1789131024.512924:0:9769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4600/0xf3fe2838e1fc2df0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269bcc expref: 54 pid: 6501 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131024.512950:0:9769:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddc2e85a40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9769:1876039508852352:192.168.203.11@tcp:104: 00010000:00010000:3.0:1789131024.512972:0:9769:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc2e0c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131024.512983:0:9769:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc2e0c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131024.513018:0:9769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc2e0c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789131024.513041:0:9769:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00010000:00010000:3.0:1789131024.513168:0:9769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5200/0xf3fe2838e1fc2e05 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269bda expref: 55 pid: 9769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131024.513184:0:9769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc2e0c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269bda expref: 54 pid: 9769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131024.513193:0:9769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff91dde1922b00) 00010000:00010000:3.0:1789131024.513195:0:9769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789131024.513199:0:9769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ddfd0b5a00, rc 0) 00000100:00100000:3.0:1789131024.513252:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01a5f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+54:12583:x1876039498290560:12345-192.168.203.11@tcp:101:bash.0 Request processed in 17355us (17703us total) trans 4294967449 rc 0/0 00000100:00100000:3.0:1789131024.513261:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 175 00000100:00100000:1.0:1789131024.541403:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131024.541514:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498290944 00000100:00100000:3.0:1789131024.541525:0:14273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498290944 00000100:00100000:3.0:1789131024.541590:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 176 00000100:00100000:3.0:1789131024.541601:0:14273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7fd0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+54:12583:x1876039498290944:12345-192.168.203.11@tcp:36:bash.0 00010000:00010000:3.0:1789131024.541893:0:14273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5200/0xf3fe2838e1fc2e1a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131024.541910:0:14273:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5200/0xf3fe2838e1fc2e1a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131024.541922:0:14273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5200/0xf3fe2838e1fc2e1a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789131024.541972:0:14273:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967450 00000004:00010000:3.0:1789131024.542267:0:14273:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000035011cf1 reply state 00000000f2a628be transno 4294967451 ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5200/0xf3fe2838e1fc2e1a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131024.542282:0:14273:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5200/0xf3fe2838e1fc2e1a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131024.542289:0:14273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff91dde1922b00) 00010000:00010000:3.0:1789131024.542292:0:14273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789131024.542296:0:14273:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789131024.542437:0:14273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7fd0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+57:12583:x1876039498290944:12345-192.168.203.11@tcp:36:bash.0 Request processed in 837us (1041us total) trans 4294967451 rc 0/0 00000100:00100000:3.0:1789131024.542446:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 176 00000020:00080000:3.0:1789131024.542451:0:14273:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789131024.562981:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131024.563143:0:14851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498291072 00000100:00100000:0.0:1789131024.563154:0:14851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498291072 00000100:00100000:0.0:1789131024.563214:0:14851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 177 00000100:00100000:0.0:1789131024.563223:0:14851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8cdf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+57:12583:x1876039498291072:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:0.0:1789131024.563257:0:14851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789131024.563276:0:14851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7e00/0xf3fe2838e1fc2e21 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269be1 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131024.563356:0:14851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7400/0xf3fe2838e1fc2e28 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131024.563371:0:14851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc2e0c lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269bda expref: 58 pid: 9769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131024.563380:0:14851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7400/0xf3fe2838e1fc2e28 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131024.563411:0:14851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc2e0c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269bda expref: 58 pid: 9769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131024.563425:0:14851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc2e0c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269bda expref: 58 pid: 9769 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131024.563438:0:14851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01a5c780 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:14851:1876039508852480:192.168.203.11@tcp:104: 00000100:00100000:0.0:1789131024.563611:0:14851:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddc4e08300 going to sleep for 11 seconds 00000100:00100000:3.0:1789131024.572747:0:14851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01a5c780 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:14851:1876039508852480:192.168.203.11@tcp:104: 00010000:00010000:3.0:1789131024.572792:0:14851:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7400/0xf3fe2838e1fc2e28 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131024.572953:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131024.573240:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498291200 00000100:00100000:3.0:1789131024.573247:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498291200 00010000:00010000:3.0:1789131024.573283:0:6485:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc2e0c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269bda expref: 59 pid: 9769 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131024.573311:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 97 00000100:00100000:3.0:1789131024.573321:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8cdf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+59:2387:x1876039498291200:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789131024.573335:0:6485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789131024.573341:0:6485:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc2e0c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269bda expref: 59 pid: 9769 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131024.573368:0:6485:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc2e0c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269bda expref: 59 pid: 9769 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131024.573390:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc2e0c lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269bda expref: 59 pid: 9769 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131024.573405:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff91dde1922b00) 00010000:00010000:3.0:1789131024.573410:0:6485:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7400/0xf3fe2838e1fc2e28 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131024.573419:0:6485:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7400/0xf3fe2838e1fc2e28 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131024.573427:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7400/0xf3fe2838e1fc2e28 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131024.573503:0:6485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789131024.573549:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8cdf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+58:2387:x1876039498291200:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 229us (597us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131024.573557:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 97 00010000:00010000:0.0:1789131024.573681:0:14851:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7400/0xf3fe2838e1fc2e28 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131024.573690:0:14851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7400/0xf3fe2838e1fc2e28 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789131024.573744:0:14851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:0.0:1789131024.573749:0:14851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789131024.573793:0:14851:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7400/0xf3fe2838e1fc2e28 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131024.573824:0:14851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7e00/0xf3fe2838e1fc2e21 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269be1 expref: 58 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131024.573841:0:14851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7400/0xf3fe2838e1fc2e28 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269be1 expref: 57 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131024.573848:0:14851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff91dde1922b00) 00010000:00010000:0.0:1789131024.573851:0:14851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789131024.573853:0:14851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91de01ad7400, rc 0) 00000100:00100000:0.0:1789131024.573879:0:14851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8cdf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+57:12583:x1876039498291072:12345-192.168.203.11@tcp:101:bash.0 Request processed in 10658us (10907us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131024.573898:0:14851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 177 00000100:00100000:0.0:1789131024.582288:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131024.582408:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498291456 00000100:00100000:2.0:1789131024.582419:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498291456 00000100:00100000:2.0:1789131024.582503:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 45 00000100:00100000:2.0:1789131024.582514:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01a5da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+57:12583:x1876039498291456:12345-192.168.203.11@tcp:35:bash.0 00000100:00100000:2.0:1789131024.582733:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01a5da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+58:12583:x1876039498291456:12345-192.168.203.11@tcp:35:bash.0 Request processed in 220us (454us total) trans 4294967452 rc 0/0 00000100:00100000:2.0:1789131024.582741:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 45 00000100:00100000:1.0:1789131024.705599:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131024.705790:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498291712 00000100:00100000:0.0:1789131024.705800:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498291712 00000100:00100000:0.0:1789131024.705861:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 178 00000100:00100000:0.0:1789131024.705870:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7fd03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+58:12593:x1876039498291712:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:0.0:1789131024.705895:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789131024.705915:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc2e2f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269be8 expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789131024.706027:0:6500:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1789131024.706122:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc2e2f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269be8 expref: 60 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131024.706152:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91dded3a2600) 00010000:00010000:0.0:1789131024.706155:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789131024.706161:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc2e2f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269be8 expref: 60 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131024.706174:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91de01ad7600, rc 0) 00000100:00100000:0.0:1789131024.706245:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7fd03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+59:12593:x1876039498291712:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 374us (654us total) trans 4294967453 rc 301/301 00000100:00100000:0.0:1789131024.706252:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 178 00000100:00100000:0.0:1789131024.720627:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131024.720804:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498291840 00000100:00100000:3.0:1789131024.720813:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498291840 00000100:00100000:3.0:1789131024.720908:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 179 00000100:00100000:3.0:1789131024.720917:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01a5ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+59:12593:x1876039498291840:12345-192.168.203.11@tcp:34:lfs.0 00010000:00010000:3.0:1789131024.720981:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc2e3d lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131024.720997:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc2e3d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131024.721020:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc2e3d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131024.721031:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4600/0xf3fe2838e1fc2e44 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131024.721038:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4600/0xf3fe2838e1fc2e44 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131024.721045:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4600/0xf3fe2838e1fc2e44 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131024.721103:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4c00/0xf3fe2838e1fc2e4b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131024.721111:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4c00/0xf3fe2838e1fc2e4b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131024.721117:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4c00/0xf3fe2838e1fc2e4b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789131024.721159:0:6501:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4c00/0xf3fe2838e1fc2e4b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131024.721170:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc2e3d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131024.721177:0:6501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc2e3d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131024.721184:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc2e3d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131024.721199:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddfd0b5a00 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:3.0:1789131024.721203:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc2e3d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131024.721211:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc2e3d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131024.721221:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff91dcc7d6bf00) 00010000:00010000:3.0:1789131024.721224:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789131024.721229:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc2e3d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131024.721235:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc2e3d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131024.721247:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4600/0xf3fe2838e1fc2e44 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131024.721252:0:6501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4600/0xf3fe2838e1fc2e44 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131024.721258:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4600/0xf3fe2838e1fc2e44 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131024.721264:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddfd0b4600 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:3.0:1789131024.721266:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4600/0xf3fe2838e1fc2e44 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131024.721272:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4600/0xf3fe2838e1fc2e44 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131024.721286:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff91ddca4e4500) 00010000:00010000:3.0:1789131024.721289:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789131024.721292:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4600/0xf3fe2838e1fc2e44 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131024.721297:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4600/0xf3fe2838e1fc2e44 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131024.721320:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4c00/0xf3fe2838e1fc2e4b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131024.721333:0:6501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4c00/0xf3fe2838e1fc2e4b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131024.721339:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4c00/0xf3fe2838e1fc2e4b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131024.721344:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddfd0b4c00 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:3.0:1789131024.721347:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4c00/0xf3fe2838e1fc2e4b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131024.721352:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4c00/0xf3fe2838e1fc2e4b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131024.721359:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff91dde1922b00) 00010000:00010000:3.0:1789131024.721361:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789131024.721364:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4c00/0xf3fe2838e1fc2e4b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131024.721369:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4c00/0xf3fe2838e1fc2e4b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131024.721449:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01a5ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+59:12593:x1876039498291840:12345-192.168.203.11@tcp:34:lfs.0 Request processed in 533us (829us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131024.721496:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 179 00000100:00100000:1.0:1789131024.729181:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131024.729661:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498292096 00000100:00100000:2.0:1789131024.729671:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498292096 00000100:00100000:2.0:1789131024.729740:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 46 00000100:00100000:2.0:1789131024.729750:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01b303c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+59:12593:x1876039498292096:12345-192.168.203.11@tcp:35:lfs.0 00000100:00100000:2.0:1789131024.730882:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01b303c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+60:12593:x1876039498292096:12345-192.168.203.11@tcp:35:lfs.0 Request processed in 1128us (1705us total) trans 4294967454 rc 0/0 00000100:00100000:2.0:1789131024.730893:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 46 00000100:00100000:0.0:1789131024.771370:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131024.771485:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498292352 00000100:00100000:2.0:1789131024.771494:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498292352 00000100:00100000:2.0:1789131024.771584:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 180 00000100:00100000:2.0:1789131024.771595:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01a5c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+60:12597:x1876039498292352:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:2.0:1789131024.771630:0:6502:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789131024.771661:0:6502:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e600/0xf3fe2838e1fc2e52 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269bef expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131024.771751:0:6502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e400/0xf3fe2838e1fc2e59 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131024.771766:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e400/0xf3fe2838e1fc2e59 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131024.771785:0:6502:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e400/0xf3fe2838e1fc2e59 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131024.771797:0:6502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fc00/0xf3fe2838e1fc2e60 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131024.771803:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fc00/0xf3fe2838e1fc2e60 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131024.771809:0:6502:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fc00/0xf3fe2838e1fc2e60 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131024.771967:0:6502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e200/0xf3fe2838e1fc2e67 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131024.771977:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e200/0xf3fe2838e1fc2e67 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131024.771984:0:6502:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e200/0xf3fe2838e1fc2e67 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789131024.771993:0:6502:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:2.0:1789131024.772065:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e400/0xf3fe2838e1fc2e59 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131024.772073:0:6502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e400/0xf3fe2838e1fc2e59 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131024.772079:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e400/0xf3fe2838e1fc2e59 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131024.772084:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc7f7e400 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:2.0:1789131024.772088:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e400/0xf3fe2838e1fc2e59 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131024.772096:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e400/0xf3fe2838e1fc2e59 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131024.772108:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff91dcc7d6bf00) 00010000:00010000:2.0:1789131024.772111:0:6502:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789131024.772115:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e400/0xf3fe2838e1fc2e59 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131024.772131:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e400/0xf3fe2838e1fc2e59 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131024.772147:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fc00/0xf3fe2838e1fc2e60 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131024.772152:0:6502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fc00/0xf3fe2838e1fc2e60 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131024.772158:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fc00/0xf3fe2838e1fc2e60 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131024.772162:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc7f7fc00 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:2.0:1789131024.772165:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fc00/0xf3fe2838e1fc2e60 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131024.772170:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fc00/0xf3fe2838e1fc2e60 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131024.772178:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff91ddca4e4500) 00010000:00010000:2.0:1789131024.772180:0:6502:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789131024.772183:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fc00/0xf3fe2838e1fc2e60 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131024.772188:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fc00/0xf3fe2838e1fc2e60 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131024.772237:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e600/0xf3fe2838e1fc2e52 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269bef expref: 63 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131024.772252:0:6502:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e200/0xf3fe2838e1fc2e67 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269bef expref: 62 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131024.772267:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff91dde1922b00) 00010000:00010000:2.0:1789131024.772269:0:6502:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789131024.772271:0:6502:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dcc7f7e200, rc 0) 00000100:00100000:2.0:1789131024.772348:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01a5c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+62:12597:x1876039498292352:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 754us (993us total) trans 4294967455 rc 0/0 00000100:00100000:2.0:1789131024.772356:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 180 00000100:00100000:0.0:1789131024.777432:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131024.780147:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131024.780255:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498292608 00000100:00100000:3.0:1789131024.780267:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498292608 00000100:00100000:3.0:1789131024.780340:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 181 00000100:00100000:3.0:1789131024.780350:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff8a4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+62:12597:x1876039498292608:12345-192.168.203.11@tcp:54:lfs.0 00010000:00010000:3.0:1789131024.780413:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4c00/0xf3fe2838e1fc2e75 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131024.780430:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4c00/0xf3fe2838e1fc2e75 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131024.780441:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4c00/0xf3fe2838e1fc2e75 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131024.780534:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4c00/0xf3fe2838e1fc2e75 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131024.780541:0:6500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4c00/0xf3fe2838e1fc2e75 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131024.780547:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4c00/0xf3fe2838e1fc2e75 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131024.780552:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddfd0b4c00 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:3.0:1789131024.780556:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4c00/0xf3fe2838e1fc2e75 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131024.780562:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4c00/0xf3fe2838e1fc2e75 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131024.780587:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff91dde1922b00) 00010000:00010000:3.0:1789131024.780590:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789131024.780595:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4c00/0xf3fe2838e1fc2e75 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131024.780601:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4c00/0xf3fe2838e1fc2e75 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131024.780666:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff8a4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+62:12597:x1876039498292608:12345-192.168.203.11@tcp:54:lfs.0 Request processed in 317us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131024.780675:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 181 00000100:00100000:1.0:1789131024.783885:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498292480 00000100:00100000:1.0:1789131024.783900:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498292480 00000100:00100000:1.0:1789131024.783976:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 15 00000100:00100000:1.0:1789131024.783986:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff8a5680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+62:2386:x1876039498292480:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789131024.784001:0:6487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789131024.784025:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e200/0xf3fe2838e1fc2e67 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269bef expref: 62 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131024.784048:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff91dde1922b00) 00010000:00010000:1.0:1789131024.784053:0:6487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789131024.784104:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff8a5680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+61:2386:x1876039498292480:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 119us (6680us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131024.784112:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 15 00000100:00100000:0.0:1789131024.790872:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789131024.790952:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498292864 00000100:00100000:1.0:1789131024.790962:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498292864 00000100:00100000:1.0:1789131024.791017:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 47 00000100:00100000:1.0:1789131024.791028:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff8a52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+61:12597:x1876039498292864:12345-192.168.203.11@tcp:35:lfs.0 00000100:00100000:1.0:1789131024.791252:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff8a52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+62:12597:x1876039498292864:12345-192.168.203.11@tcp:35:lfs.0 Request processed in 225us (388us total) trans 4294967456 rc 0/0 00000100:00100000:1.0:1789131024.791260:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 47 00000100:00100000:1.0:1789131024.978819:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789131024.978843:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc845c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508852608:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789131024.978909:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131024.979357:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508852608 00000100:00100000:0.0:1789131024.979365:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508852608 00000100:00100000:0.0:1789131024.979418:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1789131024.979427:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01b30780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508852608:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789131024.979450:0:8419:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:0.0:1789131024.979534:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01b30780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508852608:12345-0@lo:13:osp-pre-0-1.0 Request processed in 108us (624us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131024.979542:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1789131024.979765:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc845c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508852608:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789131025.036035:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789131025.036133:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498293120 00000100:00100000:1.0:1789131025.036156:0:14273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498293120 00000100:00100000:1.0:1789131025.036218:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 182 00000100:00100000:1.0:1789131025.036230:0:14273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8cdd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+62:12615:x1876039498293120:12345-192.168.203.11@tcp:101:cat.0 00010000:00010000:1.0:1789131025.036258:0:14273:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789131025.036280:0:14273:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca800/0xf3fe2838e1fc2e7c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269bf6 expref: -99 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131025.036390:0:14273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca400/0xf3fe2838e1fc2e83 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131025.036410:0:14273:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca400/0xf3fe2838e1fc2e83 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131025.036422:0:14273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca400/0xf3fe2838e1fc2e83 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789131025.036433:0:14273:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:1.0:1789131025.036563:0:14273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca800/0xf3fe2838e1fc2e7c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269bf6 expref: 65 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131025.036583:0:14273:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca400/0xf3fe2838e1fc2e83 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269bf6 expref: 64 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131025.036591:0:14273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff91dde1922b00) 00010000:00010000:1.0:1789131025.036594:0:14273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1789131025.036597:0:14273:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dcc85ca400, rc 0) 00000100:00100000:1.0:1789131025.036662:0:14273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8cdd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+64:12615:x1876039498293120:12345-192.168.203.11@tcp:101:cat.0 Request processed in 433us (634us total) trans 4294967457 rc 0/0 00000100:00100000:1.0:1789131025.036674:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 182 00000100:00100000:0.0:1789131025.073046:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131025.073149:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498293248 00000100:00100000:2.0:1789131025.073159:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498293248 00000100:00100000:2.0:1789131025.073215:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 183 00000100:00100000:2.0:1789131025.073226:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc845ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+64:12616:x1876039498293248:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:2.0:1789131025.073249:0:6502:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789131025.073267:0:6502:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fc00/0xf3fe2838e1fc2e91 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269bfd expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131025.073331:0:6502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e400/0xf3fe2838e1fc2e98 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131025.073345:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e400/0xf3fe2838e1fc2e98 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131025.073355:0:6502:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e400/0xf3fe2838e1fc2e98 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789131025.073394:0:6502:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1789131025.073398:0:6502:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789131025.073424:0:6502:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e400/0xf3fe2838e1fc2e98 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131025.073494:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fc00/0xf3fe2838e1fc2e91 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269bfd expref: 66 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131025.073513:0:6502:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e400/0xf3fe2838e1fc2e98 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269bfd expref: 65 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131025.073521:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff91dcc7d6bf00) 00010000:00010000:2.0:1789131025.073523:0:6502:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789131025.073527:0:6502:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dcc7f7e400, rc 0) 00000100:00100000:2.0:1789131025.073739:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc845ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+65:12616:x1876039498293248:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 514us (701us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131025.073747:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 183 00000100:00100000:0.0:1789131025.083064:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789131025.083155:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498293632 00000100:00100000:1.0:1789131025.083165:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498293632 00000100:00100000:1.0:1789131025.083223:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 48 00000100:00100000:1.0:1789131025.083233:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc845fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+65:12616:x1876039498293632:12345-192.168.203.11@tcp:35:lfs.0 00000100:00100000:1.0:1789131025.083566:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc845fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+66:12616:x1876039498293632:12345-192.168.203.11@tcp:35:lfs.0 Request processed in 333us (509us total) trans 4294967458 rc 0/0 00000100:00100000:1.0:1789131025.083574:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 48 00000100:00100000:1.0:1789131025.089241:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131025.089316:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498293760 00000100:00100000:3.0:1789131025.089326:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498293760 00000100:00100000:3.0:1789131025.089387:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 16 00000100:00100000:3.0:1789131025.089397:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff752940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+66:12616:x1876039498293760:12345-192.168.203.11@tcp:103:lfs.0 00010000:00010000:3.0:1789131025.089412:0:6485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1789131025.089437:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7400/0xf3fe2838e1fc2e28 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269be1 expref: 66 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131025.089493:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca400/0xf3fe2838e1fc2e83 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269bf6 expref: 65 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131025.089509:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7ee00/0xf3fe2838e1fc2d25 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269b9b expref: 64 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131025.089520:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff91dde1922b00) 00010000:00010000:3.0:1789131025.089525:0:6485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789131025.089595:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff752940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+63:12616:x1876039498293760:12345-192.168.203.11@tcp:103:lfs.0 Request processed in 199us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131025.089603:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 16 00000001:00080000:3.0:1789131025.091088:0:6479:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967458 is committed 00000004:00080000:3.0:1789131025.091116:0:6479:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000004:00080000:3.0:1789131025.091154:0:6479:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:3.0:1789131025.091164:0:6479:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff91ddc2801480 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:3.0:1789131025.091178:0:6479:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff91ddff894b00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff91dded3d5b40 00000020:00080000:3.0:1789131025.091182:0:6479:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff91ddff894800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff91ddc702a200 00000020:00080000:3.0:1789131025.091237:0:6532:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:3.0:1789131025.091301:0:6532:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:0.0:1789131025.091492:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca000/0xf3fe2838e1fc2c68 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131025.091516:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca000/0xf3fe2838e1fc2c68 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131025.091524:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca000/0xf3fe2838e1fc2c68 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131025.091532:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc85ca000 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:0.0:1789131025.091536:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca000/0xf3fe2838e1fc2c68 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131025.091545:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca000/0xf3fe2838e1fc2c68 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131025.091560:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff91dcc7d6b600) 00010000:00010000:0.0:1789131025.091563:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789131025.091568:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca000/0xf3fe2838e1fc2c68 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131025.091575:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca000/0xf3fe2838e1fc2c68 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131025.091597:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cbe00/0xf3fe2838e1fc2c6f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131025.091604:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cbe00/0xf3fe2838e1fc2c6f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131025.091609:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cbe00/0xf3fe2838e1fc2c6f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131025.091614:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc85cbe00 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:0.0:1789131025.091623:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cbe00/0xf3fe2838e1fc2c6f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131025.091630:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cbe00/0xf3fe2838e1fc2c6f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131025.091638:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff91dcc7d6bf00) 00010000:00010000:0.0:1789131025.091640:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789131025.091643:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cbe00/0xf3fe2838e1fc2c6f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131025.091649:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cbe00/0xf3fe2838e1fc2c6f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131025.091665:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6e00/0xf3fe2838e1fc2cae lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131025.091671:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6e00/0xf3fe2838e1fc2cae lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131025.091676:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6e00/0xf3fe2838e1fc2cae lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131025.091680:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91de01ad6e00 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:0.0:1789131025.091683:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6e00/0xf3fe2838e1fc2cae lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131025.091689:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6e00/0xf3fe2838e1fc2cae lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131025.091696:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff91ddca4e4500) 00010000:00010000:0.0:1789131025.091698:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789131025.091707:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6e00/0xf3fe2838e1fc2cae lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131025.091713:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6e00/0xf3fe2838e1fc2cae lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131025.091730:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5800/0xf3fe2838e1fc2db1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131025.091735:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5800/0xf3fe2838e1fc2db1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131025.091740:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5800/0xf3fe2838e1fc2db1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131025.091744:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddfd0b5800 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:0.0:1789131025.091747:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5800/0xf3fe2838e1fc2db1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131025.091752:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5800/0xf3fe2838e1fc2db1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131025.091760:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff91dde1922b00) 00010000:00010000:0.0:1789131025.091762:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789131025.091765:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5800/0xf3fe2838e1fc2db1 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131025.091770:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5800/0xf3fe2838e1fc2db1 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131025.091792:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4a00/0xf3fe2838e1fc2dd4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131025.091798:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4a00/0xf3fe2838e1fc2dd4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131025.091812:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4a00/0xf3fe2838e1fc2dd4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131025.091817:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddfd0b4a00 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:0.0:1789131025.091819:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4a00/0xf3fe2838e1fc2dd4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131025.091825:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4a00/0xf3fe2838e1fc2dd4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131025.091833:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff91dde1922b00) 00010000:00010000:0.0:1789131025.091835:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789131025.091837:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4a00/0xf3fe2838e1fc2dd4 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131025.091842:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4a00/0xf3fe2838e1fc2dd4 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131025.091852:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5200/0xf3fe2838e1fc2e1a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131025.091858:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5200/0xf3fe2838e1fc2e1a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131025.091864:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5200/0xf3fe2838e1fc2e1a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131025.091869:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddfd0b5200 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:0.0:1789131025.091872:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5200/0xf3fe2838e1fc2e1a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131025.091888:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5200/0xf3fe2838e1fc2e1a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131025.091895:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff91dde1922b00) 00010000:00010000:0.0:1789131025.091897:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789131025.091900:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5200/0xf3fe2838e1fc2e1a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131025.091905:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5200/0xf3fe2838e1fc2e1a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131025.092376:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff7503c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1876039508852736:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1789131025.092436:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131025.094581:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508852736 00000100:00100000:1.0:1789131025.094596:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508852736 00000100:00100000:1.0:1789131025.094667:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789131025.094677:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc2e85a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3627:x1876039508852736:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1789131025.094711:0:8416:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:4 count 1 00002000:00010000:1.0:1789131025.094741:0:8416:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 13, mtime: 0x6aa3f90e, atime: 0x0, ctime: 0x6aa3f90e, blocks: 0x8 00010000:00010000:1.0:1789131025.094750:0:8416:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000429a8da5/0xf3fe2838e1fc2e9f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131025.094765:0:8416:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=381s v=(0 0) 00010000:00010000:1.0:1789131025.094769:0:8416:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789131025.094787:0:8416:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000429a8da5/0xf3fe2838e1fc2e9f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131025.094805:0:8416:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000429a8da5/0xf3fe2838e1fc2e9f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131025.094814:0:8416:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000429a8da5/0xf3fe2838e1fc2e9f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131025.094849:0:8416:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000429a8da5/0xf3fe2838e1fc2e9f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131025.094875:0:8416:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789131025.095093:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc2e85a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3627:x1876039508852736:12345-0@lo:6:osp-syn-0-0.0 Request processed in 416us (2655us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1789131025.095101:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00010000:2.0:1789131025.095207:0:6488:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789131025.095214:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000429a8da5/0xf3fe2838e1fc2e9f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131025.095222:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc85cba00 already unused, calling callback (ffffffffc0c4e550) 00010000:00010000:2.0:1789131025.095227:0:6488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000429a8da5/0xf3fe2838e1fc2e9f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131025.095236:0:6488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000429a8da5/0xf3fe2838e1fc2e9f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131025.095252:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000429a8da5/0xf3fe2838e1fc2e9f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131025.095273:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000429a8da5/0xf3fe2838e1fc2e9f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131025.095295:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131025.095297:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131025.095299:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1789131025.095687:0:3627:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff91ddff7503c0/2, rc 0, transno 4294967308 00000100:00100000:0.0:1789131025.095695:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff7503c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1876039508852736:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789131025.097845:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131025.097912:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498293888 00000100:00100000:3.0:1789131025.097922:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498293888 00000100:00100000:3.0:1789131025.097978:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 184 00000100:00100000:3.0:1789131025.097986:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc845cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+16:12616:x1876039498293888:12345-192.168.203.11@tcp:58:lfs.0 00010000:00010000:3.0:1789131025.098100:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4c00/0xf3fe2838e1fc2ea6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131025.098122:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4c00/0xf3fe2838e1fc2ea6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131025.098133:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4c00/0xf3fe2838e1fc2ea6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789131025.098236:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:3.0:1789131025.098311:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc845cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+16:12616:x1876039498293888:12345-192.168.203.11@tcp:58:lfs.0 Request processed in 324us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131025.098332:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 184 00000100:00100000:0.0:1789131025.128901:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789131025.129108:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498294016 00000100:00100000:1.0:1789131025.129116:0:14273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498294016 00000100:00100000:1.0:1789131025.129170:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 185 00000100:00100000:1.0:1789131025.129179:0:14273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc845f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+16:12618:x1876039498294016:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:1.0:1789131025.129196:0:14273:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789131025.129215:0:14273:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca600/0xf3fe2838e1fc2ead lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269c04 expref: -99 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131025.129282:0:14273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb800/0xf3fe2838e1fc2eb4 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131025.129294:0:14273:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb800/0xf3fe2838e1fc2eb4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131025.129305:0:14273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb800/0xf3fe2838e1fc2eb4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131025.129317:0:14273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cba00/0xf3fe2838e1fc2ebb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131025.129324:0:14273:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cba00/0xf3fe2838e1fc2ebb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131025.129342:0:14273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cba00/0xf3fe2838e1fc2ebb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131025.129407:0:14273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cbe00/0xf3fe2838e1fc2ec2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131025.129415:0:14273:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cbe00/0xf3fe2838e1fc2ec2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131025.129422:0:14273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cbe00/0xf3fe2838e1fc2ec2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789131025.129456:0:14273:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:1.0:1789131025.129493:0:14273:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789131025.129509:0:14273:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cbe00/0xf3fe2838e1fc2ec2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131025.129520:0:14273:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cbe00/0xf3fe2838e1fc2ec2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131025.129528:0:14273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb800/0xf3fe2838e1fc2eb4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131025.129535:0:14273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb800/0xf3fe2838e1fc2eb4 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131025.129542:0:14273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb800/0xf3fe2838e1fc2eb4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131025.129547:0:14273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc85cb800 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:1.0:1789131025.129551:0:14273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb800/0xf3fe2838e1fc2eb4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131025.129564:0:14273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb800/0xf3fe2838e1fc2eb4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131025.129576:0:14273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff91dcc7d6bf00) 00010000:00010000:1.0:1789131025.129579:0:14273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789131025.129583:0:14273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb800/0xf3fe2838e1fc2eb4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131025.129589:0:14273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb800/0xf3fe2838e1fc2eb4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131025.129616:0:14273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cba00/0xf3fe2838e1fc2ebb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131025.129622:0:14273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cba00/0xf3fe2838e1fc2ebb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131025.129627:0:14273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cba00/0xf3fe2838e1fc2ebb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131025.129631:0:14273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc85cba00 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:1.0:1789131025.129633:0:14273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cba00/0xf3fe2838e1fc2ebb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131025.129638:0:14273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cba00/0xf3fe2838e1fc2ebb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131025.129644:0:14273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff91dcc7d6bb00) 00010000:00010000:1.0:1789131025.129647:0:14273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789131025.129649:0:14273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cba00/0xf3fe2838e1fc2ebb lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131025.129664:0:14273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cba00/0xf3fe2838e1fc2ebb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131025.129693:0:14273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca600/0xf3fe2838e1fc2ead lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269c04 expref: 18 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131025.129707:0:14273:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cbe00/0xf3fe2838e1fc2ec2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269c04 expref: 17 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131025.129714:0:14273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff91dde1922b00) 00010000:00010000:1.0:1789131025.129716:0:14273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789131025.129718:0:14273:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dcc85cbe00, rc 0) 00000100:00100000:1.0:1789131025.129765:0:14273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc845f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+17:12618:x1876039498294016:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 587us (873us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131025.129773:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 185 00010000:00010000:1.0:1789131025.298068:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789131025.490081:0:14475:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789131025.490090:0:14475:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789131025.490134:0:14475:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1789131025.490144:0:14475:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789131025.490287:0:14475:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8cdcb40 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14475:1876039508852864:192.168.203.11@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789131025.490404:0:14475:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddd8364a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789131025.498074:0:14475:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8cdcb40 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14475:1876039508852864:192.168.203.11@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789131025.504858:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131025.504924:0:14851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498294144 00000100:00100000:2.0:1789131025.504934:0:14851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498294144 00000100:00100000:2.0:1789131025.504991:0:14851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 186 00000100:00100000:2.0:1789131025.505001:0:14851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc845c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+17:12629:x1876039498294144:12345-192.168.203.11@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789131025.505032:0:14851:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789131025.505144:0:14851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc845c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+17:12629:x1876039498294144:12345-192.168.203.11@tcp:53:lhsmtool_posix.0 Request processed in 144us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131025.505153:0:14851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 186 00000100:00100000:1.0:1789131025.523841:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131025.523934:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498294272 00000100:00100000:3.0:1789131025.523943:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498294272 00000100:00100000:3.0:1789131025.524032:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 187 00000100:00100000:3.0:1789131025.524055:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff752580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+17:12629:x1876039498294272:12345-192.168.203.11@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1789131025.524127:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4600/0xf3fe2838e1fc2ec9 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131025.524144:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4600/0xf3fe2838e1fc2ec9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131025.524158:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4600/0xf3fe2838e1fc2ec9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131025.524192:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc2ed0 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131025.524200:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc2ed0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131025.524210:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc2ed0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131025.524242:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5000/0xf3fe2838e1fc2ed7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131025.524251:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5000/0xf3fe2838e1fc2ed7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131025.524270:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5000/0xf3fe2838e1fc2ed7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789131025.524316:0:6500:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1789131025.524320:0:6500:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789131025.524332:0:6500:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5000/0xf3fe2838e1fc2ed7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131025.524344:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4600/0xf3fe2838e1fc2ec9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131025.524350:0:6500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4600/0xf3fe2838e1fc2ec9 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131025.524356:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4600/0xf3fe2838e1fc2ec9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131025.524362:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddfd0b4600 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:3.0:1789131025.524366:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4600/0xf3fe2838e1fc2ec9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131025.524374:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4600/0xf3fe2838e1fc2ec9 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131025.524388:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff91ddcf5ffa00) 00010000:00010000:3.0:1789131025.524390:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789131025.524395:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4600/0xf3fe2838e1fc2ec9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131025.524401:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4600/0xf3fe2838e1fc2ec9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131025.524421:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc2ed0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131025.524427:0:6500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc2ed0 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131025.524432:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc2ed0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131025.524438:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddfd0b5a00 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:3.0:1789131025.524441:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc2ed0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131025.524446:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc2ed0 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131025.524454:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdc6beff1 (ffff91dcc6d88600) 00010000:00010000:3.0:1789131025.525266:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789131025.525273:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc2ed0 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131025.525280:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc2ed0 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131025.525295:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5000/0xf3fe2838e1fc2ed7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131025.525301:0:6500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5000/0xf3fe2838e1fc2ed7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131025.525306:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5000/0xf3fe2838e1fc2ed7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131025.525319:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddfd0b5000 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:3.0:1789131025.525323:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5000/0xf3fe2838e1fc2ed7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131025.525329:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5000/0xf3fe2838e1fc2ed7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131025.525339:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff91dde1922b00) 00010000:00010000:3.0:1789131025.525341:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789131025.525344:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5000/0xf3fe2838e1fc2ed7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131025.525349:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5000/0xf3fe2838e1fc2ed7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131025.529292:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff752580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+17:12629:x1876039498294272:12345-192.168.203.11@tcp:34:lhsmtool_posix.0 Request processed in 5239us (5447us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131025.529307:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 187 00000100:00100000:1.0:1789131025.537220:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131025.538863:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498294528 00000100:00100000:0.0:1789131025.538876:0:14273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498294528 00000100:00100000:1.0:1789131025.539117:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 188 00000100:00100000:1.0:1789131025.539127:0:14273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8509e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+17:12629:x1876039498294528:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789131025.539147:0:14273:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789131025.539166:0:14273:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85caa00/0xf3fe2838e1fc2ede lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269c0b expref: -99 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131025.539268:0:14273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb600/0xf3fe2838e1fc2ee5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131025.539295:0:14273:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb600/0xf3fe2838e1fc2ee5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131025.539307:0:14273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb600/0xf3fe2838e1fc2ee5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789131025.539321:0:14273:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:1.0:1789131025.539427:0:14273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb600/0xf3fe2838e1fc2ee5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131025.539435:0:14273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb600/0xf3fe2838e1fc2ee5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131025.539450:0:14273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb600/0xf3fe2838e1fc2ee5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131025.539486:0:14273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc85cb600 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:1.0:1789131025.539491:0:14273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb600/0xf3fe2838e1fc2ee5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131025.539498:0:14273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb600/0xf3fe2838e1fc2ee5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131025.539510:0:14273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff91dde1922b00) 00010000:00010000:1.0:1789131025.539513:0:14273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789131025.539518:0:14273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb600/0xf3fe2838e1fc2ee5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131025.539524:0:14273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb600/0xf3fe2838e1fc2ee5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131025.539564:0:14273:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85caa00/0xf3fe2838e1fc2ede lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269c0b expref: 19 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131025.539581:0:14273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff91ddcf5ffa00) 00010000:00010000:1.0:1789131025.539584:0:14273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789131025.539588:0:14273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85caa00/0xf3fe2838e1fc2ede lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269c0b expref: 19 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131025.539600:0:14273:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dcc85caa00, rc 0) 00000100:00100000:1.0:1789131025.539661:0:14273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8509e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+18:12629:x1876039498294528:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 536us (2450us total) trans 4294967459 rc 301/301 00000100:00100000:1.0:1789131025.539670:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 188 00000100:00100000:0.0:1789131025.543799:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131025.543863:0:14851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498294656 00000100:00100000:2.0:1789131025.543872:0:14851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498294656 00000100:00100000:2.0:1789131025.543927:0:14851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 189 00000100:00100000:2.0:1789131025.543937:0:14851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddca0c7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+18:12629:x1876039498294656:12345-192.168.203.11@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789131025.543970:0:14851:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789131025.544097:0:14851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddca0c7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+18:12629:x1876039498294656:12345-192.168.203.11@tcp:53:lhsmtool_posix.0 Request processed in 161us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131025.544105:0:14851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 189 00000100:00100000:1.0:1789131025.554089:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131025.554965:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498294912 00000100:00100000:0.0:1789131025.554977:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498294912 00000100:00100000:0.0:1789131025.555288:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 190 00000100:00100000:0.0:1789131025.555300:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc850bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+18:12629:x1876039498294912:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789131025.555320:0:9769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789131025.555322:0:9769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789131025.555348:0:9769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e400/0xf3fe2838e1fc2e98 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269bfd expref: 18 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131025.555381:0:9769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff91dcc7d6bf00) 00010000:00010000:0.0:1789131025.555386:0:9769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789131025.555401:0:9769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6a00/0xf3fe2838e1fc2ef3 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269c12 expref: -99 pid: 9769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789131025.555950:0:9769:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x5:0x0], index 1: 0 00010000:00010000:0.0:1789131025.556189:0:9769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6400/0xf3fe2838e1fc2efa lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131025.556202:0:9769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6400/0xf3fe2838e1fc2efa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131025.556905:0:9769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6400/0xf3fe2838e1fc2efa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131025.556967:0:9769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6a00/0xf3fe2838e1fc2ef3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269c12 expref: 20 pid: 9769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131025.556982:0:9769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6400/0xf3fe2838e1fc2efa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269c12 expref: 19 pid: 9769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131025.557002:0:9769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff91ddca4e4500) 00010000:00010000:0.0:1789131025.557004:0:9769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789131025.557007:0:9769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91de01ad6400, rc 0) 00000100:00100000:0.0:1789131025.557076:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc850bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+19:12629:x1876039498294912:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 1777us (2995us total) trans 4294967460 rc 0/0 00000100:00100000:0.0:1789131025.557084:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 190 00000100:00100000:1.0:1789131025.562005:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131025.562075:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498295168 00000100:00100000:3.0:1789131025.562086:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498295168 00000100:00100000:3.0:1789131025.562146:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 191 00000100:00100000:3.0:1789131025.562157:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc850a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+19:12629:x1876039498295168:12345-192.168.203.11@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789131025.562222:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789131025.562250:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6400/0xf3fe2838e1fc2efa lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269c12 expref: 19 pid: 9769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131025.562269:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff91ddca4e4500) 00010000:00010000:3.0:1789131025.562279:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789131025.562308:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5000/0xf3fe2838e1fc2f08 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131025.562321:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5000/0xf3fe2838e1fc2f08 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131025.562331:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5000/0xf3fe2838e1fc2f08 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131025.562347:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc2f0f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x5febadd4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131025.562354:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc2f0f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x5febadd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131025.562361:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc2f0f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x5febadd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131025.562403:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5000/0xf3fe2838e1fc2f08 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131025.562410:0:6501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5000/0xf3fe2838e1fc2f08 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131025.562418:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5000/0xf3fe2838e1fc2f08 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131025.562424:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddfd0b5000 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:3.0:1789131025.562427:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5000/0xf3fe2838e1fc2f08 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131025.562434:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5000/0xf3fe2838e1fc2f08 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131025.562502:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff91dcc7d6bf00) 00010000:00010000:3.0:1789131025.562506:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789131025.562636:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5000/0xf3fe2838e1fc2f08 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131025.562643:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5000/0xf3fe2838e1fc2f08 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131025.562654:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc2f0f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x5febadd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131025.562660:0:6501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc2f0f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x5febadd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131025.562666:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc2f0f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x5febadd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131025.562671:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddfd0b5a00 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:3.0:1789131025.562674:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc2f0f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x5febadd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131025.562680:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc2f0f lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x5febadd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131025.562687:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x5febadd4 (ffff91dcc6d88600) 00010000:00010000:3.0:1789131025.562689:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789131025.562692:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc2f0f lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x5febadd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131025.562699:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc2f0f lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x5febadd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131025.562846:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc850a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+18:12629:x1876039498295168:12345-192.168.203.11@tcp:36:lhsmtool_posix.0 Request processed in 688us (847us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789131025.562918:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 191 00000100:00100000:3.0:1789131025.564886:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789131025.565112:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498295296 00000100:00100000:1.0:1789131025.565121:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498295296 00000100:00100000:1.0:1789131025.565181:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 192 00000100:00100000:1.0:1789131025.565192:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc2e870c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+18:12629:x1876039498295296:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789131025.565210:0:6502:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789131025.565232:0:6502:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85caa00/0xf3fe2838e1fc2f16 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269c19 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131025.565264:0:6502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb600/0xf3fe2838e1fc2f1d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131025.565277:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb600/0xf3fe2838e1fc2f1d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131025.565306:0:6502:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb600/0xf3fe2838e1fc2f1d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131025.565423:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85caa00/0xf3fe2838e1fc2f16 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269c19 expref: 20 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131025.565442:0:6502:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb600/0xf3fe2838e1fc2f1d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269c19 expref: 19 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131025.565449:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff91dcc7d6b900) 00010000:00010000:1.0:1789131025.565452:0:6502:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789131025.565456:0:6502:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dcc85cb600, rc 0) 00000100:00100000:1.0:1789131025.565535:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc2e870c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+19:12629:x1876039498295296:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 344us (655us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131025.565544:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 192 00000100:00100000:3.0:1789131025.567757:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789131025.567818:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498295552 00000100:00100000:1.0:1789131025.567826:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498295552 00000100:00100000:1.0:1789131025.567885:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 193 00000100:00100000:1.0:1789131025.567895:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc2e87840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+19:12629:x1876039498295552:12345-192.168.203.11@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789131025.567963:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cac00/0xf3fe2838e1fc2f24 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131025.567978:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cac00/0xf3fe2838e1fc2f24 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131025.567989:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cac00/0xf3fe2838e1fc2f24 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789131025.568299:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:1.0:1789131025.568309:0:6500:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 381485849978ns, next at 382485847220ns, rc = 0 00000004:00010000:1.0:1789131025.568356:0:6500:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000061ddd5eb reply state 0000000039a9201c transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cac00/0xf3fe2838e1fc2f24 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131025.568369:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cac00/0xf3fe2838e1fc2f24 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131025.568377:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff91dcc7d6b900) 00010000:00010000:1.0:1789131025.568380:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1789131025.568383:0:6500:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789131025.568487:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc2e87840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+21:12629:x1876039498295552:12345-192.168.203.11@tcp:36:lhsmtool_posix.0 Request processed in 592us (733us total) trans 4294967461 rc 0/0 00000100:00100000:1.0:1789131025.568495:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 193 00000100:00100000:3.0:1789131025.571380:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789131025.571954:0:14851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498295680 00000100:00100000:1.0:1789131025.571970:0:14851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498295680 00000100:00100000:1.0:1789131025.572032:0:14851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 194 00000100:00100000:1.0:1789131025.572041:0:14851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc2e852c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+21:12629:x1876039498295680:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789131025.572063:0:14851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789131025.572082:0:14851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cae00/0xf3fe2838e1fc2f2b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269c20 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131025.572152:0:14851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cae00/0xf3fe2838e1fc2f2b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269c20 expref: 22 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131025.572167:0:14851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cae00/0xf3fe2838e1fc2f2b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269c20 expref: 22 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131025.572201:0:14851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff91dcc7d6b900) 00010000:00010000:1.0:1789131025.572205:0:14851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789131025.572209:0:14851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dcc85cae00, rc 0) 00000100:00100000:1.0:1789131025.572269:0:14851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc2e852c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+22:12629:x1876039498295680:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 227us (896us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131025.572276:0:14851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 194 00000100:00100000:0.0:1789131025.584623:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131025.584939:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498295808 00000100:00100000:2.0:1789131025.584949:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498295808 00000100:00080000:0.0:1789131025.585005:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789131025.585021:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 60 00000100:00100000:2.0:1789131025.585032:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddca0c4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+6:2388:x1876039498295808:12345-192.168.203.11@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1789131025.585255:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddca0c4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+7:2388:x1876039498295808:12345-192.168.203.11@tcp:2:lhsmtool_posix.0 Request processed in 224us (638us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1789131025.585264:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 60 00000100:00100000:3.0:1789131025.589690:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131025.599968:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498296064 00000100:00100000:0.0:1789131025.599983:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498296064 00000100:00100000:2.0:1789131025.604139:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 49 00000100:00100000:2.0:1789131025.604153:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7b27c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+22:12629:x1876039498296064:12345-192.168.203.11@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789131025.604529:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7b27c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+23:12629:x1876039498296064:12345-192.168.203.11@tcp:35:lhsmtool_posix.0 Request processed in 378us (14847us total) trans 4294967462 rc 0/0 00000100:00100000:2.0:1789131025.604538:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 49 00000100:00100000:0.0:1789131025.610601:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131025.612572:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498296320 00000100:00100000:3.0:1789131025.612583:0:14273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498296320 00000100:00100000:3.0:1789131025.612644:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 195 00000100:00100000:3.0:1789131025.612655:0:14273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddca229680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+23:12629:x1876039498296320:12345-192.168.203.11@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789131025.612763:0:14273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddca229680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+23:12629:x1876039498296320:12345-192.168.203.11@tcp:57:lhsmtool_posix.0 Request processed in 108us (2169us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131025.612780:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 195 00000100:00100000:3.0:1789131025.620498:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131025.620530:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498296448 00000100:00100000:3.0:1789131025.620538:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498296448 00000100:00100000:3.0:1789131025.620585:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 196 00000100:00100000:3.0:1789131025.620595:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7b25e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+23:12629:x1876039498296448:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789131025.620614:0:9769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789131025.620633:0:9769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc2f32 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269c27 expref: -99 pid: 9769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131025.620697:0:9769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5000/0xf3fe2838e1fc2f39 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131025.620711:0:9769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5000/0xf3fe2838e1fc2f39 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131025.620722:0:9769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5000/0xf3fe2838e1fc2f39 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789131025.620783:0:9769:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789131025.620803:0:9769:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5000/0xf3fe2838e1fc2f39 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131025.620829:0:9769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc2f32 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269c27 expref: 25 pid: 9769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131025.620845:0:9769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5000/0xf3fe2838e1fc2f39 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269c27 expref: 24 pid: 9769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131025.620863:0:9769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff91dcc7d6b900) 00010000:00010000:3.0:1789131025.620866:0:9769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789131025.620869:0:9769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ddfd0b5000, rc 0) 00000100:00100000:3.0:1789131025.620922:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7b25e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+24:12629:x1876039498296448:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 328us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131025.620930:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 196 00000100:00100000:3.0:1789131025.625672:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789131025.625756:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498296576 00000100:00100000:1.0:1789131025.625766:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498296576 00000100:00100000:1.0:1789131025.625831:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 61 00000100:00100000:1.0:1789131025.625841:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7b261c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+7:2385:x1876039498296576:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789131025.625984:0:8416:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789131025.626005:0:8416:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000089826788/0xf3fe2838e1fc2f40 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269c2e expref: -99 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789131025.626029:0:8416:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa3f911, blocks: 0x0 00010000:00010000:1.0:1789131025.626051:0:8416:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=381s v=(0 0) 00010000:00010000:1.0:1789131025.626056:0:8416:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789131025.626066:0:8416:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000089826788/0xf3fe2838e1fc2f40 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269c2e expref: 8 pid: 8416 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131025.626084:0:8416:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000089826788/0xf3fe2838e1fc2f40 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269c2e expref: 8 pid: 8416 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131025.626158:0:8416:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dcc85caa00, rc 0) 00000100:00100000:1.0:1789131025.626231:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7b261c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+8:2385:x1876039498296576:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 390us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131025.626238:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 61 00000100:00100000:3.0:1789131025.637568:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789131025.637669:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498296832 00000100:00100000:1.0:1789131025.637678:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498296832 00000100:00100000:1.0:1789131025.637769:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 197 00000100:00100000:1.0:1789131025.637789:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7b24b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+24:12629:x1876039498296832:12345-192.168.203.11@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789131025.637904:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7b24b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+24:12629:x1876039498296832:12345-192.168.203.11@tcp:57:lhsmtool_posix.0 Request processed in 117us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131025.637911:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 197 00000100:00100000:3.0:1789131025.641554:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789131025.641989:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498296960 00000100:00100000:1.0:1789131025.641999:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498296960 00000100:00100000:1.0:1789131025.642058:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 62 00000100:00100000:1.0:1789131025.642068:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc86083c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+8:12629:x1876039498296960:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789131025.642087:0:8417:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789131025.642277:0:8417:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009e16912c/0xf3fe2838e1fc2f47 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269c35 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131025.642310:0:8417:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000089826788/0xf3fe2838e1fc2f40 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269c2e expref: 9 pid: 8416 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131025.642320:0:8417:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789131025.642325:0:8417:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789131025.642331:0:8417:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009e16912c/0xf3fe2838e1fc2f47 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269c35 expref: 9 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131025.643487:0:8417:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000089826788/0xf3fe2838e1fc2f40 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269c2e expref: 9 pid: 8416 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131025.643502:0:8417:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000089826788/0xf3fe2838e1fc2f40 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269c2e expref: 9 pid: 8416 timeout: 481 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131025.643518:0:8417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8509680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8417:1876039508852992:192.168.203.11@tcp:104: 00000100:00100000:1.0:1789131025.643760:0:8417:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddff8bea80 going to sleep for 11 seconds 00000100:00100000:3.0:1789131025.646859:0:8417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8509680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8417:1876039508852992:192.168.203.11@tcp:104: 00010000:00010000:3.0:1789131025.646900:0:8417:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009e16912c/0xf3fe2838e1fc2f47 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269c35 expref: 9 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131025.646924:0:8417:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dcc85cb200, rc 0) 00000100:00100000:3.0:1789131025.646996:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc86083c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+9:12629:x1876039498296960:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 4919us (5441us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131025.647017:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 62 00000100:00100000:3.0:1789131025.650122:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789131025.650221:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498297088 00000100:00100000:1.0:1789131025.650231:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498297088 00010000:00010000:1.0:1789131025.650272:0:6487:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000089826788/0xf3fe2838e1fc2f40 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269c2e expref: 9 pid: 8416 timeout: 481 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131025.650318:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 98 00000100:00100000:1.0:1789131025.650337:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc86092c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+9:2388:x1876039498297088:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789131025.650353:0:6487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789131025.650374:0:6487:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000089826788/0xf3fe2838e1fc2f40 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269c2e expref: 9 pid: 8416 timeout: 481 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131025.650388:0:6487:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000089826788/0xf3fe2838e1fc2f40 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269c2e expref: 9 pid: 8416 timeout: 481 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131025.650411:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000089826788/0xf3fe2838e1fc2f40 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269c2e expref: 9 pid: 8416 timeout: 481 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131025.650450:0:6487:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789131025.650455:0:6487:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789131025.650491:0:6487:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009e16912c/0xf3fe2838e1fc2f47 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269c35 expref: 8 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131025.650501:0:6487:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009e16912c/0xf3fe2838e1fc2f47 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269c35 expref: 8 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131025.650542:0:6487:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000009e16912c/0xf3fe2838e1fc2f47 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269c35 expref: 8 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131025.650555:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc850b0c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6487:1876039508853120:192.168.203.11@tcp:105: 00000100:00100000:1.0:1789131025.650630:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddff8be840 going to sleep for 11 seconds 00000100:00100000:0.0:1789131025.660580:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131025.660624:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498297216 00000100:00100000:3.0:1789131025.660633:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498297216 00002000:00100000:3.0:1789131025.660684:0:8420:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff91ddca228000 x1876039498297216/t0(0) o4->b99c111d-b9b6-4590-88e4-9fefd4d4c3a4@192.168.203.11@tcp:741/0 lens 504/0 e 0 to 0 dl 1789131036 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1789131025.660693:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc850b0c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6487:1876039508853120:192.168.203.11@tcp:105: 00002000:00100000:3.0:1789131025.660700:0:8420:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff91ddca228000 with x1876039498297216 ext(0->8) 00002000:00010000:3.0:1789131025.660707:0:8420:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91ddca228000 00010000:00010000:2.0:1789131025.660718:0:6487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789131025.660744:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 5 00000100:00100000:3.0:1789131025.660755:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddca228000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+9:2388:x1876039498297216:12345-192.168.203.11@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1789131025.660782:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc86092c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+9:2388:x1876039498297088:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 10435us (10656us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131025.660794:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 98 00000100:00100000:0.0:1789131025.663014:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddca228000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+10:2388:x1876039498297216:12345-192.168.203.11@tcp:4:lhsmtool_posix.0 Request processed in 2252us (2434us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1789131025.663027:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 5 00002000:00100000:0.0:1789131025.663038:0:8420:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff91ddca228000 x1876039498297216/t4294967315(0) o4->b99c111d-b9b6-4590-88e4-9fefd4d4c3a4@192.168.203.11@tcp:741/0 lens 504/448 e 0 to 0 dl 1789131036 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789131025.663048:0:8420:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff91ddca228000 with x1876039498297216 ext(0->8) 00002000:00010000:0.0:1789131025.663053:0:8420:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91ddca228000 00000100:00100000:0.0:1789131025.669512:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131025.669594:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498297344 00000100:00100000:3.0:1789131025.669602:0:14273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498297344 00000100:00100000:3.0:1789131025.669663:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 198 00000100:00100000:3.0:1789131025.669675:0:14273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc86a4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+24:12629:x1876039498297344:12345-192.168.203.11@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1789131025.673331:0:6479:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967462 is committed 00000004:00080000:3.0:1789131025.673349:0:6479:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000020:00080000:3.0:1789131025.673367:0:6479:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:3.0:1789131025.673388:0:6532:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:3.0:1789131025.673398:0:6532:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00010000:00010000:1.0:1789131025.673508:0:3612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cac00/0xf3fe2838e1fc2f24 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131025.673520:0:3612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cac00/0xf3fe2838e1fc2f24 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131025.673526:0:3612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cac00/0xf3fe2838e1fc2f24 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131025.673532:0:3612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc85cac00 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:1.0:1789131025.673537:0:3612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cac00/0xf3fe2838e1fc2f24 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131025.673544:0:3612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cac00/0xf3fe2838e1fc2f24 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131025.673549:0:14273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc86a4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+20:12629:x1876039498297344:12345-192.168.203.11@tcp:44:lhsmtool_posix.0 Request processed in 3871us (4041us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131025.673563:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 198 00010000:00010000:1.0:1789131025.673576:0:3612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff91dcc7d6b900) 00010000:00010000:1.0:1789131025.673580:0:3612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789131025.673586:0:3612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cac00/0xf3fe2838e1fc2f24 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131025.673593:0:3612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cac00/0xf3fe2838e1fc2f24 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131025.675513:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789131025.675534:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc86a52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1876039508853248:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1789131025.675594:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131025.675971:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508853248 00000100:00100000:0.0:1789131025.675979:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508853248 00000100:00100000:0.0:1789131025.676046:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789131025.676055:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8cdcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1876039508853248:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1789131025.676175:0:8414:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1789131025.676180:0:8414:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1789131025 00002000:00010000:0.0:1789131025.676183:0:8414:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1789131025.676185:0:8414:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1789131025 -> 1789131025 00002000:00010000:0.0:1789131025.676188:0:8414:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:0.0:1789131025.676248:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8cdcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3627:x1876039508853248:12345-0@lo:2:osp-syn-1-0.0 Request processed in 193us (652us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1789131025.676257:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000004:00080000:0.0:1789131025.676297:0:3627:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff91dcc86a52c0/2, rc 0, transno 4294967316 00000100:00100000:0.0:1789131025.676310:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc86a52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1876039508853248:0@lo:2:osp-syn-1-0.0 00000100:00080000:1.0:1789131025.676415:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789131025.678187:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131025.678313:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498297472 00000100:00100000:0.0:1789131025.678322:0:9827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498297472 00000100:00100000:0.0:1789131025.678371:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 64 00000100:00100000:0.0:1789131025.678381:0:9827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc860b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+10:2385:x1876039498297472:12345-192.168.203.11@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1789131025.681619:0:9493:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967316 is committed 00000001:00080000:3.0:1789131025.681638:0:9493:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000100:00100000:1.0:1789131025.687070:0:9827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc860b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+7:2385:x1876039498297472:12345-192.168.203.11@tcp:16:lhsmtool_posix.0 Request processed in 8678us (8878us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131025.687087:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 64 00000100:00100000:3.0:1789131025.690568:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131025.690638:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498297728 00000100:00100000:3.0:1789131025.690656:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498297728 00000100:00100000:3.0:1789131025.690742:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 199 00000100:00100000:3.0:1789131025.690757:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8608000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+19:12629:x1876039498297728:12345-192.168.203.11@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789131025.690839:0:9769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789131025.690877:0:9769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5000/0xf3fe2838e1fc2f39 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269c27 expref: 19 pid: 9769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131025.690909:0:9769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff91dcc7d6b900) 00010000:00010000:3.0:1789131025.690915:0:9769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789131025.690958:0:9769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc2f4e lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131025.690975:0:9769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc2f4e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131025.691001:0:9769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc2f4e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789131025.691181:0:9769:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000004fabb9b5 reply state 0000000055420fbb transno 4294967463 ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc2f4e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131025.691198:0:9769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc2f4e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131025.691206:0:9769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff91dcc7d6b900) 00010000:00010000:3.0:1789131025.691209:0:9769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789131025.691213:0:9769:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789131025.691344:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8608000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+20:12629:x1876039498297728:12345-192.168.203.11@tcp:36:lhsmtool_posix.0 Request processed in 589us (794us total) trans 4294967463 rc 0/0 00000100:00100000:3.0:1789131025.691376:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 199 00000100:00100000:3.0:1789131025.694790:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131025.696329:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498297856 00000100:00100000:0.0:1789131025.696343:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498297856 00000100:00100000:2.0:1789131025.696506:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 65 00000100:00100000:2.0:1789131025.696518:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8608f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+7:2388:x1876039498297856:12345-192.168.203.11@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1789131025.696694:0:8416:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1789131025.696698:0:8416:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 1789131025 -> 1789131024 00002000:00010000:2.0:1789131025.696701:0:8416:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 1789131022 00002000:00010000:2.0:1789131025.696703:0:8416:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1789131025 -> 1789131024 00002000:00010000:2.0:1789131025.696706:0:8416:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1789131025.696790:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8608f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+8:2388:x1876039498297856:12345-192.168.203.11@tcp:2:lhsmtool_posix.0 Request processed in 273us (2024us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1789131025.696803:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 65 00000100:00100000:0.0:1789131025.700840:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131025.701999:0:14851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498298112 00000100:00100000:3.0:1789131025.702020:0:14851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498298112 00000100:00100000:3.0:1789131025.702118:0:14851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 200 00000100:00100000:3.0:1789131025.702132:0:14851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc86a43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+20:12629:x1876039498298112:12345-192.168.203.11@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1789131025.702226:0:14851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5000/0xf3fe2838e1fc2f55 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131025.702247:0:14851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb600/0xf3fe2838e1fc2f1d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269c19 expref: 20 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131025.702488:0:14851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5000/0xf3fe2838e1fc2f55 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131025.702544:0:14851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb600/0xf3fe2838e1fc2f1d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269c19 expref: 20 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131025.702562:0:14851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb600/0xf3fe2838e1fc2f1d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269c19 expref: 20 pid: 6502 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131025.702581:0:14851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7ad12c0 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:14851:1876039508853376:192.168.203.11@tcp:104: 00000100:00100000:3.0:1789131025.702711:0:14851:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddc32930c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789131025.710358:0:14851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7ad12c0 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:14851:1876039508853376:192.168.203.11@tcp:104: 00010000:00010000:3.0:1789131025.710398:0:14851:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5000/0xf3fe2838e1fc2f55 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131025.711421:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131025.715793:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498298240 00000100:00100000:3.0:1789131025.715813:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498298240 00010000:00010000:3.0:1789131025.715877:0:6485:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb600/0xf3fe2838e1fc2f1d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269c19 expref: 21 pid: 6502 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131025.715925:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 99 00000100:00100000:3.0:1789131025.715937:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc86a5680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+21:2387:x1876039498298240:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789131025.715956:0:6485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789131025.715964:0:6485:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb600/0xf3fe2838e1fc2f1d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269c19 expref: 21 pid: 6502 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131025.715981:0:6485:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb600/0xf3fe2838e1fc2f1d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269c19 expref: 21 pid: 6502 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131025.716008:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb600/0xf3fe2838e1fc2f1d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269c19 expref: 21 pid: 6502 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131025.716029:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff91dcc7d6b900) 00010000:00010000:3.0:1789131025.716034:0:6485:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5000/0xf3fe2838e1fc2f55 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131025.716045:0:6485:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5000/0xf3fe2838e1fc2f55 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131025.716165:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5000/0xf3fe2838e1fc2f55 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131025.716201:0:6485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789131025.716252:0:14851:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5000/0xf3fe2838e1fc2f55 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131025.716271:0:14851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5000/0xf3fe2838e1fc2f55 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131025.716313:0:14851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5000/0xf3fe2838e1fc2f55 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131025.716321:0:14851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5000/0xf3fe2838e1fc2f55 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131025.716327:0:14851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5000/0xf3fe2838e1fc2f55 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131025.716333:0:14851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddfd0b5000 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:1.0:1789131025.716339:0:14851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5000/0xf3fe2838e1fc2f55 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131025.716347:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc86a5680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+20:2387:x1876039498298240:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 406us (4927us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131025.716360:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 99 00010000:00010000:1.0:1789131025.716375:0:14851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5000/0xf3fe2838e1fc2f55 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131025.716395:0:14851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff91dcc7d6b900) 00010000:00010000:1.0:1789131025.716398:0:14851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1789131025.716403:0:14851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5000/0xf3fe2838e1fc2f55 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131025.716419:0:14851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5000/0xf3fe2838e1fc2f55 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131025.716537:0:14851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc86a43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+19:12629:x1876039498298112:12345-192.168.203.11@tcp:55:lhsmtool_posix.0 Request processed in 14404us (15700us total) trans 0 rc -22/-22 00000100:00100000:1.0:1789131025.716548:0:14851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 200 00000100:00100000:2.0:1789131025.723721:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131025.723933:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498298368 00000100:00100000:3.0:1789131025.723949:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498298368 00000100:00100000:3.0:1789131025.724087:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 66 00000100:00100000:3.0:1789131025.724100:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8cded00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+8:2388:x1876039498298368:12345-192.168.203.11@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1789131025.724161:0:8417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000bc148169/0xf3fe2838e1fc2f5c lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131025.724185:0:8417:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009e16912c/0xf3fe2838e1fc2f47 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269c35 expref: 8 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131025.724195:0:8417:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789131025.724200:0:8417:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789131025.724205:0:8417:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bc148169/0xf3fe2838e1fc2f5c lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131025.724259:0:8417:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009e16912c/0xf3fe2838e1fc2f47 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269c35 expref: 8 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131025.724277:0:8417:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009e16912c/0xf3fe2838e1fc2f47 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269c35 expref: 8 pid: 8417 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131025.724296:0:8417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7ad12c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8417:1876039508853504:192.168.203.11@tcp:104: 00000100:00100000:3.0:1789131025.724410:0:8417:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddc32930c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789131025.729334:0:8417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7ad12c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8417:1876039508853504:192.168.203.11@tcp:104: 00010000:00010000:3.0:1789131025.729365:0:8417:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000bc148169/0xf3fe2838e1fc2f5c lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131025.730679:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131025.730763:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498298496 00000100:00100000:3.0:1789131025.730781:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498298496 00010000:00010000:3.0:1789131025.730821:0:6486:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009e16912c/0xf3fe2838e1fc2f47 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269c35 expref: 9 pid: 8417 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131025.730862:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 100 00000100:00100000:3.0:1789131025.730872:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8d3e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+9:2387:x1876039498298496:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789131025.730885:0:6486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789131025.730908:0:6486:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009e16912c/0xf3fe2838e1fc2f47 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269c35 expref: 9 pid: 8417 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131025.730920:0:6486:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009e16912c/0xf3fe2838e1fc2f47 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269c35 expref: 9 pid: 8417 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131025.730944:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009e16912c/0xf3fe2838e1fc2f47 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269c35 expref: 9 pid: 8417 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131025.731656:0:6486:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789131025.731663:0:6486:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789131025.731669:0:6486:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bc148169/0xf3fe2838e1fc2f5c lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131025.731698:0:6486:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bc148169/0xf3fe2838e1fc2f5c lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131025.731736:0:6486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789131025.731802:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8d3e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+8:2387:x1876039498298496:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 930us (1129us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131025.731810:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 100 00010000:00010000:1.0:1789131025.731878:0:8417:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000bc148169/0xf3fe2838e1fc2f5c lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131025.731887:0:8417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bc148169/0xf3fe2838e1fc2f5c lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131025.731906:0:8417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000bc148169/0xf3fe2838e1fc2f5c lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131025.731914:0:8417:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bc148169/0xf3fe2838e1fc2f5c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131025.731921:0:8417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bc148169/0xf3fe2838e1fc2f5c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131025.731933:0:8417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddfd0b4600 already unused, calling callback (ffffffffc0c4e550) 00010000:00010000:1.0:1789131025.731938:0:8417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc148169/0xf3fe2838e1fc2f5c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131025.731947:0:8417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc148169/0xf3fe2838e1fc2f5c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131025.731968:0:8417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bc148169/0xf3fe2838e1fc2f5c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131025.731976:0:8417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bc148169/0xf3fe2838e1fc2f5c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131025.732020:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8cded00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+7:2388:x1876039498298368:12345-192.168.203.11@tcp:1:lhsmtool_posix.0 Request processed in 7924us (8309us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131025.732027:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 66 00000100:00100000:3.0:1789131025.738796:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789131025.738888:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498298752 00000100:00100000:1.0:1789131025.738897:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498298752 00000100:00100000:1.0:1789131025.738956:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 201 00000100:00100000:1.0:1789131025.738974:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7ad12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+19:12629:x1876039498298752:12345-192.168.203.11@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789131025.739050:0:6502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cac00/0xf3fe2838e1fc2f63 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131025.739066:0:6502:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca200/0xf3fe2838e1fc2daa lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269bbe expref: 19 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131025.739091:0:6502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cac00/0xf3fe2838e1fc2f63 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131025.739124:0:6502:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca200/0xf3fe2838e1fc2daa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269bbe expref: 19 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131025.739137:0:6502:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca200/0xf3fe2838e1fc2daa lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269bbe expref: 19 pid: 14273 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131025.739151:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc850b0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6502:1876039508853632:192.168.203.11@tcp:104: 00000100:00100000:1.0:1789131025.739221:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddff8bef00 going to sleep for 11 seconds 00000100:00100000:2.0:1789131025.752784:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131025.752951:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498298880 00000100:00100000:3.0:1789131025.752959:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498298880 00010000:00010000:3.0:1789131025.752996:0:8431:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca200/0xf3fe2838e1fc2daa lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269bbe expref: 20 pid: 14273 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131025.753036:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 101 00000100:00100000:3.0:1789131025.753045:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc33ae450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+20:2388:x1876039498298880:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789131025.753059:0:8431:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789131025.753066:0:8431:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca200/0xf3fe2838e1fc2daa lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269bbe expref: 20 pid: 14273 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131025.753078:0:8431:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca200/0xf3fe2838e1fc2daa lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269bbe expref: 20 pid: 14273 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131025.753100:0:8431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff91dde1922b00) 00010000:00010000:3.0:1789131025.753105:0:8431:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cac00/0xf3fe2838e1fc2f63 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131025.753130:0:8431:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cac00/0xf3fe2838e1fc2f63 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131025.753137:0:8431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cac00/0xf3fe2838e1fc2f63 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131025.753155:0:8431:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789131025.753203:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc33ae450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+20:2388:x1876039498298880:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 159us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131025.753211:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 101 00010000:00010000:1.0:1789131025.753391:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca200/0xf3fe2838e1fc2daa lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269bbe expref: 19 pid: 14273 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131025.753407:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc850b0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6502:1876039508853632:192.168.203.11@tcp:104: 00010000:00010000:1.0:1789131025.753426:0:6502:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cac00/0xf3fe2838e1fc2f63 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131025.753434:0:6502:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cac00/0xf3fe2838e1fc2f63 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131025.753440:0:6502:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cac00/0xf3fe2838e1fc2f63 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131025.753698:0:6502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85caa00/0xf3fe2838e1fc2f6a lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131025.753710:0:6502:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cae00/0xf3fe2838e1fc2f2b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269c20 expref: 19 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131025.753726:0:6502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85caa00/0xf3fe2838e1fc2f6a lrc: 4/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131025.753755:0:6502:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cae00/0xf3fe2838e1fc2f2b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269c20 expref: 19 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131025.753768:0:6502:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cae00/0xf3fe2838e1fc2f2b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269c20 expref: 19 pid: 14851 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131025.753793:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc850b0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6502:1876039508853760:192.168.203.11@tcp:104: 00000100:00100000:1.0:1789131025.753849:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddff8be780 going to sleep for 11 seconds 00000100:00100000:2.0:1789131025.766907:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131025.766999:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc850b0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6502:1876039508853760:192.168.203.11@tcp:104: 00010000:00010000:0.0:1789131025.767028:0:6502:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85caa00/0xf3fe2838e1fc2f6a lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131025.767133:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498299008 00000100:00100000:3.0:1789131025.767141:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498299008 00010000:00010000:3.0:1789131025.767175:0:6487:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cae00/0xf3fe2838e1fc2f2b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269c20 expref: 20 pid: 14851 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131025.767214:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 102 00000100:00100000:3.0:1789131025.767223:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8d3cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+20:2385:x1876039498299008:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789131025.767237:0:6487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789131025.767243:0:6487:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cae00/0xf3fe2838e1fc2f2b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269c20 expref: 20 pid: 14851 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131025.767255:0:6487:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cae00/0xf3fe2838e1fc2f2b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269c20 expref: 20 pid: 14851 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131025.767277:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cae00/0xf3fe2838e1fc2f2b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269c20 expref: 20 pid: 14851 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131025.767309:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff91dcc7d6b900) 00010000:00010000:3.0:1789131025.767313:0:6487:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85caa00/0xf3fe2838e1fc2f6a lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131025.767321:0:6487:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85caa00/0xf3fe2838e1fc2f6a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131025.767328:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85caa00/0xf3fe2838e1fc2f6a lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131025.767359:0:6487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789131025.767406:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8d3cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+19:2385:x1876039498299008:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 184us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131025.767414:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 102 00010000:00010000:2.0:1789131025.767780:0:6502:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85caa00/0xf3fe2838e1fc2f6a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131025.767789:0:6502:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85caa00/0xf3fe2838e1fc2f6a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789131025.767890:0:6502:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:2.0:1789131025.768052:0:6502:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000001:00080000:2.0:1789131025.768084:0:6502:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:2.0:1789131025.768152:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8d3ed00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6502:1876039508853888:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1789131025.768218:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131025.768250:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddcf7a5a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789131025.768605:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508853888 00000100:00100000:3.0:1789131025.768611:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508853888 00000100:00100000:3.0:1789131025.768643:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1789131025.768650:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8d3e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6502:x1876039508853888:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1789131025.768732:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8d3e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6502:x1876039508853888:12345-0@lo:1000:mdt00_002.0 Request processed in 82us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131025.768740:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1789131025.768804:0:6502:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967316 gen 2 00000004:00080000:0.0:1789131025.768809:0:6502:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff91dcc86a52c0, transno 4294967316 00000100:00100000:0.0:1789131025.768827:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8d3ed00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6502:1876039508853888:0@lo:1000:mdt00_002.0 00000001:00080000:0.0:1789131025.768935:0:6502:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00000100:00100000:0.0:1789131025.768980:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc86a5680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6502:1876039508854016:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789131025.769081:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131025.769102:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddc3049b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789131025.769114:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508854016 00000100:00100000:0.0:1789131025.769118:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508854016 00000100:00100000:0.0:1789131025.769140:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1789131025.769146:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc84161c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6502:x1876039508854016:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789131025.769225:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc84161c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6502:x1876039508854016:12345-0@lo:1000:mdt00_002.0 Request processed in 78us (142us total) trans 4294967318 rc 0/0 00000100:00100000:0.0:1789131025.769240:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1789131025.769271:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc86a5680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6502:1876039508854016:0@lo:1000:mdt00_002.0 00010000:00010000:0.0:1789131025.769298:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85caa00/0xf3fe2838e1fc2f6a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131025.769306:0:6502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85caa00/0xf3fe2838e1fc2f6a lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131025.769313:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85caa00/0xf3fe2838e1fc2f6a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131025.769319:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc85caa00 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:0.0:1789131025.769323:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85caa00/0xf3fe2838e1fc2f6a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131025.769331:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85caa00/0xf3fe2838e1fc2f6a lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131025.769345:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff91dcc7d6b900) 00010000:00010000:0.0:1789131025.769347:0:6502:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789131025.769351:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85caa00/0xf3fe2838e1fc2f6a lrc: 2/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131025.769357:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85caa00/0xf3fe2838e1fc2f6a lrc: 0/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131025.769378:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4c00/0xf3fe2838e1fc2ea6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131025.769385:0:6502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4c00/0xf3fe2838e1fc2ea6 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131025.769400:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4c00/0xf3fe2838e1fc2ea6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131025.769406:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddfd0b4c00 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:0.0:1789131025.769409:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4c00/0xf3fe2838e1fc2ea6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131025.769415:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4c00/0xf3fe2838e1fc2ea6 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131025.769423:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff91dde1922b00) 00010000:00010000:0.0:1789131025.769426:0:6502:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789131025.769429:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4c00/0xf3fe2838e1fc2ea6 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131025.769434:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4c00/0xf3fe2838e1fc2ea6 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131025.769454:0:6502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc2f71 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131025.769491:0:6502:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cbe00/0xf3fe2838e1fc2ec2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269c04 expref: 22 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131025.769500:0:6502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc2f71 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131025.769523:0:6502:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cbe00/0xf3fe2838e1fc2ec2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269c04 expref: 22 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131025.769548:0:6502:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cbe00/0xf3fe2838e1fc2ec2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269c04 expref: 22 pid: 14273 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131025.769559:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc6ff92c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6502:1876039508854144:192.168.203.11@tcp:104: 00000100:00100000:0.0:1789131025.769611:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddc7cf0a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789131025.780487:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc6ff92c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6502:1876039508854144:192.168.203.11@tcp:104: 00010000:00010000:0.0:1789131025.780515:0:6502:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc2f71 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131025.785845:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131025.786199:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498299136 00000100:00100000:0.0:1789131025.786208:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498299136 00010000:00010000:0.0:1789131025.786248:0:8431:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cbe00/0xf3fe2838e1fc2ec2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269c04 expref: 23 pid: 14273 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131025.786286:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 103 00000100:00100000:0.0:1789131025.786295:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7ad0b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+23:2388:x1876039498299136:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789131025.786308:0:8431:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789131025.786314:0:8431:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cbe00/0xf3fe2838e1fc2ec2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269c04 expref: 23 pid: 14273 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131025.786326:0:8431:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cbe00/0xf3fe2838e1fc2ec2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269c04 expref: 23 pid: 14273 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131025.786347:0:8431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cbe00/0xf3fe2838e1fc2ec2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269c04 expref: 23 pid: 14273 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131025.786378:0:8431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff91dde1922b00) 00010000:00010000:0.0:1789131025.786383:0:8431:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc2f71 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131025.786392:0:8431:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc2f71 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131025.786399:0:8431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc2f71 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131025.786678:0:8431:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789131025.786740:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7ad0b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+22:2388:x1876039498299136:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 444us (902us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131025.786747:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 103 00010000:00010000:2.0:1789131025.786812:0:6502:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc2f71 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131025.786820:0:6502:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc2f71 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131025.786839:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc2f71 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131025.786845:0:6502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc2f71 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131025.786852:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc2f71 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131025.786857:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91de01ad7600 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:2.0:1789131025.786861:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc2f71 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131025.786869:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc2f71 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131025.786878:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff91dde1922b00) 00010000:00010000:2.0:1789131025.786881:0:6502:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789131025.786885:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc2f71 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131025.786891:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc2f71 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131025.786901:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cac00/0xf3fe2838e1fc2f63 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131025.786907:0:6502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cac00/0xf3fe2838e1fc2f63 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131025.786913:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cac00/0xf3fe2838e1fc2f63 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131025.786923:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc85cac00 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:2.0:1789131025.786926:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cac00/0xf3fe2838e1fc2f63 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131025.786932:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cac00/0xf3fe2838e1fc2f63 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131025.786940:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff91dde1922b00) 00010000:00010000:2.0:1789131025.786943:0:6502:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789131025.786946:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cac00/0xf3fe2838e1fc2f63 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131025.786951:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cac00/0xf3fe2838e1fc2f63 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131025.787091:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7ad12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+21:12629:x1876039498298752:12345-192.168.203.11@tcp:57:lhsmtool_posix.0 Request processed in 48117us (48317us total) trans 4294967468 rc 0/0 00000100:00100000:2.0:1789131025.787099:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 201 00000020:00080000:2.0:1789131025.787103:0:6502:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1789131025.787815:0:14475:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789131025.787820:0:14475:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789131025.788336:0:14475:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:0.0:1789131025.788344:0:14475:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789131025.796148:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131025.796224:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498299392 00000100:00100000:2.0:1789131025.796234:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498299392 00000100:00100000:2.0:1789131025.796290:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 50 00000100:00100000:2.0:1789131025.796300:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dded1d1c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+21:12629:x1876039498299392:12345-192.168.203.11@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1789131025.796578:0:6504:0:(mdd_object.c:4024:mdd_close()) Object [0x200000402:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1789131025.796605:0:6504:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967469 00010000:00010000:2.0:1789131025.796637:0:6504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f800/0xf3fe2838e1fc2f78 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131025.796653:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f800/0xf3fe2838e1fc2f78 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131025.796677:0:6504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f800/0xf3fe2838e1fc2f78 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131025.796685:0:6504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f800/0xf3fe2838e1fc2f78 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131025.796693:0:6504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f800/0xf3fe2838e1fc2f78 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131025.796699:0:6504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f800/0xf3fe2838e1fc2f78 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131025.796716:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789131025.796801:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dded1d1c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+23:12629:x1876039498299392:12345-192.168.203.11@tcp:35:lhsmtool_posix.0 Request processed in 501us (831us total) trans 4294967470 rc 0/0 00000100:00100000:2.0:1789131025.796809:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 50 00000020:00080000:2.0:1789131025.796813:0:6504:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789131025.796856:0:6489:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789131025.796861:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f800/0xf3fe2838e1fc2f78 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131025.796868:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc7f7f800 already unused, calling callback (ffffffffc0c4e550) 00010000:00010000:2.0:1789131025.796872:0:6489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f800/0xf3fe2838e1fc2f78 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131025.796880:0:6489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f800/0xf3fe2838e1fc2f78 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131025.796892:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff91dcc7d6b900) 00010000:00010000:2.0:1789131025.796895:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789131025.796906:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f800/0xf3fe2838e1fc2f78 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131025.796912:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7f800/0xf3fe2838e1fc2f78 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131025.796921:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131025.796923:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131025.796924:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789131025.919333:0:15337:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789131025.919341:0:15337:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789131025.919363:0:15337:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1789131025.919368:0:15337:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789131026.058811:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789131026.058894:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498299648 00000100:00100000:1.0:1789131026.058903:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498299648 00000100:00100000:1.0:1789131026.058973:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 202 00000100:00100000:1.0:1789131026.058982:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7ad1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+23:12639:x1876039498299648:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:1.0:1789131026.059015:0:9769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789131026.059034:0:9769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca200/0xf3fe2838e1fc2f7f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269c3c expref: -99 pid: 9769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131026.059128:0:9769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cbe00/0xf3fe2838e1fc2f86 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131026.059143:0:9769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cbe00/0xf3fe2838e1fc2f86 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131026.059163:0:9769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cbe00/0xf3fe2838e1fc2f86 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789131026.059174:0:9769:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1789131026.059278:0:9769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca200/0xf3fe2838e1fc2f7f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269c3c expref: 26 pid: 9769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131026.059299:0:9769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cbe00/0xf3fe2838e1fc2f86 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269c3c expref: 25 pid: 9769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131026.059307:0:9769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff91dcc7d6bf00) 00010000:00010000:1.0:1789131026.059311:0:9769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789131026.059314:0:9769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dcc85cbe00, rc 0) 00000100:00100000:1.0:1789131026.059368:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7ad1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+25:12639:x1876039498299648:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 387us (567us total) trans 4294967471 rc 0/0 00000100:00100000:1.0:1789131026.059376:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 202 00000100:00080000:3.0:1789131026.061518:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789131026.064191:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789131026.064267:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498299776 00000100:00100000:1.0:1789131026.064277:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498299776 00000100:00100000:1.0:1789131026.064333:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 203 00000100:00100000:1.0:1789131026.064343:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8d3ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+25:12639:x1876039498299776:12345-192.168.203.11@tcp:34:lfs.0 00010000:00010000:1.0:1789131026.064411:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85caa00/0xf3fe2838e1fc2f94 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131026.064427:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85caa00/0xf3fe2838e1fc2f94 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131026.064438:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85caa00/0xf3fe2838e1fc2f94 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131026.064567:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cae00/0xf3fe2838e1fc2f9b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131026.064576:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cae00/0xf3fe2838e1fc2f9b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131026.064583:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cae00/0xf3fe2838e1fc2f9b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131026.064659:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb200/0xf3fe2838e1fc2fa2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131026.064668:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb200/0xf3fe2838e1fc2fa2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131026.064675:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb200/0xf3fe2838e1fc2fa2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789131026.064716:0:6501:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb200/0xf3fe2838e1fc2fa2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131026.064729:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85caa00/0xf3fe2838e1fc2f94 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131026.064736:0:6501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85caa00/0xf3fe2838e1fc2f94 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131026.064743:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85caa00/0xf3fe2838e1fc2f94 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131026.064749:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc85caa00 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:1.0:1789131026.064753:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85caa00/0xf3fe2838e1fc2f94 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131026.064779:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85caa00/0xf3fe2838e1fc2f94 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131026.064791:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff91dcc7d6bf00) 00010000:00010000:1.0:1789131026.064795:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789131026.064799:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85caa00/0xf3fe2838e1fc2f94 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131026.064805:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85caa00/0xf3fe2838e1fc2f94 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131026.064818:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cae00/0xf3fe2838e1fc2f9b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131026.064824:0:6501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cae00/0xf3fe2838e1fc2f9b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131026.064829:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cae00/0xf3fe2838e1fc2f9b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131026.064835:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc85cae00 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:1.0:1789131026.064837:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cae00/0xf3fe2838e1fc2f9b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131026.064843:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cae00/0xf3fe2838e1fc2f9b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131026.064849:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff91dcc7d6bd00) 00010000:00010000:1.0:1789131026.064851:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789131026.064853:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cae00/0xf3fe2838e1fc2f9b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131026.064869:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cae00/0xf3fe2838e1fc2f9b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131026.064884:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb200/0xf3fe2838e1fc2fa2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131026.064890:0:6501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb200/0xf3fe2838e1fc2fa2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131026.064896:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb200/0xf3fe2838e1fc2fa2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131026.064901:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc85cb200 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:1.0:1789131026.064903:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb200/0xf3fe2838e1fc2fa2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131026.064908:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb200/0xf3fe2838e1fc2fa2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131026.064916:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff91dcc7d6b000) 00010000:00010000:1.0:1789131026.064918:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789131026.064921:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb200/0xf3fe2838e1fc2fa2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131026.064927:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb200/0xf3fe2838e1fc2fa2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131026.065157:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8d3ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+25:12639:x1876039498299776:12345-192.168.203.11@tcp:34:lfs.0 Request processed in 813us (973us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131026.065166:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 203 00000100:00100000:1.0:1789131026.133174:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131026.134640:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498300032 00000100:00100000:3.0:1789131026.134653:0:14273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498300032 00000100:00100000:3.0:1789131026.134726:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 204 00000100:00100000:3.0:1789131026.134736:0:14273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8509680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+25:12642:x1876039498300032:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:3.0:1789131026.134776:0:14273:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789131026.134811:0:14273:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5400/0xf3fe2838e1fc2fa9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269c43 expref: -99 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131026.134897:0:14273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4c00/0xf3fe2838e1fc2fb0 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131026.134910:0:14273:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4c00/0xf3fe2838e1fc2fb0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131026.134923:0:14273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4c00/0xf3fe2838e1fc2fb0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131026.134937:0:14273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4600/0xf3fe2838e1fc2fb7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131026.134944:0:14273:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4600/0xf3fe2838e1fc2fb7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131026.134950:0:14273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4600/0xf3fe2838e1fc2fb7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131026.136266:0:14273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5000/0xf3fe2838e1fc2fbe lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131026.136281:0:14273:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5000/0xf3fe2838e1fc2fbe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131026.136291:0:14273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5000/0xf3fe2838e1fc2fbe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789131026.136302:0:14273:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:3.0:1789131026.136396:0:14273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4c00/0xf3fe2838e1fc2fb0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131026.136404:0:14273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4c00/0xf3fe2838e1fc2fb0 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131026.136411:0:14273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4c00/0xf3fe2838e1fc2fb0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131026.136417:0:14273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddfd0b4c00 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:3.0:1789131026.136420:0:14273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4c00/0xf3fe2838e1fc2fb0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131026.136428:0:14273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4c00/0xf3fe2838e1fc2fb0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131026.136450:0:14273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff91dcc7d6bf00) 00010000:00010000:3.0:1789131026.136453:0:14273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789131026.136472:0:14273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4c00/0xf3fe2838e1fc2fb0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131026.136479:0:14273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4c00/0xf3fe2838e1fc2fb0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131026.136492:0:14273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4600/0xf3fe2838e1fc2fb7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131026.136498:0:14273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4600/0xf3fe2838e1fc2fb7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131026.136504:0:14273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4600/0xf3fe2838e1fc2fb7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131026.136518:0:14273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddfd0b4600 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:3.0:1789131026.136521:0:14273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4600/0xf3fe2838e1fc2fb7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131026.136527:0:14273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4600/0xf3fe2838e1fc2fb7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131026.136534:0:14273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff91dded3a2900) 00010000:00010000:3.0:1789131026.136536:0:14273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789131026.136539:0:14273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4600/0xf3fe2838e1fc2fb7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131026.136544:0:14273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4600/0xf3fe2838e1fc2fb7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131026.136599:0:14273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5400/0xf3fe2838e1fc2fa9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269c43 expref: 28 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131026.136611:0:14273:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5000/0xf3fe2838e1fc2fbe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269c43 expref: 27 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131026.136618:0:14273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff91dded3a2000) 00010000:00010000:3.0:1789131026.136620:0:14273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789131026.136622:0:14273:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ddfd0b5000, rc 0) 00000100:00100000:3.0:1789131026.136687:0:14273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8509680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+27:12642:x1876039498300032:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 1951us (3522us total) trans 4294967472 rc 0/0 00000100:00100000:3.0:1789131026.136696:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 204 00000100:00100000:3.0:1789131026.141665:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131026.141713:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498300160 00000100:00100000:3.0:1789131026.141722:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498300160 00000100:00100000:3.0:1789131026.141766:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 205 00000100:00100000:3.0:1789131026.141787:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7ad2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+27:12642:x1876039498300160:12345-192.168.203.11@tcp:54:lfs.0 00010000:00010000:3.0:1789131026.141846:0:9769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5200/0xf3fe2838e1fc2fcc lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131026.141861:0:9769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5200/0xf3fe2838e1fc2fcc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131026.141871:0:9769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5200/0xf3fe2838e1fc2fcc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131026.141902:0:9769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5200/0xf3fe2838e1fc2fcc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131026.141909:0:9769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5200/0xf3fe2838e1fc2fcc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131026.141915:0:9769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5200/0xf3fe2838e1fc2fcc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131026.141920:0:9769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddfd0b5200 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:3.0:1789131026.141924:0:9769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5200/0xf3fe2838e1fc2fcc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131026.141930:0:9769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5200/0xf3fe2838e1fc2fcc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131026.141940:0:9769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff91dded3a2000) 00010000:00010000:3.0:1789131026.141944:0:9769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789131026.141955:0:9769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5200/0xf3fe2838e1fc2fcc lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131026.141961:0:9769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5200/0xf3fe2838e1fc2fcc lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131026.142143:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7ad2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+27:12642:x1876039498300160:12345-192.168.203.11@tcp:54:lfs.0 Request processed in 356us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131026.142151:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 205 00000100:00100000:1.0:1789131026.160718:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131026.160792:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498300416 00000100:00100000:3.0:1789131026.160804:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498300416 00000100:00100000:3.0:1789131026.160862:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 51 00000100:00100000:3.0:1789131026.160873:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc850b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+27:12642:x1876039498300416:12345-192.168.203.11@tcp:35:lfs.0 00000100:00100000:3.0:1789131026.161082:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc850b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+28:12642:x1876039498300416:12345-192.168.203.11@tcp:35:lfs.0 Request processed in 210us (373us total) trans 4294967473 rc 0/0 00000100:00100000:3.0:1789131026.161091:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 51 00000100:00100000:3.0:1789131026.192150:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789131026.192284:0:14851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498300672 00000100:00100000:1.0:1789131026.192294:0:14851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498300672 00000100:00100000:1.0:1789131026.192348:0:14851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 206 00000100:00100000:1.0:1789131026.192358:0:14851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc86a52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+28:12174:x1876039498300672:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:1.0:1789131026.192381:0:14851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789131026.192400:0:14851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cae00/0xf3fe2838e1fc2fd3 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269c4a expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131026.192537:0:14851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85caa00/0xf3fe2838e1fc2fda lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131026.192551:0:14851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5000/0xf3fe2838e1fc2fbe lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269c43 expref: 29 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131026.192560:0:14851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85caa00/0xf3fe2838e1fc2fda lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131026.192592:0:14851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5000/0xf3fe2838e1fc2fbe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269c43 expref: 29 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131026.192604:0:14851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5000/0xf3fe2838e1fc2fbe lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269c43 expref: 29 pid: 14273 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131026.192617:0:14851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd1dad2c0 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:14851:1876039508854272:192.168.203.11@tcp:104: 00000100:00100000:1.0:1789131026.192704:0:14851:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddff8becc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789131026.197364:0:14851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd1dad2c0 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:14851:1876039508854272:192.168.203.11@tcp:104: 00010000:00010000:1.0:1789131026.197412:0:14851:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85caa00/0xf3fe2838e1fc2fda lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131026.203442:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131026.205626:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498300800 00000100:00100000:2.0:1789131026.205639:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498300800 00010000:00010000:2.0:1789131026.205683:0:6487:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5000/0xf3fe2838e1fc2fbe lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269c43 expref: 30 pid: 14273 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131026.205777:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 104 00000100:00100000:2.0:1789131026.205787:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8cdd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+30:2387:x1876039498300800:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789131026.205800:0:6487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789131026.205807:0:6487:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5000/0xf3fe2838e1fc2fbe lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269c43 expref: 30 pid: 14273 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131026.205819:0:6487:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5000/0xf3fe2838e1fc2fbe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269c43 expref: 30 pid: 14273 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131026.205848:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5000/0xf3fe2838e1fc2fbe lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269c43 expref: 30 pid: 14273 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131026.205864:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff91dded3a2000) 00010000:00010000:2.0:1789131026.205869:0:6487:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85caa00/0xf3fe2838e1fc2fda lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131026.205889:0:6487:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85caa00/0xf3fe2838e1fc2fda lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131026.205896:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85caa00/0xf3fe2838e1fc2fda lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131026.205978:0:6487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789131026.206047:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8cdd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+29:2387:x1876039498300800:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 261us (2622us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131026.206054:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 104 00010000:00010000:1.0:1789131026.209940:0:14851:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85caa00/0xf3fe2838e1fc2fda lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131026.209958:0:14851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85caa00/0xf3fe2838e1fc2fda lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789131026.210048:0:14851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:1.0:1789131026.210185:0:14851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cae00/0xf3fe2838e1fc2fd3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269c4a expref: 30 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131026.210208:0:14851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85caa00/0xf3fe2838e1fc2fda lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269c4a expref: 29 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131026.210217:0:14851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff91dded3a2000) 00010000:00010000:1.0:1789131026.210220:0:14851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789131026.210224:0:14851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dcc85caa00, rc 0) 00000100:00100000:1.0:1789131026.210355:0:14851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc86a52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+29:12174:x1876039498300672:12345-192.168.203.11@tcp:101:bash.0 Request processed in 17997us (18213us total) trans 4294967474 rc 0/0 00000100:00100000:1.0:1789131026.210364:0:14851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 206 00000100:00100000:3.0:1789131026.216276:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131026.216377:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498300928 00000100:00100000:0.0:1789131026.216387:0:14273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498300928 00000100:00100000:0.0:1789131026.216443:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 207 00000100:00100000:0.0:1789131026.216454:0:14273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8cdf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+29:12174:x1876039498300928:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:0.0:1789131026.216519:0:14273:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789131026.216539:0:14273:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7400/0xf3fe2838e1fc2fe8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269c51 expref: -99 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131026.216571:0:14273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6800/0xf3fe2838e1fc2fef lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131026.216598:0:14273:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6800/0xf3fe2838e1fc2fef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131026.216610:0:14273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6800/0xf3fe2838e1fc2fef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131026.216718:0:14273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7400/0xf3fe2838e1fc2fe8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269c51 expref: 31 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131026.216736:0:14273:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6800/0xf3fe2838e1fc2fef lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269c51 expref: 30 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131026.216746:0:14273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff91dded3a2000) 00010000:00010000:0.0:1789131026.216749:0:14273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789131026.216753:0:14273:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91de01ad6800, rc 0) 00000100:00100000:0.0:1789131026.216820:0:14273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8cdf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+30:12174:x1876039498300928:12345-192.168.203.11@tcp:101:bash.0 Request processed in 367us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131026.217527:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 207 00000100:00100000:3.0:1789131026.228724:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789131026.229097:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498301184 00000100:00100000:1.0:1789131026.229108:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498301184 00000100:00100000:1.0:1789131026.229167:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 208 00000100:00100000:1.0:1789131026.229178:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff8a52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+30:12174:x1876039498301184:12345-192.168.203.11@tcp:36:bash.0 00010000:00010000:1.0:1789131026.229384:0:9769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cae00/0xf3fe2838e1fc2ff6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131026.229420:0:9769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cae00/0xf3fe2838e1fc2ff6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131026.229432:0:9769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cae00/0xf3fe2838e1fc2ff6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789131026.229522:0:9769:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967475 00000004:00010000:1.0:1789131026.229545:0:9769:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000003b14bc0a reply state 000000009ecf7bd0 transno 4294967476 ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cae00/0xf3fe2838e1fc2ff6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131026.229558:0:9769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cae00/0xf3fe2838e1fc2ff6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131026.229565:0:9769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff91dded3a2000) 00010000:00010000:1.0:1789131026.229568:0:9769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789131026.229571:0:9769:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1789131026.229608:0:9769:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967476 00000100:00100000:1.0:1789131026.229699:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff8a52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+34:12174:x1876039498301184:12345-192.168.203.11@tcp:36:bash.0 Request processed in 522us (984us total) trans 4294967477 rc 0/0 00000100:00100000:1.0:1789131026.229707:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 208 00000020:00080000:1.0:1789131026.229712:0:9769:0:(tgt_main.c:785:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1789131026.234638:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131026.237119:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498301312 00000100:00100000:3.0:1789131026.237134:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498301312 00000100:00100000:3.0:1789131026.237213:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 209 00000100:00100000:3.0:1789131026.237223:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01a5da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+34:12174:x1876039498301312:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:3.0:1789131026.237250:0:6501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789131026.237272:0:6501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5200/0xf3fe2838e1fc2ffd lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269c58 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131026.237348:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5200/0xf3fe2838e1fc2ffd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269c58 expref: 35 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131026.237363:0:6501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5200/0xf3fe2838e1fc2ffd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269c58 expref: 35 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131026.237381:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff91dded3a2000) 00010000:00010000:3.0:1789131026.237384:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789131026.237387:0:6501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ddfd0b5200, rc 0) 00000100:00100000:3.0:1789131026.237498:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01a5da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+35:12174:x1876039498301312:12345-192.168.203.11@tcp:101:bash.0 Request processed in 276us (2869us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131026.237506:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 209 00000100:00100000:0.0:1789131026.242657:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131026.243948:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498301440 00000100:00100000:2.0:1789131026.243969:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498301440 00000100:00100000:2.0:1789131026.244038:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 67 00000100:00100000:2.0:1789131026.244048:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc6ff92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+7:12174:x1876039498301440:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:2.0:1789131026.244066:0:8416:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789131026.244086:0:8416:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f8a483ec/0xf3fe2838e1fc3004 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269c5f expref: -99 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789131026.244107:0:8416:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 9, mtime: 0x6aa3f910, atime: 0x6aa3f90e, ctime: 0x6aa3f910, blocks: 0x8 00010000:00010000:2.0:1789131026.244128:0:8416:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=382s v=(0 0) 00010000:00010000:2.0:1789131026.244132:0:8416:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789131026.244140:0:8416:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f8a483ec/0xf3fe2838e1fc3004 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269c5f expref: 8 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131026.244157:0:8416:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f8a483ec/0xf3fe2838e1fc3004 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269c5f expref: 8 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131026.244188:0:8416:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dcc7f7ee00, rc 0) 00000100:00100000:2.0:1789131026.244302:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc6ff92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+8:12174:x1876039498301440:12345-192.168.203.11@tcp:101:bash.0 Request processed in 255us (1652us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131026.244310:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 67 00000100:00100000:0.0:1789131026.257185:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131026.257285:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498301568 00000100:00100000:2.0:1789131026.257296:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498301568 00002000:00010000:2.0:1789131026.257339:0:8421:0:(ofd_dev.c:2842:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/5 (0->18446744073709551615) 00002000:00100000:2.0:1789131026.257344:0:8421:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff91dcc6ff9680 with x1876039498301568 ext(0->18446744073709551615) 00002000:00010000:2.0:1789131026.257356:0:8421:0:(ofd_dev.c:2847:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91dcc6ff9680. 00000100:00100000:2.0:1789131026.257389:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 6 00000100:00100000:2.0:1789131026.257399:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc6ff9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+8:2386:x1876039498301568:12345-192.168.203.11@tcp:10:bash.0 00002000:00010000:2.0:1789131026.257839:0:8421:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1789131026.257844:0:8421:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 1789131024 -> 1789131025 00002000:00010000:2.0:1789131026.257846:0:8421:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 1789131022 -> 1789131022 00002000:00010000:2.0:1789131026.257849:0:8421:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1789131024 -> 1789131025 00002000:00010000:2.0:1789131026.257851:0:8421:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:2.0:1789131026.257964:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc6ff9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+9:2386:x1876039498301568:12345-192.168.203.11@tcp:10:bash.0 Request processed in 557us (779us total) trans 4294967319 rc 0/0 00000100:00100000:2.0:1789131026.257974:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 6 00002000:00010000:2.0:1789131026.257977:0:8421:0:(ofd_dev.c:2842:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/5 (0->18446744073709551615) 00002000:00100000:2.0:1789131026.257980:0:8421:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff91dcc6ff9680 with x1876039498301568 ext(0->18446744073709551615) 00002000:00010000:2.0:1789131026.257985:0:8421:0:(ofd_dev.c:2847:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91dcc6ff9680. 00010000:00010000:2.0:1789131026.322099:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789131026.337607:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131026.341479:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498301696 00000100:00100000:0.0:1789131026.341493:0:14273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498301696 00000100:00100000:0.0:1789131026.341630:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 210 00000100:00100000:0.0:1789131026.341641:0:14273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff8a5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+35:12656:x1876039498301696:12345-192.168.203.11@tcp:34:lfs.0 00010000:00010000:0.0:1789131026.341710:0:14273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7c00/0xf3fe2838e1fc300b lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131026.341725:0:14273:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7c00/0xf3fe2838e1fc300b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131026.341749:0:14273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7c00/0xf3fe2838e1fc300b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131026.341775:0:14273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc3012 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131026.341783:0:14273:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc3012 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131026.341789:0:14273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc3012 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131026.341862:0:14273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6400/0xf3fe2838e1fc3019 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131026.341883:0:14273:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6400/0xf3fe2838e1fc3019 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131026.341891:0:14273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6400/0xf3fe2838e1fc3019 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789131026.341935:0:14273:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6400/0xf3fe2838e1fc3019 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131026.341947:0:14273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7c00/0xf3fe2838e1fc300b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131026.341954:0:14273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7c00/0xf3fe2838e1fc300b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131026.341960:0:14273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7c00/0xf3fe2838e1fc300b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131026.341977:0:14273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91de01ad7c00 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:0.0:1789131026.341982:0:14273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7c00/0xf3fe2838e1fc300b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131026.341989:0:14273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7c00/0xf3fe2838e1fc300b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131026.341999:0:14273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff91dcc7d6bf00) 00010000:00010000:0.0:1789131026.342002:0:14273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789131026.342007:0:14273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7c00/0xf3fe2838e1fc300b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131026.342013:0:14273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7c00/0xf3fe2838e1fc300b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131026.342025:0:14273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc3012 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131026.342031:0:14273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc3012 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131026.342037:0:14273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc3012 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131026.342041:0:14273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91de01ad7600 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:0.0:1789131026.342044:0:14273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc3012 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131026.342049:0:14273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc3012 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131026.342065:0:14273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff91ddca4e4700) 00010000:00010000:0.0:1789131026.342067:0:14273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789131026.342070:0:14273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc3012 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131026.342075:0:14273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc3012 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131026.342099:0:14273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6400/0xf3fe2838e1fc3019 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131026.342106:0:14273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6400/0xf3fe2838e1fc3019 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131026.342112:0:14273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6400/0xf3fe2838e1fc3019 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131026.342116:0:14273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91de01ad6400 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:0.0:1789131026.342119:0:14273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6400/0xf3fe2838e1fc3019 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131026.342125:0:14273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6400/0xf3fe2838e1fc3019 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131026.342132:0:14273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff91dded3a2000) 00010000:00010000:0.0:1789131026.342134:0:14273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789131026.342137:0:14273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6400/0xf3fe2838e1fc3019 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131026.342142:0:14273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6400/0xf3fe2838e1fc3019 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131026.342231:0:14273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff8a5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+35:12656:x1876039498301696:12345-192.168.203.11@tcp:34:lfs.0 Request processed in 591us (4631us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131026.342245:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 210 00000100:00100000:0.0:1789131026.390493:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131026.390755:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498301952 00000100:00100000:3.0:1789131026.390764:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498301952 00000100:00100000:3.0:1789131026.390941:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 211 00000100:00100000:3.0:1789131026.390952:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7d9a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+35:12659:x1876039498301952:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:3.0:1789131026.390972:0:9769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789131026.391282:0:9769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4a00/0xf3fe2838e1fc3020 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269c66 expref: -99 pid: 9769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131026.391350:0:9769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5400/0xf3fe2838e1fc3027 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131026.391364:0:9769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5400/0xf3fe2838e1fc3027 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131026.391394:0:9769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5400/0xf3fe2838e1fc3027 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131026.391408:0:9769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4600/0xf3fe2838e1fc302e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131026.391415:0:9769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4600/0xf3fe2838e1fc302e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131026.391422:0:9769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4600/0xf3fe2838e1fc302e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131026.391544:0:9769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4c00/0xf3fe2838e1fc3035 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131026.391555:0:9769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4c00/0xf3fe2838e1fc3035 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131026.391562:0:9769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4c00/0xf3fe2838e1fc3035 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789131026.391571:0:9769:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:3.0:1789131026.392815:0:9769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5400/0xf3fe2838e1fc3027 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131026.392892:0:9769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5400/0xf3fe2838e1fc3027 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131026.392900:0:9769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5400/0xf3fe2838e1fc3027 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131026.392906:0:9769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddfd0b5400 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:3.0:1789131026.392922:0:9769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5400/0xf3fe2838e1fc3027 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131026.392929:0:9769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5400/0xf3fe2838e1fc3027 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131026.392943:0:9769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff91dcc7d6bf00) 00010000:00010000:3.0:1789131026.392946:0:9769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789131026.392950:0:9769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5400/0xf3fe2838e1fc3027 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131026.392956:0:9769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5400/0xf3fe2838e1fc3027 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131026.392970:0:9769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4600/0xf3fe2838e1fc302e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131026.393046:0:9769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4600/0xf3fe2838e1fc302e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131026.393054:0:9769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4600/0xf3fe2838e1fc302e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131026.393060:0:9769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddfd0b4600 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:3.0:1789131026.393063:0:9769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4600/0xf3fe2838e1fc302e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131026.393069:0:9769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4600/0xf3fe2838e1fc302e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131026.393077:0:9769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff91dded3a2900) 00010000:00010000:3.0:1789131026.393079:0:9769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789131026.393088:0:9769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4600/0xf3fe2838e1fc302e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131026.393093:0:9769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4600/0xf3fe2838e1fc302e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131026.393139:0:9769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4a00/0xf3fe2838e1fc3020 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269c66 expref: 38 pid: 9769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131026.393151:0:9769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4c00/0xf3fe2838e1fc3035 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269c66 expref: 37 pid: 9769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131026.393158:0:9769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff91dded3a2000) 00010000:00010000:3.0:1789131026.393160:0:9769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789131026.393163:0:9769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ddfd0b4c00, rc 0) 00000100:00100000:3.0:1789131026.393303:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7d9a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+37:12659:x1876039498301952:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 2351us (2848us total) trans 4294967478 rc 0/0 00000100:00100000:3.0:1789131026.393311:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 211 00000100:00100000:1.0:1789131026.415281:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131026.416587:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498302080 00000100:00100000:3.0:1789131026.416600:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498302080 00000100:00100000:3.0:1789131026.416665:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 212 00000100:00100000:3.0:1789131026.416675:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd1dad2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+37:12659:x1876039498302080:12345-192.168.203.11@tcp:54:lfs.0 00010000:00010000:3.0:1789131026.416739:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4a00/0xf3fe2838e1fc3043 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131026.416756:0:6501:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85caa00/0xf3fe2838e1fc2fda lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269c4a expref: 37 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131026.416776:0:6501:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4a00/0xf3fe2838e1fc3043 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131026.416825:0:6501:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85caa00/0xf3fe2838e1fc2fda lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269c4a expref: 37 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131026.416839:0:6501:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85caa00/0xf3fe2838e1fc2fda lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269c4a expref: 37 pid: 14851 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131026.416853:0:6501:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff752940 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6501:1876039508854400:192.168.203.11@tcp:104: 00000100:00100000:3.0:1789131026.416952:0:6501:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddc33c4d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789131026.426381:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131026.426399:0:6501:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff752940 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6501:1876039508854400:192.168.203.11@tcp:104: 00010000:00010000:3.0:1789131026.426425:0:6501:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4a00/0xf3fe2838e1fc3043 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131026.426496:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498302336 00000100:00100000:0.0:1789131026.426502:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498302336 00000100:00100000:0.0:1789131026.426556:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 52 00000100:00100000:0.0:1789131026.426566:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01b303c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+38:6157:x1876039498302336:12345-192.168.203.11@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1789131026.426840:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01b303c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+39:6157:x1876039498302336:12345-192.168.203.11@tcp:35:ldlm_bl.0 Request processed in 274us (466us total) trans 4294967479 rc 0/0 00000100:00100000:0.0:1789131026.426849:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 52 00000100:00100000:0.0:1789131026.432610:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131026.432721:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498302464 00000100:00100000:2.0:1789131026.432731:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498302464 00010000:00010000:2.0:1789131026.432778:0:6485:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85caa00/0xf3fe2838e1fc2fda lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269c4a expref: 39 pid: 14851 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131026.432819:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 105 00000100:00100000:2.0:1789131026.432828:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7d99e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+39:2388:x1876039498302464:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789131026.432843:0:6485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789131026.432851:0:6485:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85caa00/0xf3fe2838e1fc2fda lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269c4a expref: 39 pid: 14851 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131026.432864:0:6485:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85caa00/0xf3fe2838e1fc2fda lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269c4a expref: 39 pid: 14851 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131026.432886:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85caa00/0xf3fe2838e1fc2fda lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269c4a expref: 39 pid: 14851 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131026.432903:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff91dded3a2000) 00010000:00010000:2.0:1789131026.432909:0:6485:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4a00/0xf3fe2838e1fc3043 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131026.432918:0:6485:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4a00/0xf3fe2838e1fc3043 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131026.432925:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4a00/0xf3fe2838e1fc3043 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131026.432966:0:6485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789131026.433025:0:6501:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4a00/0xf3fe2838e1fc3043 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131026.433035:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4a00/0xf3fe2838e1fc3043 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131026.433074:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4a00/0xf3fe2838e1fc3043 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131026.433077:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7d99e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+38:2388:x1876039498302464:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 249us (476us total) trans 0 rc 0/0 00010000:00010000:3.0:1789131026.433083:0:6501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4a00/0xf3fe2838e1fc3043 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131026.433090:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4a00/0xf3fe2838e1fc3043 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131026.433102:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddfd0b4a00 already unused, calling callback (ffffffffc185c4f0) 00000100:00100000:2.0:1789131026.433107:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 105 00010000:00010000:3.0:1789131026.433108:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4a00/0xf3fe2838e1fc3043 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131026.433126:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4a00/0xf3fe2838e1fc3043 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131026.433136:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff91dded3a2000) 00010000:00010000:3.0:1789131026.433139:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789131026.433143:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4a00/0xf3fe2838e1fc3043 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131026.433149:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4a00/0xf3fe2838e1fc3043 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131026.433187:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd1dad2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+37:12659:x1876039498302080:12345-192.168.203.11@tcp:54:lfs.0 Request processed in 16513us (17916us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131026.433195:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 212 00000100:00100000:2.0:1789131026.441910:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131026.441997:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498302720 00000100:00100000:0.0:1789131026.442007:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498302720 00000100:00100000:0.0:1789131026.442061:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 53 00000100:00100000:0.0:1789131026.442071:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc845fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+37:12659:x1876039498302720:12345-192.168.203.11@tcp:35:lfs.0 00000100:00100000:0.0:1789131026.442276:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc845fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+38:12659:x1876039498302720:12345-192.168.203.11@tcp:35:lfs.0 Request processed in 206us (375us total) trans 4294967480 rc 0/0 00000100:00100000:0.0:1789131026.442285:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 53 00000100:00100000:1.0:1789131026.565131:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131026.568157:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498302976 00000100:00100000:3.0:1789131026.568173:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498302976 00000100:00100000:3.0:1789131026.569597:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 213 00000100:00100000:3.0:1789131026.569618:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd1dacb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+38:12670:x1876039498302976:12345-192.168.203.11@tcp:101:cat.0 00010000:00010000:3.0:1789131026.569644:0:6502:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789131026.569665:0:6502:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4600/0xf3fe2838e1fc304a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269c6d expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131026.569734:0:6502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4a00/0xf3fe2838e1fc3051 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131026.569749:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4a00/0xf3fe2838e1fc3051 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131026.569776:0:6502:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4a00/0xf3fe2838e1fc3051 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131026.569807:0:6502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5400/0xf3fe2838e1fc3058 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131026.569815:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5400/0xf3fe2838e1fc3058 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131026.569822:0:6502:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5400/0xf3fe2838e1fc3058 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131026.569928:0:6502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5800/0xf3fe2838e1fc305f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131026.569937:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5800/0xf3fe2838e1fc305f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131026.569945:0:6502:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5800/0xf3fe2838e1fc305f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789131026.569955:0:6502:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 8 00010000:00010000:3.0:1789131026.570592:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4a00/0xf3fe2838e1fc3051 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131026.570601:0:6502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4a00/0xf3fe2838e1fc3051 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131026.570608:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4a00/0xf3fe2838e1fc3051 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131026.570614:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddfd0b4a00 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:3.0:1789131026.570618:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4a00/0xf3fe2838e1fc3051 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131026.570638:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4a00/0xf3fe2838e1fc3051 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131026.570649:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff91dcc7d6bf00) 00010000:00010000:3.0:1789131026.570652:0:6502:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789131026.570656:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4a00/0xf3fe2838e1fc3051 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131026.570662:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4a00/0xf3fe2838e1fc3051 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131026.570674:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5400/0xf3fe2838e1fc3058 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131026.570679:0:6502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5400/0xf3fe2838e1fc3058 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131026.570685:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5400/0xf3fe2838e1fc3058 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131026.570690:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddfd0b5400 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:3.0:1789131026.570692:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5400/0xf3fe2838e1fc3058 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131026.570698:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5400/0xf3fe2838e1fc3058 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131026.570705:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff91dded3a2900) 00010000:00010000:3.0:1789131026.570707:0:6502:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789131026.570710:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5400/0xf3fe2838e1fc3058 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131026.570725:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5400/0xf3fe2838e1fc3058 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131026.570833:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4600/0xf3fe2838e1fc304a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269c6d expref: 41 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131026.570847:0:6502:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5800/0xf3fe2838e1fc305f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269c6d expref: 40 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131026.570855:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff91dded3a2000) 00010000:00010000:3.0:1789131026.570857:0:6502:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789131026.570859:0:6502:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ddfd0b5800, rc 0) 00000100:00100000:3.0:1789131026.571006:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd1dacb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+40:12670:x1876039498302976:12345-192.168.203.11@tcp:101:cat.0 Request processed in 1396us (5883us total) trans 4294967481 rc 0/0 00000100:00100000:3.0:1789131026.571014:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 213 00000100:00100000:2.0:1789131026.585525:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131026.585613:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498303232 00000100:00100000:0.0:1789131026.585623:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498303232 00000100:00100000:0.0:1789131026.585677:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 54 00000100:00100000:0.0:1789131026.585686:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7b27c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+40:12670:x1876039498303232:12345-192.168.203.11@tcp:35:cat.0 00000100:00100000:0.0:1789131026.585957:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7b27c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+41:12670:x1876039498303232:12345-192.168.203.11@tcp:35:cat.0 Request processed in 271us (439us total) trans 4294967482 rc 0/0 00000100:00100000:0.0:1789131026.585986:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 54 00000100:00100000:2.0:1789131026.622119:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131026.622217:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498303488 00000100:00100000:0.0:1789131026.622228:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498303488 00000100:00100000:0.0:1789131026.622287:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 214 00000100:00100000:0.0:1789131026.622297:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd286bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+41:12671:x1876039498303488:12345-192.168.203.11@tcp:36:rm.0 00010000:00010000:0.0:1789131026.622353:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1789131026.622379:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5200/0xf3fe2838e1fc2ffd lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269c58 expref: 41 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131026.622403:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5800/0xf3fe2838e1fc305f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269c6d expref: 40 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131026.622417:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4c00/0xf3fe2838e1fc3035 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269c66 expref: 39 pid: 9769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131026.622430:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6800/0xf3fe2838e1fc2fef lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269c51 expref: 38 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131026.622440:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff91dded3a2000) 00010000:00010000:0.0:1789131026.622444:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789131026.622508:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc306d lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131026.622521:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc306d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131026.622531:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc306d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131026.622559:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7c00/0xf3fe2838e1fc3074 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131026.622566:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7c00/0xf3fe2838e1fc3074 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131026.622573:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7c00/0xf3fe2838e1fc3074 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131026.622643:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6a00/0xf3fe2838e1fc307b lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131026.622652:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6a00/0xf3fe2838e1fc307b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131026.622659:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6a00/0xf3fe2838e1fc307b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789131026.622872:0:6500:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:0.0:1789131026.622882:0:6500:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 382540422878ns, next at 383540420210ns, rc = 0 00010000:00010000:0.0:1789131026.622925:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7e00/0xf3fe2838e1fc3082 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131026.622933:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7e00/0xf3fe2838e1fc3082 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131026.622940:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7e00/0xf3fe2838e1fc3082 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131026.622947:0:6500:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7e00/0xf3fe2838e1fc3082 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131026.622962:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7e00/0xf3fe2838e1fc3082 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131026.622967:0:6500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7e00/0xf3fe2838e1fc3082 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131026.623130:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789131026.623150:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6a00/0xf3fe2838e1fc307b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131026.623156:0:6500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6a00/0xf3fe2838e1fc307b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131026.623162:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6a00/0xf3fe2838e1fc307b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131026.623168:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91de01ad6a00 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:0.0:1789131026.623172:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6a00/0xf3fe2838e1fc307b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131026.623179:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6a00/0xf3fe2838e1fc307b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131026.623187:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff91dded3a2000) 00010000:00010000:0.0:1789131026.623190:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789131026.623194:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6a00/0xf3fe2838e1fc307b lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131026.623199:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6a00/0xf3fe2838e1fc307b lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131026.623213:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc306d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131026.623226:0:6500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc306d lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131026.623231:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc306d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131026.623236:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91de01ad7600 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:0.0:1789131026.623240:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc306d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131026.623247:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc306d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131026.623255:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff91dcc7d6bf00) 00010000:00010000:0.0:1789131026.623257:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789131026.623260:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc306d lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131026.623266:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc306d lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789131026.623277:0:6500:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000f5e28c7b reply state 00000000b8cb239c transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7c00/0xf3fe2838e1fc3074 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131026.623287:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7c00/0xf3fe2838e1fc3074 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131026.623293:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff91ddca4e4700) 00010000:00010000:0.0:1789131026.623296:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789131026.623298:0:6500:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789131026.623374:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd286bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+39:12671:x1876039498303488:12345-192.168.203.11@tcp:36:rm.0 Request processed in 1076us (1262us total) trans 4294967483 rc 0/0 00000100:00100000:0.0:1789131026.623387:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 214 00010000:00010000:1.0:1789131026.634095:0:7442:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789131026.634109:0:7442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7e00/0xf3fe2838e1fc3082 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131026.634120:0:7442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91de01ad7e00 already unused, calling callback (ffffffffc0c4e550) 00010000:00010000:1.0:1789131026.634125:0:7442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7e00/0xf3fe2838e1fc3082 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131026.634156:0:7442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7e00/0xf3fe2838e1fc3082 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131026.634173:0:7442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff91dded3a2000) 00010000:00010000:1.0:1789131026.634177:0:7442:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789131026.634182:0:7442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7e00/0xf3fe2838e1fc3082 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131026.634188:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7e00/0xf3fe2838e1fc3082 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131026.634205:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789131026.634207:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789131026.634209:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789131026.696249:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789131026.696364:0:14851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498303744 00000100:00100000:1.0:1789131026.696376:0:14851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498303744 00000100:00100000:1.0:1789131026.696429:0:14851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 215 00000100:00100000:1.0:1789131026.696437:0:14851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddf5c2f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+39:12677:x1876039498303744:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:1.0:1789131026.696489:0:14851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789131026.696507:0:14851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca800/0xf3fe2838e1fc3089 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269c74 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131026.696605:0:14851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca400/0xf3fe2838e1fc3090 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131026.696620:0:14851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca400/0xf3fe2838e1fc3090 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131026.696631:0:14851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca400/0xf3fe2838e1fc3090 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131026.696661:0:14851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca000/0xf3fe2838e1fc3097 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131026.696675:0:14851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca000/0xf3fe2838e1fc3097 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131026.696684:0:14851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca000/0xf3fe2838e1fc3097 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789131026.697150:0:14851:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x5:0x0], index 0: 0 00010000:00010000:1.0:1789131026.697284:0:14851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb800/0xf3fe2838e1fc309e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131026.697294:0:14851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb800/0xf3fe2838e1fc309e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131026.697300:0:14851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb800/0xf3fe2838e1fc309e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131026.697329:0:14851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca400/0xf3fe2838e1fc3090 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131026.697336:0:14851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca400/0xf3fe2838e1fc3090 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131026.697342:0:14851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca400/0xf3fe2838e1fc3090 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131026.697348:0:14851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc85ca400 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:1.0:1789131026.697611:0:14851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca400/0xf3fe2838e1fc3090 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131026.697632:0:14851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca400/0xf3fe2838e1fc3090 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131026.697644:0:14851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff91dcc7d6bf00) 00010000:00010000:1.0:1789131026.697647:0:14851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789131026.697652:0:14851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca400/0xf3fe2838e1fc3090 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131026.697659:0:14851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca400/0xf3fe2838e1fc3090 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789131026.697680:0:14851:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000003db54248 reply state 0000000001b242ff transno 4294967484 ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca000/0xf3fe2838e1fc3097 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131026.697691:0:14851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca000/0xf3fe2838e1fc3097 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131026.697698:0:14851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff91ddca4e4700) 00010000:00010000:1.0:1789131026.697700:0:14851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789131026.697703:0:14851:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789131026.701232:0:14851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca800/0xf3fe2838e1fc3089 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269c74 expref: 42 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131026.701266:0:14851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb800/0xf3fe2838e1fc309e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269c74 expref: 41 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131026.701276:0:14851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff91dcc7d6b000) 00010000:00010000:2.0:1789131026.701278:0:14851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789131026.701282:0:14851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dcc85cb800, rc 0) 00000100:00100000:2.0:1789131026.701493:0:14851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddf5c2f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+42:12677:x1876039498303744:12345-192.168.203.11@tcp:101:bash.0 Request processed in 5054us (5251us total) trans 4294967484 rc 0/0 00000100:00100000:2.0:1789131026.701502:0:14851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 215 00000100:00100000:2.0:1789131026.714161:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789131026.715107:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498303872 00000100:00100000:1.0:1789131026.715120:0:9827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498303872 00000100:00100000:1.0:1789131026.715208:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 68 00000100:00100000:1.0:1789131026.715218:0:9827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd286a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+7:2385:x1876039498303872:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:1.0:1789131026.715236:0:9827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789131026.715255:0:9827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007df34cb8/0xf3fe2838e1fc30ac lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269c7b expref: -99 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789131026.715280:0:9827:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789131026.715314:0:9827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=382s v=(0 0) 00010000:00010000:1.0:1789131026.715318:0:9827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789131026.715328:0:9827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007df34cb8/0xf3fe2838e1fc30ac lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269c7b expref: 8 pid: 9827 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131026.715348:0:9827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007df34cb8/0xf3fe2838e1fc30ac lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269c7b expref: 8 pid: 9827 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131026.715362:0:9827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dcc85ca400, rc 0) 00000100:00100000:1.0:1789131026.715416:0:9827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd286a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+8:2385:x1876039498303872:12345-192.168.203.11@tcp:101:bash.0 Request processed in 200us (1265us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131026.715424:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 68 00000100:00080000:3.0:1789131026.715578:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789131026.724599:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131026.724684:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498304000 00000100:00100000:2.0:1789131026.724694:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498304000 00000100:00100000:2.0:1789131026.724749:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 69 00000100:00100000:2.0:1789131026.724758:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd1dada40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+8:12677:x1876039498304000:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:2.0:1789131026.724782:0:8416:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789131026.724799:0:8416:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f1c0ed47/0xf3fe2838e1fc30b3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269c82 expref: -99 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131026.724846:0:8416:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007df34cb8/0xf3fe2838e1fc30ac lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269c7b expref: 9 pid: 9827 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131026.724856:0:8416:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789131026.724860:0:8416:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789131026.724866:0:8416:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f1c0ed47/0xf3fe2838e1fc30b3 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269c82 expref: 9 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131026.724905:0:8416:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007df34cb8/0xf3fe2838e1fc30ac lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269c7b expref: 9 pid: 9827 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131026.724919:0:8416:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007df34cb8/0xf3fe2838e1fc30ac lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269c7b expref: 9 pid: 9827 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131026.724932:0:8416:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd28683c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8416:1876039508854528:192.168.203.11@tcp:104: 00000100:00100000:2.0:1789131026.725024:0:8416:0:(client.c:2715:ptlrpc_set_wait()) set ffff91dcc6aad240 going to sleep for 11 seconds 00000100:00100000:0.0:1789131026.730964:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131026.731061:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498304128 00000100:00100000:3.0:1789131026.731071:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498304128 00010000:00010000:3.0:1789131026.731107:0:6486:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007df34cb8/0xf3fe2838e1fc30ac lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269c7b expref: 10 pid: 9827 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131026.731156:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 106 00000100:00100000:3.0:1789131026.731167:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7d9a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+10:2388:x1876039498304128:12345-192.168.203.11@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1789131026.731173:0:8416:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd28683c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8416:1876039508854528:192.168.203.11@tcp:104: 00010000:00010000:3.0:1789131026.731186:0:6486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789131026.731204:0:8416:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f1c0ed47/0xf3fe2838e1fc30b3 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269c82 expref: 10 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131026.731210:0:6486:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007df34cb8/0xf3fe2838e1fc30ac lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269c7b expref: 10 pid: 9827 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131026.731228:0:8416:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dcc7f7ea00, rc 0) 00010000:00010000:3.0:1789131026.731250:0:6486:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007df34cb8/0xf3fe2838e1fc30ac lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269c7b expref: 10 pid: 9827 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131026.731273:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007df34cb8/0xf3fe2838e1fc30ac lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269c7b expref: 10 pid: 9827 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131026.731289:0:6486:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789131026.731294:0:6486:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789131026.731307:0:6486:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f1c0ed47/0xf3fe2838e1fc30b3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269c82 expref: 9 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131026.731317:0:6486:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f1c0ed47/0xf3fe2838e1fc30b3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269c82 expref: 9 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131026.731349:0:6486:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000f1c0ed47/0xf3fe2838e1fc30b3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269c82 expref: 9 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131026.731362:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd1dada40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+9:12677:x1876039498304000:12345-192.168.203.11@tcp:101:bash.0 Request processed in 6603us (6773us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131026.731380:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 69 00000100:00100000:3.0:1789131026.731385:0:6486:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff752940 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6486:1876039508854656:192.168.203.11@tcp:105: 00000100:00100000:3.0:1789131026.731449:0:6486:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddc33c4a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789131026.740681:0:6486:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff752940 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6486:1876039508854656:192.168.203.11@tcp:105: 00010000:00010000:0.0:1789131026.740701:0:6486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789131026.740754:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7d9a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+8:2388:x1876039498304128:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 9589us (9799us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131026.740776:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 106 00000100:00100000:3.0:1789131026.741536:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131026.742197:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498304384 00000100:00100000:0.0:1789131026.742205:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498304384 00000100:00100000:0.0:1789131026.742300:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 55 00000100:00100000:0.0:1789131026.742310:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff752940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+42:12677:x1876039498304384:12345-192.168.203.11@tcp:35:bash.0 00000100:00100000:0.0:1789131026.742691:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff752940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+43:12677:x1876039498304384:12345-192.168.203.11@tcp:35:bash.0 Request processed in 381us (1156us total) trans 4294967485 rc 0/0 00000100:00100000:0.0:1789131026.742699:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 55 00000100:00100000:2.0:1789131026.910512:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131026.910660:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498304512 00000100:00100000:0.0:1789131026.910674:0:14273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498304512 00000100:00100000:0.0:1789131026.910735:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 216 00000100:00100000:0.0:1789131026.910745:0:14273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd28683c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+43:12693:x1876039498304512:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:0.0:1789131026.910781:0:14273:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789131026.910800:0:14273:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6a00/0xf3fe2838e1fc30ba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269c89 expref: -99 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131026.910882:0:14273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6800/0xf3fe2838e1fc30c1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131026.910900:0:14273:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6800/0xf3fe2838e1fc30c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131026.910925:0:14273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6800/0xf3fe2838e1fc30c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789131026.910972:0:14273:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1789131026.910989:0:14273:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789131026.911013:0:14273:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6800/0xf3fe2838e1fc30c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131026.911046:0:14273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6a00/0xf3fe2838e1fc30ba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269c89 expref: 45 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131026.911067:0:14273:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6800/0xf3fe2838e1fc30c1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269c89 expref: 44 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131026.911075:0:14273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff91dcc7d6bf00) 00010000:00010000:0.0:1789131026.911077:0:14273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789131026.911081:0:14273:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91de01ad6800, rc 0) 00000100:00100000:0.0:1789131026.911141:0:14273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd28683c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+44:12693:x1876039498304512:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 398us (645us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131026.911427:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 216 00000100:00100000:3.0:1789131026.915282:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789131026.915390:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498304768 00000100:00100000:1.0:1789131026.915400:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498304768 00000100:00100000:1.0:1789131026.915485:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 217 00000100:00100000:1.0:1789131026.915496:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff7521c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+44:12693:x1876039498304768:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:1.0:1789131026.915515:0:9769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789131026.915535:0:9769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca600/0xf3fe2838e1fc30c8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269c90 expref: -99 pid: 9769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131026.915630:0:9769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca400/0xf3fe2838e1fc30cf lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131026.915643:0:9769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca400/0xf3fe2838e1fc30cf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131026.915654:0:9769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca400/0xf3fe2838e1fc30cf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789131026.915675:0:9769:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:1.0:1789131026.915776:0:9769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca600/0xf3fe2838e1fc30c8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269c90 expref: 47 pid: 9769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131026.915795:0:9769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca400/0xf3fe2838e1fc30cf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269c90 expref: 46 pid: 9769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131026.915803:0:9769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff91dcc7d6b000) 00010000:00010000:1.0:1789131026.915806:0:9769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789131026.916085:0:9769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dcc85ca400, rc 0) 00000100:00100000:1.0:1789131026.916182:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff7521c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+46:12693:x1876039498304768:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 686us (914us total) trans 4294967486 rc 0/0 00000100:00100000:1.0:1789131026.916190:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 217 00000100:00100000:2.0:1789131026.922156:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131026.922199:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131026.922591:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498305152 00000100:00100000:0.0:1789131026.922601:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498305152 00000100:00100000:0.0:1789131026.922665:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 17 00000100:00100000:0.0:1789131026.922675:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd2868780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+46:2386:x1876039498305152:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789131026.922689:0:6485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789131026.922712:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca400/0xf3fe2838e1fc30cf lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269c90 expref: 46 pid: 9769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131026.922750:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff91dcc7d6b000) 00010000:00010000:0.0:1789131026.922755:0:6485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789131026.922821:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd2868780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+45:2386:x1876039498305152:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 148us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131026.922830:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 17 00000100:00100000:3.0:1789131026.922914:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498305024 00000100:00100000:3.0:1789131026.922919:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498305024 00000100:00100000:3.0:1789131026.922956:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 218 00000100:00100000:3.0:1789131026.922964:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd2869a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+45:12693:x1876039498305024:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:3.0:1789131026.922997:0:6501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789131026.923012:0:6501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4600/0xf3fe2838e1fc30dd lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269c97 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131026.923101:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5400/0xf3fe2838e1fc30e4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131026.923115:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5400/0xf3fe2838e1fc30e4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131026.923126:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5400/0xf3fe2838e1fc30e4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789131026.923138:0:6501:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:3.0:1789131026.923623:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4600/0xf3fe2838e1fc30dd lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269c97 expref: 48 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131026.923641:0:6501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5400/0xf3fe2838e1fc30e4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269c97 expref: 47 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131026.923649:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff91dcc7d6b000) 00010000:00010000:3.0:1789131026.923652:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789131026.923655:0:6501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ddfd0b5400, rc 0) 00000100:00100000:3.0:1789131026.923683:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd2869a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+47:12693:x1876039498305024:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 721us (1537us total) trans 4294967487 rc 0/0 00000100:00100000:3.0:1789131026.923691:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 218 00000100:00100000:2.0:1789131026.931075:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789131026.931408:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498305280 00000100:00100000:1.0:1789131026.931417:0:9827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498305280 00000100:00100000:1.0:1789131026.931494:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 70 00000100:00100000:1.0:1789131026.931504:0:9827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd2868000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+8:2388:x1876039498305280:12345-192.168.203.11@tcp:1:lfs.0 00010000:00010000:1.0:1789131026.931546:0:9827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df96b4fa/0xf3fe2838e1fc30f2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131026.931566:0:9827:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f1c0ed47/0xf3fe2838e1fc30b3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269c82 expref: 8 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131026.931576:0:9827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789131026.931940:0:9827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789131026.931947:0:9827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df96b4fa/0xf3fe2838e1fc30f2 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131026.932002:0:9827:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f1c0ed47/0xf3fe2838e1fc30b3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269c82 expref: 8 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131026.932017:0:9827:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f1c0ed47/0xf3fe2838e1fc30b3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269c82 expref: 8 pid: 8416 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131026.932032:0:9827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd1daf0c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9827:1876039508854784:192.168.203.11@tcp:104: 00000100:00100000:1.0:1789131026.932117:0:9827:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddff8be780 going to sleep for 11 seconds 00000100:00100000:2.0:1789131026.937312:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789131026.937445:0:9827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd1daf0c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9827:1876039508854784:192.168.203.11@tcp:104: 00010000:00010000:1.0:1789131026.937512:0:9827:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000df96b4fa/0xf3fe2838e1fc30f2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131026.938335:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498305408 00000100:00100000:0.0:1789131026.938344:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498305408 00002000:00100000:0.0:1789131026.938393:0:8420:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff91ddd2868b40 x1876039498305408/t0(0) o4->b99c111d-b9b6-4590-88e4-9fefd4d4c3a4@192.168.203.11@tcp:742/0 lens 504/0 e 0 to 0 dl 1789131037 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789131026.938404:0:8420:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff91ddd2868b40 with x1876039498305408 ext(0->8) 00010000:00010000:0.0:1789131026.938412:0:8420:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000f1c0ed47/0xf3fe2838e1fc30b3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269c82 expref: 9 pid: 8416 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131026.938428:0:8420:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000f1c0ed47/0xf3fe2838e1fc30b3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269c82 expref: 9 pid: 8416 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789131026.938519:0:8420:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff91ddd2868b40 00000100:00100000:0.0:1789131026.938603:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2 00000100:00100000:0.0:1789131026.938614:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd2868b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+9:2387:x1876039498305408:12345-192.168.203.11@tcp:4:lfs.0 00000100:00100000:0.0:1789131026.939890:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd2868b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+11:2387:x1876039498305408:12345-192.168.203.11@tcp:4:lfs.0 Request processed in 1272us (2581us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1789131026.939901:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2 00002000:00100000:0.0:1789131026.939911:0:8420:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff91ddd2868b40 x1876039498305408/t4294967309(0) o4->b99c111d-b9b6-4590-88e4-9fefd4d4c3a4@192.168.203.11@tcp:742/0 lens 504/448 e 0 to 0 dl 1789131037 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789131026.939935:0:8420:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff91ddd2868b40 with x1876039498305408 ext(0->8) 00010000:00010000:0.0:1789131026.939943:0:8420:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000f1c0ed47/0xf3fe2838e1fc30b3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269c82 expref: 11 pid: 8416 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131026.939957:0:8420:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000f1c0ed47/0xf3fe2838e1fc30b3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269c82 expref: 11 pid: 8416 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789131026.939964:0:8420:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff91ddd2868b40 00000100:00100000:3.0:1789131026.944017:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131026.944558:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498305536 00000100:00100000:0.0:1789131026.944567:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498305536 00010000:00010000:0.0:1789131026.944617:0:6487:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f1c0ed47/0xf3fe2838e1fc30b3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269c82 expref: 11 pid: 8416 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131026.944666:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 107 00000100:00100000:0.0:1789131026.944676:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc33af050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+11:2386:x1876039498305536:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789131026.944690:0:6487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1789131026.944706:0:6487:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1789131026.944709:0:6487:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1789131026 00002000:00010000:0.0:1789131026.944711:0:6487:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 1789131026 00002000:00010000:0.0:1789131026.944713:0:6487:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 0 -> 1789131026 00002000:00010000:0.0:1789131026.944715:0:6487:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1789131026.944722:0:6487:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f1c0ed47/0xf3fe2838e1fc30b3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269c82 expref: 11 pid: 8416 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131026.944737:0:6487:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f1c0ed47/0xf3fe2838e1fc30b3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269c82 expref: 11 pid: 8416 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131026.944787:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f1c0ed47/0xf3fe2838e1fc30b3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269c82 expref: 11 pid: 8416 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131026.944805:0:6487:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789131026.944810:0:6487:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789131026.944815:0:6487:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000df96b4fa/0xf3fe2838e1fc30f2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131026.944825:0:6487:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df96b4fa/0xf3fe2838e1fc30f2 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131026.944850:0:6487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789131026.944908:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc33af050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+10:2386:x1876039498305536:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 233us (901us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131026.944916:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 107 00010000:00010000:1.0:1789131026.945838:0:9827:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000df96b4fa/0xf3fe2838e1fc30f2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131026.945852:0:9827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df96b4fa/0xf3fe2838e1fc30f2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131026.945874:0:9827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df96b4fa/0xf3fe2838e1fc30f2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131026.945883:0:9827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000df96b4fa/0xf3fe2838e1fc30f2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131026.945904:0:9827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000df96b4fa/0xf3fe2838e1fc30f2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131026.945912:0:9827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc85ca600 already unused, calling callback (ffffffffc0c4e550) 00010000:00010000:1.0:1789131026.945916:0:9827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000df96b4fa/0xf3fe2838e1fc30f2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131026.945923:0:9827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000df96b4fa/0xf3fe2838e1fc30f2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131026.945938:0:9827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000df96b4fa/0xf3fe2838e1fc30f2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131026.945945:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df96b4fa/0xf3fe2838e1fc30f2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131026.946034:0:9827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd2868000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+9:2388:x1876039498305280:12345-192.168.203.11@tcp:1:lfs.0 Request processed in 14530us (14966us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131026.946042:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 70 00000100:00100000:3.0:1789131026.951787:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789131026.952581:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498305792 00000100:00100000:1.0:1789131026.952592:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498305792 00000100:00100000:1.0:1789131026.952639:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 56 00000100:00100000:1.0:1789131026.952659:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dded1d2050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+47:12693:x1876039498305792:12345-192.168.203.11@tcp:35:lfs.0 00000004:00010000:1.0:1789131026.952714:0:6503:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5400/0xf3fe2838e1fc30e4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269c97 expref: 47 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789131026.952907:0:6503:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:1.0:1789131026.952941:0:6503:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:1.0:1789131026.953231:0:6503:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00010000:00010000:1.0:1789131026.953265:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca600/0xf3fe2838e1fc30f9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131026.953278:0:6503:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb800/0xf3fe2838e1fc309e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269c74 expref: 51 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131026.953287:0:6503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca600/0xf3fe2838e1fc30f9 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131026.953321:0:6503:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb800/0xf3fe2838e1fc309e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269c74 expref: 51 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131026.953335:0:6503:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb800/0xf3fe2838e1fc309e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269c74 expref: 51 pid: 14851 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131026.953348:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd1daf0c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6503:1876039508854912:192.168.203.11@tcp:104: 00000100:00100000:1.0:1789131026.953435:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddff8bef00 going to sleep for 11 seconds 00000100:00100000:1.0:1789131026.958535:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd1daf0c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6503:1876039508854912:192.168.203.11@tcp:104: 00010000:00010000:1.0:1789131026.958564:0:6503:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca600/0xf3fe2838e1fc30f9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6503 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131026.961070:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131026.961498:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498305920 00000100:00100000:0.0:1789131026.961516:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498305920 00010000:00010000:0.0:1789131026.961555:0:6485:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb800/0xf3fe2838e1fc309e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269c74 expref: 52 pid: 14851 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131026.961597:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 108 00000100:00100000:0.0:1789131026.961607:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff750b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+52:2387:x1876039498305920:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789131026.961622:0:6485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789131026.961629:0:6485:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb800/0xf3fe2838e1fc309e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269c74 expref: 52 pid: 14851 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131026.961666:0:6485:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb800/0xf3fe2838e1fc309e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269c74 expref: 52 pid: 14851 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131026.961689:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb800/0xf3fe2838e1fc309e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269c74 expref: 52 pid: 14851 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131026.961705:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff91dcc7d6b000) 00010000:00010000:0.0:1789131026.961711:0:6485:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca600/0xf3fe2838e1fc30f9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131026.961720:0:6485:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca600/0xf3fe2838e1fc30f9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131026.961728:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca600/0xf3fe2838e1fc30f9 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131026.961757:0:6485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789131026.961815:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff750b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+51:2387:x1876039498305920:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 209us (753us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131026.961824:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 108 00010000:00010000:3.0:1789131026.963048:0:6503:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca600/0xf3fe2838e1fc30f9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131026.963060:0:6503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca600/0xf3fe2838e1fc30f9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6503 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789131026.963165:0:6503:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000001:00080000:3.0:1789131026.963275:0:6503:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:3.0:1789131026.963365:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff750780 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6503:1876039508855040:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789131026.963417:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131026.963793:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508855040 00000100:00100000:0.0:1789131026.963800:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508855040 00000100:00100000:0.0:1789131026.963860:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1789131026.963869:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff751a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6503:x1876039508855040:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789131026.963943:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff751a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6503:x1876039508855040:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 76us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131026.963950:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1789131026.964109:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddc33c4e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789131026.964135:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff750780 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6503:1876039508855040:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1789131026.964265:0:6503:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00000100:00100000:2.0:1789131026.964311:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd286b0c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6503:1876039508855168:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789131026.964346:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131026.964374:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddc33c4d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789131026.964707:0:11069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508855168 00000100:00100000:0.0:1789131026.964713:0:11069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508855168 00000100:00100000:0.0:1789131026.964747:0:11069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1789131026.964755:0:11069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd286a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6503:x1876039508855168:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789131026.964872:0:11069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd286a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:6503:x1876039508855168:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 117us (524us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1789131026.964879:0:11069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1789131026.965305:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd286b0c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6503:1876039508855168:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1789131026.965346:0:6503:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:2.0:1789131026.965379:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca600/0xf3fe2838e1fc30f9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131026.965389:0:6503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca600/0xf3fe2838e1fc30f9 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131026.965396:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca600/0xf3fe2838e1fc30f9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131026.965402:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc85ca600 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:2.0:1789131026.965406:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca600/0xf3fe2838e1fc30f9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131026.965414:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca600/0xf3fe2838e1fc30f9 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131026.965438:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff91dcc7d6b000) 00010000:00010000:2.0:1789131026.965451:0:6503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1789131026.965482:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca600/0xf3fe2838e1fc30f9 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6503 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131026.965489:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca600/0xf3fe2838e1fc30f9 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6503 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789131026.965691:0:6503:0:(mdd_object.c:4024:mdd_close()) Object [0x200000402:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1789131026.965745:0:6503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:2.0:1789131026.965756:0:6503:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 382883296487ns, next at 383883294185ns, rc = 0 00000001:00080000:2.0:1789131026.965773:0:6503:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967495 00010000:00010000:2.0:1789131026.965796:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff91dcc7d6b000) 00010000:00010000:2.0:1789131026.965799:0:6503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789131026.965806:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5400/0xf3fe2838e1fc30e4 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269c97 expref: 55 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131026.965952:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dded1d2050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+54:12693:x1876039498305792:12345-192.168.203.11@tcp:35:lfs.0 Request processed in 13303us (14174us total) trans 4294967496 rc 0/0 00000100:00100000:2.0:1789131026.965961:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 56 00000020:00080000:2.0:1789131026.965966:0:6503:0:(tgt_main.c:785:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00080000:3.0:1789131026.966119:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789131026.969343:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131026.969424:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498306048 00000100:00100000:0.0:1789131026.969441:0:14273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498306048 00000100:00100000:0.0:1789131026.969535:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 219 00000100:00100000:0.0:1789131026.969545:0:14273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff752d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+54:12693:x1876039498306048:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:0.0:1789131026.969566:0:14273:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789131026.969586:0:14273:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6a00/0xf3fe2838e1fc3100 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269c9e expref: -99 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131026.969636:0:14273:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6a00/0xf3fe2838e1fc3100 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269c9e expref: 55 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131026.969650:0:14273:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6a00/0xf3fe2838e1fc3100 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269c9e expref: 55 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131026.969667:0:14273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff91ddca4e4f00) 00010000:00010000:0.0:1789131026.969670:0:14273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789131026.969674:0:14273:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91de01ad6a00, rc 0) 00000100:00100000:0.0:1789131026.969722:0:14273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff752d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+55:12693:x1876039498306048:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 179us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131026.969730:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 219 00000100:00100000:1.0:1789131026.976504:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131026.976584:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498306304 00000100:00100000:0.0:1789131026.976593:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498306304 00000100:00100000:0.0:1789131026.976646:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 57 00000100:00100000:0.0:1789131026.976655:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd1daf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+55:12693:x1876039498306304:12345-192.168.203.11@tcp:35:lfs.0 00000100:00100000:0.0:1789131026.976883:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd1daf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+56:12693:x1876039498306304:12345-192.168.203.11@tcp:35:lfs.0 Request processed in 228us (424us total) trans 4294967497 rc 0/0 00000100:00100000:0.0:1789131026.976892:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 57 00000100:00100000:3.0:1789131027.026195:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789131027.026218:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd2869e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508855296:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789131027.026284:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131027.026389:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508855296 00000100:00100000:0.0:1789131027.026395:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508855296 00000100:00100000:0.0:1789131027.026437:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1789131027.026445:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff751e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508855296:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789131027.026510:0:6506:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789131027.026555:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff751e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508855296:12345-0@lo:41:osp-pre-1-0.0 Request processed in 111us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131027.026563:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1789131027.026983:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd2869e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508855296:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789131027.027346:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789131027.027358:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7d99e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508855424:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789131027.027402:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131027.027492:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508855424 00000100:00100000:0.0:1789131027.027498:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508855424 00000100:00100000:0.0:1789131027.027520:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1789131027.027527:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd1dad680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508855424:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789131027.027548:0:6505:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1789131027.027595:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd1dad680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508855424:12345-0@lo:41:osp-pre-0-1.0 Request processed in 68us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131027.027602:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1789131027.027667:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7d99e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508855424:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789131027.071695:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131027.071784:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498306432 00000100:00100000:0.0:1789131027.071793:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498306432 00000100:00100000:0.0:1789131027.071852:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 220 00000100:00100000:0.0:1789131027.071861:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd2868f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+56:12703:x1876039498306432:12345-192.168.203.11@tcp:34:lfs.0 00010000:00010000:0.0:1789131027.071944:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7800/0xf3fe2838e1fc3107 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131027.071961:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7800/0xf3fe2838e1fc3107 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131027.072182:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7800/0xf3fe2838e1fc3107 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131027.072199:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc310e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131027.072207:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc310e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131027.072215:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc310e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131027.072283:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7e00/0xf3fe2838e1fc3115 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131027.072291:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7e00/0xf3fe2838e1fc3115 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131027.072298:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7e00/0xf3fe2838e1fc3115 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789131027.072344:0:6500:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7e00/0xf3fe2838e1fc3115 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131027.072356:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7800/0xf3fe2838e1fc3107 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131027.072373:0:6500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7800/0xf3fe2838e1fc3107 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131027.072380:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7800/0xf3fe2838e1fc3107 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131027.072387:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91de01ad7800 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:0.0:1789131027.072391:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7800/0xf3fe2838e1fc3107 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131027.072401:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7800/0xf3fe2838e1fc3107 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131027.072413:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff91dcc7d6bf00) 00010000:00010000:0.0:1789131027.072416:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789131027.072421:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7800/0xf3fe2838e1fc3107 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131027.072428:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7800/0xf3fe2838e1fc3107 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131027.072441:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc310e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131027.072447:0:6500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc310e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131027.072454:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc310e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131027.072578:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91de01ad7600 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:0.0:1789131027.072587:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc310e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131027.072594:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc310e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131027.072602:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff91ddca4e4700) 00010000:00010000:0.0:1789131027.072605:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789131027.072608:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc310e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131027.072614:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc310e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131027.072624:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7e00/0xf3fe2838e1fc3115 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131027.072629:0:6500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7e00/0xf3fe2838e1fc3115 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131027.072635:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7e00/0xf3fe2838e1fc3115 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131027.072640:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91de01ad7e00 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:0.0:1789131027.072642:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7e00/0xf3fe2838e1fc3115 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131027.072648:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7e00/0xf3fe2838e1fc3115 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131027.072654:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff91ddca4e4f00) 00010000:00010000:0.0:1789131027.072656:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789131027.072663:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7e00/0xf3fe2838e1fc3115 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131027.072668:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7e00/0xf3fe2838e1fc3115 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131027.072742:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd2868f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+56:12703:x1876039498306432:12345-192.168.203.11@tcp:34:lfs.0 Request processed in 881us (1055us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131027.072750:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 220 00000100:00100000:3.0:1789131027.129671:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789131027.129849:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498306688 00000100:00100000:1.0:1789131027.129860:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498306688 00000100:00100000:1.0:1789131027.129926:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 221 00000100:00100000:1.0:1789131027.129936:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff7512c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+56:12706:x1876039498306688:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:1.0:1789131027.129954:0:6501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789131027.129972:0:6501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85caa00/0xf3fe2838e1fc311c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269ca5 expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131027.130035:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb600/0xf3fe2838e1fc3123 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131027.130048:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb600/0xf3fe2838e1fc3123 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131027.130061:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb600/0xf3fe2838e1fc3123 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131027.130072:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca200/0xf3fe2838e1fc312a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131027.130079:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca200/0xf3fe2838e1fc312a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131027.130086:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca200/0xf3fe2838e1fc312a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131027.130185:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb200/0xf3fe2838e1fc3131 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131027.130194:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb200/0xf3fe2838e1fc3131 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131027.130214:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb200/0xf3fe2838e1fc3131 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789131027.130228:0:6501:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:1.0:1789131027.130301:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb600/0xf3fe2838e1fc3123 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131027.130308:0:6501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb600/0xf3fe2838e1fc3123 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131027.130315:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb600/0xf3fe2838e1fc3123 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131027.130320:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc85cb600 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:1.0:1789131027.130324:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb600/0xf3fe2838e1fc3123 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131027.130331:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb600/0xf3fe2838e1fc3123 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131027.130342:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff91dcc7d6bf00) 00010000:00010000:1.0:1789131027.130359:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789131027.130363:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb600/0xf3fe2838e1fc3123 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131027.130369:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb600/0xf3fe2838e1fc3123 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131027.130382:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca200/0xf3fe2838e1fc312a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131027.130388:0:6501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca200/0xf3fe2838e1fc312a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131027.130400:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca200/0xf3fe2838e1fc312a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131027.130406:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc85ca200 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:1.0:1789131027.130408:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca200/0xf3fe2838e1fc312a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131027.130414:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca200/0xf3fe2838e1fc312a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131027.130422:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff91ddca4e4700) 00010000:00010000:1.0:1789131027.130425:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789131027.130428:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca200/0xf3fe2838e1fc312a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131027.130433:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca200/0xf3fe2838e1fc312a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131027.130509:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85caa00/0xf3fe2838e1fc311c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269ca5 expref: 59 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131027.130526:0:6501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb200/0xf3fe2838e1fc3131 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269ca5 expref: 58 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131027.130533:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff91ddca4e4f00) 00010000:00010000:1.0:1789131027.130535:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789131027.130537:0:6501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dcc85cb200, rc 0) 00000100:00100000:1.0:1789131027.130608:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff7512c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+58:12706:x1876039498306688:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 673us (946us total) trans 4294967498 rc 0/0 00000100:00100000:1.0:1789131027.130627:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 221 00000100:00100000:2.0:1789131027.136412:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131027.136520:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498306816 00000100:00100000:0.0:1789131027.136529:0:14273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498306816 00000100:00100000:0.0:1789131027.136583:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 222 00000100:00100000:0.0:1789131027.136593:0:14273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd286bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+58:12706:x1876039498306816:12345-192.168.203.11@tcp:54:lfs.0 00010000:00010000:0.0:1789131027.136653:0:14273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7e00/0xf3fe2838e1fc313f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131027.136668:0:14273:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7e00/0xf3fe2838e1fc313f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131027.136679:0:14273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7e00/0xf3fe2838e1fc313f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131027.136712:0:14273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7e00/0xf3fe2838e1fc313f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131027.136720:0:14273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7e00/0xf3fe2838e1fc313f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131027.136727:0:14273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7e00/0xf3fe2838e1fc313f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131027.136734:0:14273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91de01ad7e00 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:0.0:1789131027.136750:0:14273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7e00/0xf3fe2838e1fc313f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131027.136759:0:14273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7e00/0xf3fe2838e1fc313f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131027.136783:0:14273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff91ddca4e4f00) 00010000:00010000:0.0:1789131027.136787:0:14273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789131027.136791:0:14273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7e00/0xf3fe2838e1fc313f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131027.136798:0:14273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7e00/0xf3fe2838e1fc313f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131027.137106:0:14273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd286bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+58:12706:x1876039498306816:12345-192.168.203.11@tcp:54:lfs.0 Request processed in 513us (700us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131027.137114:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 222 00000100:00100000:2.0:1789131027.140548:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131027.141131:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498307072 00000100:00100000:0.0:1789131027.141141:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498307072 00000100:00100000:3.0:1789131027.142735:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 58 00000100:00100000:3.0:1789131027.142751:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd286a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+58:12706:x1876039498307072:12345-192.168.203.11@tcp:35:lfs.0 00000100:00100000:3.0:1789131027.143677:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd286a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+59:12706:x1876039498307072:12345-192.168.203.11@tcp:35:lfs.0 Request processed in 929us (3137us total) trans 4294967499 rc 0/0 00000100:00100000:3.0:1789131027.143686:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 58 00000100:00100000:3.0:1789131027.252412:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789131027.253360:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498307328 00000100:00100000:1.0:1789131027.253371:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498307328 00000100:00100000:1.0:1789131027.253445:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 223 00000100:00100000:1.0:1789131027.253456:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff751680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+59:12716:x1876039498307328:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:1.0:1789131027.253515:0:9769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789131027.253518:0:9769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789131027.253544:0:9769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6800/0xf3fe2838e1fc30c1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269c89 expref: 59 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131027.253562:0:9769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff91dcc7d6bf00) 00010000:00010000:1.0:1789131027.253567:0:9769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789131027.253579:0:9769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca200/0xf3fe2838e1fc3146 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269cac expref: -99 pid: 9769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131027.253679:0:9769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb600/0xf3fe2838e1fc314d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131027.253693:0:9769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb600/0xf3fe2838e1fc314d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131027.253703:0:9769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb600/0xf3fe2838e1fc314d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789131027.253714:0:9769:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:1.0:1789131027.253824:0:9769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca200/0xf3fe2838e1fc3146 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269cac expref: 61 pid: 9769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131027.253859:0:9769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb600/0xf3fe2838e1fc314d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269cac expref: 60 pid: 9769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131027.253932:0:9769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff91ddca4e4f00) 00010000:00010000:1.0:1789131027.253935:0:9769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789131027.253938:0:9769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dcc85cb600, rc 0) 00000100:00100000:1.0:1789131027.254007:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff751680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+60:12716:x1876039498307328:12345-192.168.203.11@tcp:101:bash.0 Request processed in 553us (1604us total) trans 4294967500 rc 0/0 00000100:00100000:1.0:1789131027.254015:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 223 00000100:00100000:1.0:1789131027.273558:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789131027.273610:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131027.273672:0:14851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498307584 00000100:00100000:0.0:1789131027.273682:0:14851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498307584 00000100:00100000:0.0:1789131027.273741:0:14851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 224 00000100:00100000:0.0:1789131027.273751:0:14851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd1dac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+60:12716:x1876039498307584:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:0.0:1789131027.273782:0:14851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789131027.273802:0:14851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7e00/0xf3fe2838e1fc315b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269cb3 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131027.273836:0:14851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc3162 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131027.273849:0:14851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc3162 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131027.273873:0:14851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc3162 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131027.273896:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498307456 00000100:00100000:2.0:1789131027.273902:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498307456 00000100:00100000:2.0:1789131027.273944:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 18 00000100:00100000:2.0:1789131027.273952:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd1daed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+62:2385:x1876039498307456:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789131027.273973:0:6487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789131027.273988:0:14851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7e00/0xf3fe2838e1fc315b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269cb3 expref: 63 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131027.273996:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb600/0xf3fe2838e1fc314d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269cac expref: 63 pid: 9769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131027.274010:0:14851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc3162 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269cb3 expref: 61 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131027.274013:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff91ddca4e4f00) 00010000:00010000:0.0:1789131027.274023:0:14851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff91ddca4e4f00) 00010000:00010000:0.0:1789131027.274026:0:14851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789131027.274028:0:14851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91de01ad7600, rc 0) 00000100:00100000:0.0:1789131027.274080:0:14851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd1dac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+61:12716:x1876039498307584:12345-192.168.203.11@tcp:101:bash.0 Request processed in 330us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131027.274087:0:14851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 224 00010000:00010000:2.0:1789131027.274350:0:6487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789131027.274398:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd1daed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+60:2385:x1876039498307456:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 439us (782us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131027.274406:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 18 00000100:00100000:1.0:1789131027.286414:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131027.286504:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498307840 00000100:00100000:3.0:1789131027.286514:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498307840 00000100:00100000:2.0:1789131027.287546:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 225 00000100:00100000:2.0:1789131027.287560:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd1dafc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+60:12716:x1876039498307840:12345-192.168.203.11@tcp:36:bash.0 00010000:00010000:2.0:1789131027.287614:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789131027.287641:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb200/0xf3fe2838e1fc3131 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269ca5 expref: 60 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131027.287659:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff91ddca4e4f00) 00010000:00010000:2.0:1789131027.287664:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789131027.287833:0:6502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e800/0xf3fe2838e1fc3169 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131027.287845:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e800/0xf3fe2838e1fc3169 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131027.287854:0:6502:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e800/0xf3fe2838e1fc3169 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789131027.287906:0:6502:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967501 00000004:00010000:2.0:1789131027.287928:0:6502:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000a2e4d6d7 reply state 00000000736566fc transno 4294967502 ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e800/0xf3fe2838e1fc3169 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131027.287955:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e800/0xf3fe2838e1fc3169 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131027.287962:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff91ddca4e4f00) 00010000:00010000:2.0:1789131027.287964:0:6502:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789131027.287966:0:6502:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789131027.288061:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd1dafc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+62:12716:x1876039498307840:12345-192.168.203.11@tcp:36:bash.0 Request processed in 504us (1657us total) trans 4294967502 rc 0/0 00000100:00100000:2.0:1789131027.288069:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 225 00000020:00080000:2.0:1789131027.288075:0:6502:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789131027.298635:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131027.298809:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498307968 00000100:00100000:3.0:1789131027.298819:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498307968 00000100:00100000:3.0:1789131027.298892:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 226 00000100:00100000:3.0:1789131027.298916:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7d9a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+62:12716:x1876039498307968:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:3.0:1789131027.298941:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789131027.298960:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4600/0xf3fe2838e1fc3170 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269cba expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131027.299451:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4a00/0xf3fe2838e1fc3177 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131027.299520:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4a00/0xf3fe2838e1fc3177 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131027.299535:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4a00/0xf3fe2838e1fc3177 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789131027.299976:0:6500:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1789131027.299982:0:6500:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789131027.300005:0:6500:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4a00/0xf3fe2838e1fc3177 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131027.300038:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4600/0xf3fe2838e1fc3170 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269cba expref: 64 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131027.300057:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4a00/0xf3fe2838e1fc3177 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269cba expref: 63 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131027.300066:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff91ddca4e4f00) 00010000:00010000:2.0:1789131027.300069:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789131027.300073:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ddfd0b4a00, rc 0) 00000100:00100000:2.0:1789131027.300193:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7d9a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+63:12716:x1876039498307968:12345-192.168.203.11@tcp:101:bash.0 Request processed in 1280us (1567us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131027.300201:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 226 00000100:00100000:3.0:1789131027.316346:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789131027.316556:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498308224 00000100:00100000:1.0:1789131027.316566:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498308224 00000100:00100000:1.0:1789131027.316623:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 59 00000100:00100000:1.0:1789131027.316632:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff7530c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+63:12716:x1876039498308224:12345-192.168.203.11@tcp:35:bash.0 00000100:00100000:1.0:1789131027.317002:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff7530c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+64:12716:x1876039498308224:12345-192.168.203.11@tcp:35:bash.0 Request processed in 370us (664us total) trans 4294967503 rc 0/0 00000100:00100000:1.0:1789131027.317011:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 59 00010000:00010000:2.0:1789131027.346552:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789131027.417731:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131027.417914:0:14851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498308352 00000100:00100000:0.0:1789131027.417924:0:14851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498308352 00000100:00100000:0.0:1789131027.417990:0:14851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 227 00000100:00100000:0.0:1789131027.418000:0:14851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd1daf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+64:12722:x1876039498308352:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:0.0:1789131027.418022:0:14851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789131027.418042:0:14851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6e00/0xf3fe2838e1fc317e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269cc1 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131027.418101:0:14851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7400/0xf3fe2838e1fc3185 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131027.418135:0:14851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7400/0xf3fe2838e1fc3185 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131027.418147:0:14851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7400/0xf3fe2838e1fc3185 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789131027.418187:0:14851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1789131027.418191:0:14851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789131027.418210:0:14851:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7400/0xf3fe2838e1fc3185 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131027.418235:0:14851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6e00/0xf3fe2838e1fc317e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269cc1 expref: 66 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131027.418254:0:14851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7400/0xf3fe2838e1fc3185 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269cc1 expref: 65 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131027.418263:0:14851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff91dcc7d6bf00) 00010000:00010000:0.0:1789131027.418266:0:14851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789131027.418269:0:14851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91de01ad7400, rc 0) 00000100:00100000:0.0:1789131027.418332:0:14851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd1daf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+65:12722:x1876039498308352:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 332us (610us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131027.418339:0:14851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 227 00000100:00100000:0.0:1789131027.426541:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131027.426736:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498308480 00000100:00100000:2.0:1789131027.426746:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498308480 00000100:00100000:2.0:1789131027.426813:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 228 00000100:00100000:2.0:1789131027.426823:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7d98f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+65:12722:x1876039498308480:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:2.0:1789131027.426843:0:6502:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789131027.427065:0:6502:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e600/0xf3fe2838e1fc318c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269cc8 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131027.427134:0:6502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fc00/0xf3fe2838e1fc3193 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131027.427149:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fc00/0xf3fe2838e1fc3193 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131027.427160:0:6502:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fc00/0xf3fe2838e1fc3193 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131027.427171:0:6502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e200/0xf3fe2838e1fc319a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131027.427178:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e200/0xf3fe2838e1fc319a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131027.427184:0:6502:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e200/0xf3fe2838e1fc319a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131027.427258:0:6502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e000/0xf3fe2838e1fc31a1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131027.427268:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e000/0xf3fe2838e1fc31a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131027.427293:0:6502:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e000/0xf3fe2838e1fc31a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789131027.427330:0:6502:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1789131027.427334:0:6502:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789131027.427351:0:6502:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e000/0xf3fe2838e1fc31a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131027.427361:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e000/0xf3fe2838e1fc31a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131027.427368:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fc00/0xf3fe2838e1fc3193 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131027.427374:0:6502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fc00/0xf3fe2838e1fc3193 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131027.427380:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fc00/0xf3fe2838e1fc3193 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131027.427385:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc7f7fc00 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:2.0:1789131027.427389:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fc00/0xf3fe2838e1fc3193 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131027.427410:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fc00/0xf3fe2838e1fc3193 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131027.427422:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff91dcc7d6bf00) 00010000:00010000:2.0:1789131027.427425:0:6502:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789131027.427430:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fc00/0xf3fe2838e1fc3193 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131027.431876:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fc00/0xf3fe2838e1fc3193 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131027.431899:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e200/0xf3fe2838e1fc319a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131027.431905:0:6502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e200/0xf3fe2838e1fc319a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131027.431912:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e200/0xf3fe2838e1fc319a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131027.431917:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc7f7e200 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:2.0:1789131027.431922:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e200/0xf3fe2838e1fc319a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131027.431930:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e200/0xf3fe2838e1fc319a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131027.431946:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff91ddca4e4700) 00010000:00010000:2.0:1789131027.431949:0:6502:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789131027.431953:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e200/0xf3fe2838e1fc319a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131027.431960:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e200/0xf3fe2838e1fc319a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131027.432002:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e600/0xf3fe2838e1fc318c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269cc8 expref: 67 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131027.432016:0:6502:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e000/0xf3fe2838e1fc31a1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269cc8 expref: 66 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131027.432029:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff91ddca4e4f00) 00010000:00010000:2.0:1789131027.432032:0:6502:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789131027.432035:0:6502:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dcc7f7e000, rc 0) 00000100:00100000:2.0:1789131027.432118:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7d98f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+66:12722:x1876039498308480:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 5295us (5585us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131027.432127:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 228 00000100:00100000:3.0:1789131027.443412:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131027.443487:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131027.443643:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498308608 00000100:00100000:0.0:1789131027.443652:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498308608 00000100:00100000:0.0:1789131027.443716:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 19 00000100:00100000:0.0:1789131027.443727:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff753840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+66:2385:x1876039498308608:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789131027.443756:0:6485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789131027.443791:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e000/0xf3fe2838e1fc31a1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269cc8 expref: 66 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131027.443809:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff91ddca4e4f00) 00010000:00010000:0.0:1789131027.443814:0:6485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789131027.443875:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff753840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+65:2385:x1876039498308608:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 149us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131027.443883:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 19 00000100:00100000:1.0:1789131027.446522:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498308864 00000100:00100000:1.0:1789131027.446534:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498308864 00000100:00100000:1.0:1789131027.446603:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 229 00000100:00100000:1.0:1789131027.446613:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff753c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+65:12722:x1876039498308864:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:1.0:1789131027.446633:0:9769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789131027.446664:0:9769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cac00/0xf3fe2838e1fc31a8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269ccf expref: -99 pid: 9769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131027.446774:0:9769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca200/0xf3fe2838e1fc31af lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131027.446789:0:9769:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4a00/0xf3fe2838e1fc3177 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269cba expref: 66 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131027.446799:0:9769:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca200/0xf3fe2838e1fc31af lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131027.446969:0:9769:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4a00/0xf3fe2838e1fc3177 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269cba expref: 66 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131027.446992:0:9769:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4a00/0xf3fe2838e1fc3177 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269cba expref: 66 pid: 6500 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131027.447004:0:9769:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd1dae940 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9769:1876039508855552:192.168.203.11@tcp:104: 00000100:00100000:1.0:1789131027.447135:0:9769:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddff8beb40 going to sleep for 11 seconds 00000100:00100000:1.0:1789131027.463703:0:9769:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd1dae940 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9769:1876039508855552:192.168.203.11@tcp:104: 00010000:00010000:1.0:1789131027.463733:0:9769:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca200/0xf3fe2838e1fc31af lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131027.468520:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131027.469937:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498308992 00000100:00100000:2.0:1789131027.469949:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498308992 00010000:00010000:2.0:1789131027.469992:0:6487:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4a00/0xf3fe2838e1fc3177 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269cba expref: 67 pid: 6500 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131027.470041:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 109 00000100:00100000:2.0:1789131027.470051:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff753480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+67:2388:x1876039498308992:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789131027.470065:0:6487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789131027.470072:0:6487:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4a00/0xf3fe2838e1fc3177 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269cba expref: 67 pid: 6500 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131027.470086:0:6487:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4a00/0xf3fe2838e1fc3177 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269cba expref: 67 pid: 6500 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131027.470109:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4a00/0xf3fe2838e1fc3177 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269cba expref: 67 pid: 6500 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131027.470126:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff91ddca4e4f00) 00010000:00010000:2.0:1789131027.470131:0:6487:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca200/0xf3fe2838e1fc31af lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131027.470153:0:6487:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca200/0xf3fe2838e1fc31af lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131027.470161:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca200/0xf3fe2838e1fc31af lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131027.470321:0:6487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789131027.470379:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff753480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+66:2388:x1876039498308992:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 329us (1867us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131027.470387:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 109 00010000:00010000:1.0:1789131027.470753:0:9769:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca200/0xf3fe2838e1fc31af lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131027.470771:0:9769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca200/0xf3fe2838e1fc31af lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789131027.470801:0:9769:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:1.0:1789131027.470936:0:9769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cac00/0xf3fe2838e1fc31a8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269ccf expref: 67 pid: 9769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131027.470955:0:9769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca200/0xf3fe2838e1fc31af lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269ccf expref: 66 pid: 9769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131027.470963:0:9769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff91ddca4e4f00) 00010000:00010000:1.0:1789131027.470966:0:9769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789131027.470969:0:9769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dcc85ca200, rc 0) 00000100:00100000:1.0:1789131027.471009:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff753c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+66:12722:x1876039498308864:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 24398us (27551us total) trans 4294967504 rc 0/0 00000100:00100000:1.0:1789131027.471017:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 229 00000100:00100000:3.0:1789131027.483633:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131027.483704:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498309248 00000100:00100000:0.0:1789131027.483713:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498309248 00000100:00100000:0.0:1789131027.483787:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 20 00000100:00100000:0.0:1789131027.483798:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff750000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+66:12722:x1876039498309248:12345-192.168.203.11@tcp:103:lfs.0 00010000:00010000:0.0:1789131027.483813:0:6485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789131027.483907:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6a00/0xf3fe2838e1fc3100 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269c9e expref: 66 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131027.483926:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff91ddca4e4f00) 00010000:00010000:0.0:1789131027.483931:0:6485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789131027.483988:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff750000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+65:12722:x1876039498309248:12345-192.168.203.11@tcp:103:lfs.0 Request processed in 192us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131027.483996:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 20 00000100:00100000:3.0:1789131027.503370:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131027.503498:0:14851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498309376 00000100:00100000:0.0:1789131027.503509:0:14851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498309376 00000100:00100000:0.0:1789131027.503566:0:14851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 230 00000100:00100000:0.0:1789131027.503576:0:14851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff752580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+65:12722:x1876039498309376:12345-192.168.203.11@tcp:58:lfs.0 00010000:00010000:0.0:1789131027.503692:0:14851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6a00/0xf3fe2838e1fc31bd lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131027.503710:0:14851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6a00/0xf3fe2838e1fc31bd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131027.503722:0:14851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6a00/0xf3fe2838e1fc31bd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789131027.503839:0:14851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:0.0:1789131027.503922:0:14851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff752580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+65:12722:x1876039498309376:12345-192.168.203.11@tcp:58:lfs.0 Request processed in 346us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131027.503930:0:14851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 230 00000100:00100000:3.0:1789131027.517204:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131027.517505:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498309504 00000100:00100000:0.0:1789131027.517515:0:14273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498309504 00000100:00100000:0.0:1789131027.517580:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 231 00000100:00100000:0.0:1789131027.517590:0:14273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff752940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+65:12722:x1876039498309504:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:0.0:1789131027.517609:0:14273:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789131027.517628:0:14273:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6e00/0xf3fe2838e1fc31c4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269cd6 expref: -99 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131027.517679:0:14273:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6a00/0xf3fe2838e1fc31bd lrc: 2/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131027.517691:0:14273:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6e00/0xf3fe2838e1fc31c4 lrc: 4/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269cd6 expref: 66 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131027.517709:0:14273:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6a00/0xf3fe2838e1fc31bd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131027.517738:0:14273:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6e00/0xf3fe2838e1fc31c4 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269cd6 expref: 66 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131027.517752:0:14273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff91ddca4e4f00) 00010000:00010000:0.0:1789131027.517755:0:14273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789131027.517770:0:14273:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6e00/0xf3fe2838e1fc31c4 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269cd6 expref: 66 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131027.517779:0:14273:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91de01ad6e00, rc 0) 00000100:00100000:0.0:1789131027.517904:0:14273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff752940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+66:12722:x1876039498309504:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 314us (710us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131027.517912:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 231 00000040:00080000:0.0:1789131027.859176:0:14475:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789131027.859185:0:14475:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789131027.859209:0:14475:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:0.0:1789131027.859217:0:14475:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789131027.859342:0:14475:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7d99680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14475:1876039508855680:192.168.203.11@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789131027.859860:0:14475:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddc7cf09c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789131027.864790:0:14475:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7d99680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14475:1876039508855680:192.168.203.11@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789131027.873373:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131027.874080:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498309632 00000100:00100000:2.0:1789131027.874090:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498309632 00000100:00100000:2.0:1789131027.874153:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 232 00000100:00100000:2.0:1789131027.874163:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff750780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+66:12723:x1876039498309632:12345-192.168.203.11@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789131027.874193:0:6500:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789131027.874299:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff750780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+66:12723:x1876039498309632:12345-192.168.203.11@tcp:53:lhsmtool_posix.0 Request processed in 136us (935us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131027.874306:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 232 00000100:00100000:3.0:1789131027.880431:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131027.881115:0:14851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498309760 00000100:00100000:0.0:1789131027.881126:0:14851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498309760 00000100:00100000:0.0:1789131027.881188:0:14851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 233 00000100:00100000:0.0:1789131027.881198:0:14851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8609680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+66:12723:x1876039498309760:12345-192.168.203.11@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1789131027.881267:0:14851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7e00/0xf3fe2838e1fc31cb lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131027.881301:0:14851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7e00/0xf3fe2838e1fc31cb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131027.881312:0:14851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7e00/0xf3fe2838e1fc31cb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131027.881328:0:14851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6400/0xf3fe2838e1fc31d2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131027.881335:0:14851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6400/0xf3fe2838e1fc31d2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131027.881341:0:14851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6400/0xf3fe2838e1fc31d2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131027.881364:0:14851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7800/0xf3fe2838e1fc31d9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131027.881373:0:14851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7800/0xf3fe2838e1fc31d9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131027.881379:0:14851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7800/0xf3fe2838e1fc31d9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789131027.881420:0:14851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:0.0:1789131027.881425:0:14851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789131027.881436:0:14851:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7800/0xf3fe2838e1fc31d9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131027.881447:0:14851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7e00/0xf3fe2838e1fc31cb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131027.881504:0:14851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7e00/0xf3fe2838e1fc31cb lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131027.881511:0:14851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7e00/0xf3fe2838e1fc31cb lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131027.881518:0:14851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91de01ad7e00 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:0.0:1789131027.881522:0:14851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7e00/0xf3fe2838e1fc31cb lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131027.881530:0:14851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7e00/0xf3fe2838e1fc31cb lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131027.881543:0:14851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff91ddcf5ffa00) 00010000:00010000:0.0:1789131027.881546:0:14851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789131027.881550:0:14851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7e00/0xf3fe2838e1fc31cb lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131027.881557:0:14851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7e00/0xf3fe2838e1fc31cb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131027.881567:0:14851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6400/0xf3fe2838e1fc31d2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131027.881572:0:14851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6400/0xf3fe2838e1fc31d2 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131027.881577:0:14851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6400/0xf3fe2838e1fc31d2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131027.881582:0:14851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91de01ad6400 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:0.0:1789131027.881590:0:14851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6400/0xf3fe2838e1fc31d2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131027.881598:0:14851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6400/0xf3fe2838e1fc31d2 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131027.881607:0:14851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x69d7fe76 (ffff91ddca4e4800) 00010000:00010000:0.0:1789131027.881610:0:14851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789131027.881613:0:14851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6400/0xf3fe2838e1fc31d2 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131027.881619:0:14851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6400/0xf3fe2838e1fc31d2 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131027.881635:0:14851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7800/0xf3fe2838e1fc31d9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131027.881641:0:14851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7800/0xf3fe2838e1fc31d9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131027.881646:0:14851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7800/0xf3fe2838e1fc31d9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131027.881651:0:14851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91de01ad7800 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:0.0:1789131027.881653:0:14851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7800/0xf3fe2838e1fc31d9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131027.881658:0:14851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7800/0xf3fe2838e1fc31d9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131027.881665:0:14851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff91ddca4e4f00) 00010000:00010000:0.0:1789131027.881667:0:14851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789131027.881676:0:14851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7800/0xf3fe2838e1fc31d9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131027.881682:0:14851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7800/0xf3fe2838e1fc31d9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131027.881766:0:14851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8609680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+66:12723:x1876039498309760:12345-192.168.203.11@tcp:34:lhsmtool_posix.0 Request processed in 557us (1333us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131027.881776:0:14851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 233 00000100:00100000:3.0:1789131027.894018:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131027.894118:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498310016 00000100:00100000:0.0:1789131027.894127:0:14273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498310016 00000100:00100000:0.0:1789131027.894193:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 234 00000100:00100000:0.0:1789131027.894203:0:14273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8608b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+66:12723:x1876039498310016:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789131027.894223:0:14273:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789131027.894240:0:14273:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7800/0xf3fe2838e1fc31e0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269cdd expref: -99 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131027.894336:0:14273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6400/0xf3fe2838e1fc31e7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131027.894351:0:14273:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6400/0xf3fe2838e1fc31e7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131027.894363:0:14273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6400/0xf3fe2838e1fc31e7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789131027.894387:0:14273:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:0.0:1789131027.894509:0:14273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6400/0xf3fe2838e1fc31e7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131027.894517:0:14273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6400/0xf3fe2838e1fc31e7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131027.894538:0:14273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6400/0xf3fe2838e1fc31e7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131027.894544:0:14273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91de01ad6400 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:0.0:1789131027.894548:0:14273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6400/0xf3fe2838e1fc31e7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131027.894556:0:14273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6400/0xf3fe2838e1fc31e7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131027.894569:0:14273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff91ddca4e4f00) 00010000:00010000:0.0:1789131027.894572:0:14273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789131027.894577:0:14273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6400/0xf3fe2838e1fc31e7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131027.894584:0:14273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6400/0xf3fe2838e1fc31e7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131027.894623:0:14273:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7800/0xf3fe2838e1fc31e0 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269cdd expref: 68 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131027.894640:0:14273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff91ddcf5ffa00) 00010000:00010000:0.0:1789131027.894643:0:14273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789131027.894647:0:14273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7800/0xf3fe2838e1fc31e0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269cdd expref: 68 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131027.894656:0:14273:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91de01ad7800, rc 0) 00000100:00100000:0.0:1789131027.894714:0:14273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8608b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+67:12723:x1876039498310016:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 513us (705us total) trans 4294967505 rc 301/301 00000100:00100000:0.0:1789131027.894729:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 234 00000100:00100000:0.0:1789131027.904306:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789131027.904405:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498310144 00000100:00100000:1.0:1789131027.904415:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498310144 00000100:00100000:1.0:1789131027.904496:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 235 00000100:00100000:1.0:1789131027.904506:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7d99680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+67:12723:x1876039498310144:12345-192.168.203.11@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789131027.904540:0:9769:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789131027.904666:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7d99680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+67:12723:x1876039498310144:12345-192.168.203.11@tcp:53:lhsmtool_posix.0 Request processed in 161us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131027.904674:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 235 00000100:00100000:3.0:1789131027.926171:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131027.926377:0:14851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498310400 00000100:00100000:0.0:1789131027.926386:0:14851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498310400 00000100:00100000:0.0:1789131027.926450:0:14851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 236 00000100:00100000:0.0:1789131027.926497:0:14851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc860b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+67:12723:x1876039498310400:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789131027.926517:0:14851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789131027.926520:0:14851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789131027.926548:0:14851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7400/0xf3fe2838e1fc3185 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269cc1 expref: 67 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131027.926567:0:14851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff91dcc7d6bf00) 00010000:00010000:0.0:1789131027.926573:0:14851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789131027.926605:0:14851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7800/0xf3fe2838e1fc31f5 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269ce4 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789131027.926987:0:14851:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x6:0x0], index 1: 0 00010000:00010000:0.0:1789131027.927128:0:14851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6400/0xf3fe2838e1fc31fc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131027.927142:0:14851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6400/0xf3fe2838e1fc31fc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131027.927151:0:14851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6400/0xf3fe2838e1fc31fc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131027.927197:0:14851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7800/0xf3fe2838e1fc31f5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269ce4 expref: 69 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131027.927236:0:14851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6400/0xf3fe2838e1fc31fc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269ce4 expref: 68 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131027.927244:0:14851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff91ddca4e4800) 00010000:00010000:0.0:1789131027.927246:0:14851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789131027.927249:0:14851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91de01ad6400, rc 0) 00000100:00100000:0.0:1789131027.927314:0:14851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc860b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+68:12723:x1876039498310400:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 854us (1152us total) trans 4294967506 rc 0/0 00000100:00100000:0.0:1789131027.927322:0:14851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 236 00000100:00100000:3.0:1789131027.942045:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131027.942190:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498310656 00000100:00100000:0.0:1789131027.942199:0:14273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498310656 00000100:00100000:0.0:1789131027.942261:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 237 00000100:00100000:0.0:1789131027.942270:0:14273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8609e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+68:12723:x1876039498310656:12345-192.168.203.11@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789131027.942318:0:14273:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789131027.942341:0:14273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6400/0xf3fe2838e1fc31fc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269ce4 expref: 68 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131027.942360:0:14273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff91ddca4e4800) 00010000:00010000:0.0:1789131027.942369:0:14273:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789131027.942387:0:14273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7800/0xf3fe2838e1fc320a lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131027.942399:0:14273:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7800/0xf3fe2838e1fc320a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131027.942407:0:14273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7800/0xf3fe2838e1fc320a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131027.942439:0:14273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7400/0xf3fe2838e1fc3211 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0xbc7946e1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131027.942446:0:14273:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7400/0xf3fe2838e1fc3211 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xbc7946e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131027.942505:0:14273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7400/0xf3fe2838e1fc3211 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xbc7946e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131027.942558:0:14273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7800/0xf3fe2838e1fc320a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131027.942566:0:14273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7800/0xf3fe2838e1fc320a lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131027.942573:0:14273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7800/0xf3fe2838e1fc320a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131027.942579:0:14273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91de01ad7800 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:0.0:1789131027.942583:0:14273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7800/0xf3fe2838e1fc320a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131027.942590:0:14273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7800/0xf3fe2838e1fc320a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131027.942597:0:14273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff91dcc7d6bf00) 00010000:00010000:0.0:1789131027.942599:0:14273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789131027.942603:0:14273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7800/0xf3fe2838e1fc320a lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131027.942610:0:14273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7800/0xf3fe2838e1fc320a lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131027.942627:0:14273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7400/0xf3fe2838e1fc3211 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xbc7946e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131027.942633:0:14273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7400/0xf3fe2838e1fc3211 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xbc7946e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131027.942638:0:14273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7400/0xf3fe2838e1fc3211 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xbc7946e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131027.942643:0:14273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91de01ad7400 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:0.0:1789131027.942646:0:14273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7400/0xf3fe2838e1fc3211 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xbc7946e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131027.942653:0:14273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7400/0xf3fe2838e1fc3211 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xbc7946e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131027.942660:0:14273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0xbc7946e1 (ffff91ddca4e4e00) 00010000:00010000:0.0:1789131027.942663:0:14273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789131027.942665:0:14273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7400/0xf3fe2838e1fc3211 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xbc7946e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131027.942671:0:14273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7400/0xf3fe2838e1fc3211 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xbc7946e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131027.942742:0:14273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8609e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+67:12723:x1876039498310656:12345-192.168.203.11@tcp:36:lhsmtool_posix.0 Request processed in 473us (705us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789131027.942750:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 237 00000100:00100000:3.0:1789131027.947378:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131027.947689:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498310784 00000100:00100000:2.0:1789131027.947699:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498310784 00000100:00100000:2.0:1789131027.947746:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 238 00000100:00100000:2.0:1789131027.947766:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc860ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+67:12723:x1876039498310784:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789131027.947784:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789131027.947805:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e600/0xf3fe2838e1fc3218 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269ceb expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131027.947851:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e200/0xf3fe2838e1fc321f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131027.947885:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e200/0xf3fe2838e1fc321f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131027.947896:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e200/0xf3fe2838e1fc321f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131027.947999:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e600/0xf3fe2838e1fc3218 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269ceb expref: 69 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131027.948017:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e200/0xf3fe2838e1fc321f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269ceb expref: 68 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131027.948025:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff91dde1922200) 00010000:00010000:2.0:1789131027.948028:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789131027.948031:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dcc7f7e200, rc 0) 00000100:00100000:2.0:1789131027.948089:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc860ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+68:12723:x1876039498310784:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 335us (720us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131027.948097:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 238 00000100:00100000:1.0:1789131027.956117:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131027.956195:0:14851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498311040 00000100:00100000:0.0:1789131027.956205:0:14851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498311040 00000100:00100000:0.0:1789131027.956261:0:14851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 239 00000100:00100000:0.0:1789131027.956285:0:14851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd1dae940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+68:12723:x1876039498311040:12345-192.168.203.11@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789131027.956366:0:14851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7400/0xf3fe2838e1fc3226 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131027.956381:0:14851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7400/0xf3fe2838e1fc3226 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131027.956391:0:14851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7400/0xf3fe2838e1fc3226 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789131027.956576:0:14851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00080000:0.0:1789131027.956586:0:14851:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 383874126593ns, next at 384874123288ns, rc = 0 00000004:00010000:0.0:1789131027.956631:0:14851:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000a00eaeb0 reply state 00000000c7f2346d transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7400/0xf3fe2838e1fc3226 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131027.956644:0:14851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7400/0xf3fe2838e1fc3226 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131027.956652:0:14851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff91dde1922200) 00010000:00010000:0.0:1789131027.956655:0:14851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1789131027.956659:0:14851:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789131027.956747:0:14851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd1dae940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+70:12723:x1876039498311040:12345-192.168.203.11@tcp:36:lhsmtool_posix.0 Request processed in 464us (638us total) trans 4294967507 rc 0/0 00000100:00100000:0.0:1789131027.956766:0:14851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 239 00000100:00100000:3.0:1789131027.964819:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131027.964921:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498311168 00000100:00100000:2.0:1789131027.964931:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498311168 00000100:00100000:2.0:1789131027.964991:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 240 00000100:00100000:2.0:1789131027.965001:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc860bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+70:12723:x1876039498311168:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789131027.965026:0:6502:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789131027.965046:0:6502:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e600/0xf3fe2838e1fc322d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269cf2 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131027.965099:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e600/0xf3fe2838e1fc322d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269cf2 expref: 71 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131027.965131:0:6502:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e600/0xf3fe2838e1fc322d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269cf2 expref: 71 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131027.965150:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff91dde1922200) 00010000:00010000:2.0:1789131027.965154:0:6502:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789131027.965157:0:6502:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dcc7f7e600, rc 0) 00000100:00100000:2.0:1789131027.965217:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc860bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+71:12723:x1876039498311168:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 217us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131027.965225:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 240 00000100:00100000:3.0:1789131027.968765:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131027.969388:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498311296 00000100:00100000:0.0:1789131027.969397:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498311296 00000100:00100000:0.0:1789131027.969525:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 71 00000100:00100000:0.0:1789131027.969536:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc860a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+9:2387:x1876039498311296:12345-192.168.203.11@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1789131027.969738:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc860a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+10:2387:x1876039498311296:12345-192.168.203.11@tcp:2:lhsmtool_posix.0 Request processed in 203us (991us total) trans 4294967320 rc 0/0 00000100:00100000:0.0:1789131027.969764:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 71 00000100:00080000:3.0:1789131027.970042:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789131027.974899:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131027.974990:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498311552 00000100:00100000:3.0:1789131027.974998:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498311552 00000100:00100000:3.0:1789131027.975052:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 60 00000100:00100000:3.0:1789131027.975063:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd1dae580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+71:12723:x1876039498311552:12345-192.168.203.11@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789131027.975281:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd1dae580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+72:12723:x1876039498311552:12345-192.168.203.11@tcp:35:lhsmtool_posix.0 Request processed in 219us (390us total) trans 4294967508 rc 0/0 00000100:00100000:3.0:1789131027.975289:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 60 00000100:00100000:1.0:1789131027.979553:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131027.979650:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498311808 00000100:00100000:2.0:1789131027.979659:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498311808 00000100:00100000:2.0:1789131027.979718:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 241 00000100:00100000:2.0:1789131027.979738:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd1dae1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+72:12723:x1876039498311808:12345-192.168.203.11@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789131027.979856:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd1dae1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+72:12723:x1876039498311808:12345-192.168.203.11@tcp:57:lhsmtool_posix.0 Request processed in 128us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131027.979864:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 241 00000100:00100000:0.0:1789131027.984329:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131027.984526:0:14851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498311936 00000100:00100000:2.0:1789131027.984536:0:14851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498311936 00000100:00100000:2.0:1789131027.984594:0:14851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 242 00000100:00100000:2.0:1789131027.984605:0:14851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7d9a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+72:12723:x1876039498311936:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789131027.984625:0:14851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789131027.984646:0:14851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fc00/0xf3fe2838e1fc3234 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269cf9 expref: -99 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131027.984713:0:14851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e400/0xf3fe2838e1fc323b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131027.984741:0:14851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e400/0xf3fe2838e1fc323b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131027.984752:0:14851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e400/0xf3fe2838e1fc323b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789131027.984806:0:14851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789131027.984825:0:14851:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e400/0xf3fe2838e1fc323b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131027.984851:0:14851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fc00/0xf3fe2838e1fc3234 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269cf9 expref: 74 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131027.984869:0:14851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e400/0xf3fe2838e1fc323b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269cf9 expref: 73 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131027.984877:0:14851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff91dde1922200) 00010000:00010000:2.0:1789131027.984880:0:14851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789131027.984883:0:14851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dcc7f7e400, rc 0) 00000100:00100000:2.0:1789131027.985042:0:14851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7d9a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+73:12723:x1876039498311936:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 439us (723us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131027.985050:0:14851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 242 00000100:00100000:3.0:1789131027.989221:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131027.989376:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498312064 00000100:00100000:2.0:1789131027.989386:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498312064 00000100:00100000:2.0:1789131027.989451:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 72 00000100:00100000:2.0:1789131027.989497:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8608780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+10:2388:x1876039498312064:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789131027.989514:0:8417:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789131027.989547:0:8417:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f1c0ed47/0xf3fe2838e1fc3242 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269d00 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789131027.989572:0:8417:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa3f913, blocks: 0x0 00010000:00010000:2.0:1789131027.989590:0:8417:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=383s v=(0 0) 00010000:00010000:2.0:1789131027.989595:0:8417:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789131027.989604:0:8417:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f1c0ed47/0xf3fe2838e1fc3242 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269d00 expref: 11 pid: 8417 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131027.989621:0:8417:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f1c0ed47/0xf3fe2838e1fc3242 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269d00 expref: 11 pid: 8417 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131027.989634:0:8417:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dcc7f7ea00, rc 0) 00000100:00100000:2.0:1789131027.989679:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8608780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+11:2388:x1876039498312064:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 220us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131027.989686:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 72 00000100:00100000:2.0:1789131027.993246:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131027.993432:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498312320 00000100:00100000:0.0:1789131027.993441:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498312320 00000100:00100000:0.0:1789131027.993525:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 243 00000100:00100000:0.0:1789131027.993536:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd286b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+73:12723:x1876039498312320:12345-192.168.203.11@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789131027.993634:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd286b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+73:12723:x1876039498312320:12345-192.168.203.11@tcp:57:lhsmtool_posix.0 Request processed in 99us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131027.993642:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 243 00000100:00100000:0.0:1789131027.997296:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131027.997433:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498312448 00000100:00100000:3.0:1789131027.997442:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498312448 00000100:00100000:3.0:1789131027.997526:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 73 00000100:00100000:3.0:1789131027.997535:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7d983c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+11:12723:x1876039498312448:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789131027.997552:0:8414:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789131027.997567:0:8414:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bc148169/0xf3fe2838e1fc3249 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269d07 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131027.997596:0:8414:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f1c0ed47/0xf3fe2838e1fc3242 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269d00 expref: 12 pid: 8417 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131027.997605:0:8414:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789131027.997610:0:8414:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789131027.997614:0:8414:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bc148169/0xf3fe2838e1fc3249 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269d07 expref: 12 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131027.997645:0:8414:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f1c0ed47/0xf3fe2838e1fc3242 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269d00 expref: 12 pid: 8417 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131027.997677:0:8414:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f1c0ed47/0xf3fe2838e1fc3242 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269d00 expref: 12 pid: 8417 timeout: 483 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131027.997691:0:8414:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc860b0c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8414:1876039508855808:192.168.203.11@tcp:104: 00000100:00100000:3.0:1789131027.997782:0:8414:0:(client.c:2715:ptlrpc_set_wait()) set ffff91de01a87d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789131028.011736:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131028.011842:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498312576 00000100:00100000:0.0:1789131028.011851:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498312576 00010000:00010000:0.0:1789131028.011890:0:6486:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f1c0ed47/0xf3fe2838e1fc3242 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269d00 expref: 13 pid: 8417 timeout: 483 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131028.011936:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 110 00000100:00100000:0.0:1789131028.011946:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd1dad2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+13:2387:x1876039498312576:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789131028.011958:0:6486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789131028.011991:0:6486:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f1c0ed47/0xf3fe2838e1fc3242 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269d00 expref: 13 pid: 8417 timeout: 483 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131028.012005:0:6486:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f1c0ed47/0xf3fe2838e1fc3242 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269d00 expref: 13 pid: 8417 timeout: 483 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131028.012032:0:6486:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789131028.012050:0:6486:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789131028.012059:0:6486:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bc148169/0xf3fe2838e1fc3249 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269d07 expref: 13 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131028.012069:0:6486:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bc148169/0xf3fe2838e1fc3249 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269d07 expref: 13 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131028.012110:0:6486:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000bc148169/0xf3fe2838e1fc3249 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269d07 expref: 13 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131028.012122:0:6486:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7d9b840 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6486:1876039508855936:192.168.203.11@tcp:105: 00000100:00100000:0.0:1789131028.012206:0:6486:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddc7cf09c0 going to sleep for 11 seconds 00010000:00010000:3.0:1789131028.012352:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f1c0ed47/0xf3fe2838e1fc3242 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269d00 expref: 13 pid: 8417 timeout: 483 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131028.012366:0:8414:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc860b0c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8414:1876039508855808:192.168.203.11@tcp:104: 00010000:00010000:3.0:1789131028.012387:0:8414:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000bc148169/0xf3fe2838e1fc3249 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269d07 expref: 12 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131028.012398:0:8414:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ddfd0b4600, rc 0) 00000100:00100000:3.0:1789131028.012427:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7d983c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+12:12723:x1876039498312448:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 14893us (15139us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131028.012435:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 73 00000100:00100000:2.0:1789131028.016987:0:6486:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7d9b840 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6486:1876039508855936:192.168.203.11@tcp:105: 00010000:00010000:2.0:1789131028.017015:0:6486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789131028.017074:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd1dad2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+11:2387:x1876039498312576:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 5129us (5347us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131028.017085:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 110 00000100:00100000:1.0:1789131028.028448:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131028.028687:0:8421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498312704 00000100:00100000:2.0:1789131028.028696:0:8421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498312704 00002000:00100000:2.0:1789131028.028746:0:8421:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x6:0x0] (0->12) req@ffff91ddd1dacb40 x1876039498312704/t0(0) o4->b99c111d-b9b6-4590-88e4-9fefd4d4c3a4@192.168.203.11@tcp:744/0 lens 504/0 e 0 to 0 dl 1789131039 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789131028.028779:0:8421:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff91ddd1dacb40 with x1876039498312704 ext(0->12) 00002000:00010000:2.0:1789131028.028786:0:8421:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91ddd1dacb40 00000100:00100000:2.0:1789131028.028817:0:8421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 7 00000100:00100000:2.0:1789131028.028826:0:8421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd1dacb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+11:2387:x1876039498312704:12345-192.168.203.11@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1789131028.029800:0:8421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd1dacb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+13:2387:x1876039498312704:12345-192.168.203.11@tcp:4:lhsmtool_posix.0 Request processed in 970us (1358us total) trans 4294967321 rc 0/0 00000100:00100000:2.0:1789131028.029810:0:8421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 7 00002000:00100000:2.0:1789131028.029818:0:8421:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x6:0x0] (0->12) req@ffff91ddd1dacb40 x1876039498312704/t4294967321(0) o4->b99c111d-b9b6-4590-88e4-9fefd4d4c3a4@192.168.203.11@tcp:744/0 lens 504/448 e 0 to 0 dl 1789131039 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789131028.029826:0:8421:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff91ddd1dacb40 with x1876039498312704 ext(0->12) 00002000:00010000:2.0:1789131028.029829:0:8421:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91ddd1dacb40 00000100:00100000:1.0:1789131028.038058:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131028.043244:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498312832 00000100:00100000:2.0:1789131028.043258:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498312832 00000100:00100000:2.0:1789131028.045861:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 244 00000100:00100000:2.0:1789131028.045879:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd1dfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+73:12723:x1876039498312832:12345-192.168.203.11@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1789131028.049032:0:6479:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967508 is committed 00000004:00080000:0.0:1789131028.049054:0:6479:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00010000:00010000:2.0:1789131028.049157:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc2f4e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131028.049172:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc2f4e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131028.049181:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc2f4e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131028.049188:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddfd0b5a00 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:2.0:1789131028.049207:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc2f4e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131028.049218:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc2f4e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131028.049239:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff91dcc7d6b900) 00010000:00010000:2.0:1789131028.049242:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789131028.049248:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc2f4e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131028.049255:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5a00/0xf3fe2838e1fc2f4e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131028.049290:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cae00/0xf3fe2838e1fc2ff6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131028.049296:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cae00/0xf3fe2838e1fc2ff6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131028.049302:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cae00/0xf3fe2838e1fc2ff6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131028.049308:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc85cae00 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:2.0:1789131028.049311:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cae00/0xf3fe2838e1fc2ff6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131028.049317:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cae00/0xf3fe2838e1fc2ff6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131028.049323:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff91dded3a2000) 00010000:00010000:2.0:1789131028.049325:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789131028.049343:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cae00/0xf3fe2838e1fc2ff6 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131028.049349:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cae00/0xf3fe2838e1fc2ff6 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131028.049370:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7c00/0xf3fe2838e1fc3074 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131028.049376:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7c00/0xf3fe2838e1fc3074 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131028.049382:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7c00/0xf3fe2838e1fc3074 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131028.049388:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91de01ad7c00 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:2.0:1789131028.049390:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7c00/0xf3fe2838e1fc3074 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131028.049396:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7c00/0xf3fe2838e1fc3074 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131028.049404:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff91ddca4e4700) 00010000:00010000:2.0:1789131028.049406:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789131028.049409:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7c00/0xf3fe2838e1fc3074 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131028.049415:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7c00/0xf3fe2838e1fc3074 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131028.049426:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca000/0xf3fe2838e1fc3097 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131028.049440:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca000/0xf3fe2838e1fc3097 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131028.049446:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca000/0xf3fe2838e1fc3097 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131028.049450:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc85ca000 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:2.0:1789131028.049453:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca000/0xf3fe2838e1fc3097 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131028.049527:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca000/0xf3fe2838e1fc3097 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131028.049535:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff91ddca4e4700) 00010000:00010000:2.0:1789131028.049537:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789131028.049540:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca000/0xf3fe2838e1fc3097 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131028.049545:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca000/0xf3fe2838e1fc3097 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131028.049722:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e800/0xf3fe2838e1fc3169 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131028.049730:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e800/0xf3fe2838e1fc3169 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131028.049737:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e800/0xf3fe2838e1fc3169 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131028.049742:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc7f7e800 already unused, calling callback (ffffffffc185c4f0) 00000100:00080000:3.0:1789131028.049745:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789131028.049767:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e800/0xf3fe2838e1fc3169 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131028.049775:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e800/0xf3fe2838e1fc3169 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131028.049786:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff91ddca4e4f00) 00010000:00010000:2.0:1789131028.049789:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789131028.049792:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e800/0xf3fe2838e1fc3169 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131028.049799:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e800/0xf3fe2838e1fc3169 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131028.049814:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7400/0xf3fe2838e1fc3226 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131028.049820:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7400/0xf3fe2838e1fc3226 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131028.049826:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7400/0xf3fe2838e1fc3226 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131028.049831:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91de01ad7400 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:2.0:1789131028.049835:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7400/0xf3fe2838e1fc3226 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131028.049841:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7400/0xf3fe2838e1fc3226 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131028.049848:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff91dde1922200) 00010000:00010000:2.0:1789131028.049850:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789131028.049860:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7400/0xf3fe2838e1fc3226 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131028.049867:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7400/0xf3fe2838e1fc3226 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789131028.050127:0:6479:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000020:00080000:0.0:1789131028.050152:0:6479:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff91ddc33c40c0 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:0.0:1789131028.050156:0:6479:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff91ddff410100 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff91dcc6aad240 00000020:00080000:0.0:1789131028.050160:0:6479:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff91ddd241fa00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff91ddd1db9200 00000004:00080000:0.0:1789131028.050191:0:6479:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000020:00080000:3.0:1789131028.050216:0:6532:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1789131028.050359:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd2869e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1876039508856064:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1789131028.050442:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131028.051274:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508856064 00000100:00100000:2.0:1789131028.051285:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508856064 00000100:00100000:2.0:1789131028.051362:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789131028.051374:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddffc0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3627:x1876039508856064:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1789131028.051406:0:8417:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:5 count 1 00002000:00010000:2.0:1789131028.051444:0:8417:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 9, mtime: 0x6aa3f912, atime: 0x6aa3f912, ctime: 0x6aa3f912, blocks: 0x8 00010000:00010000:2.0:1789131028.051453:0:8417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008df21597/0xf3fe2838e1fc3250 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131028.051485:0:8417:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=383s v=(0 0) 00010000:00010000:2.0:1789131028.051490:0:8417:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789131028.051497:0:8417:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008df21597/0xf3fe2838e1fc3250 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131028.051522:0:8417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008df21597/0xf3fe2838e1fc3250 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131028.051533:0:8417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008df21597/0xf3fe2838e1fc3250 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131028.051541:0:8417:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008df21597/0xf3fe2838e1fc3250 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131028.051583:0:8417:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789131028.051655:0:6488:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789131028.051661:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008df21597/0xf3fe2838e1fc3250 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131028.051669:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc7f7fc00 already unused, calling callback (ffffffffc0c4e550) 00010000:00010000:2.0:1789131028.051673:0:6488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008df21597/0xf3fe2838e1fc3250 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131028.051683:0:6488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008df21597/0xf3fe2838e1fc3250 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131028.051701:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008df21597/0xf3fe2838e1fc3250 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131028.051708:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008df21597/0xf3fe2838e1fc3250 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131028.051729:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131028.051731:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131028.051732:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789131028.052343:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789131028.052899:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789131028.052923:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd1df92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1876039508856192:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1789131028.053075:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd1df83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508856320:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1789131028.053087:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131028.053149:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131028.053228:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508856192 00000100:00100000:3.0:1789131028.053237:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508856192 00000100:00100000:3.0:1789131028.053297:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508856320 00000100:00100000:3.0:1789131028.053301:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508856320 00000100:00100000:3.0:1789131028.053323:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789131028.053334:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc860b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3627:x1876039508856192:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1789131028.053362:0:8414:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:5 count 1 00010000:00010000:3.0:1789131028.053386:0:8414:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4c05e0e/0xf3fe2838e1fc3257 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131028.053407:0:8414:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f8a483ec/0xf3fe2838e1fc3004 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269c5f expref: 12 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131028.053416:0:8414:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1789131028.053420:0:8414:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789131028.053425:0:8414:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4c05e0e/0xf3fe2838e1fc3257 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131028.053475:0:8414:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f8a483ec/0xf3fe2838e1fc3004 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269c5f expref: 12 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131028.053489:0:8414:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f8a483ec/0xf3fe2838e1fc3004 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269c5f expref: 12 pid: 8416 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131028.053501:0:8414:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8609a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8414:1876039508856448:192.168.203.11@tcp:104: 00000100:00100000:3.0:1789131028.053562:0:8414:0:(client.c:2715:ptlrpc_set_wait()) set ffff91de01a87d80 going to sleep for 11 seconds 00000100:00080000:3.0:1789131028.053578:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789131028.053776:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddffc0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:3627:x1876039508856064:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2401us (3330us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1789131028.053803:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789131028.054023:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789131028.054037:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd2868780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3625:x1876039508856320:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1789131028.054157:0:8417:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1789131028.054161:0:8417:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb mtime from disk: 0 -> 1789131027 00000004:00080000:3.0:1789131028.054163:0:3627:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff91ddd2869e00/2, rc 0, transno 4294967311 00002000:00010000:2.0:1789131028.054165:0:8417:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789131028.054174:0:8417:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb ctime from disk: 1789131027 -> 1789131027 00000100:00100000:3.0:1789131028.054179:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd2869e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1876039508856064:0@lo:6:osp-syn-0-0.0 00002000:00010000:2.0:1789131028.054180:0:8417:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:2.0:1789131028.054244:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd2868780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3625:x1876039508856320:12345-0@lo:2:osp-syn-1-0.0 Request processed in 210us (1096us total) trans 4294967322 rc 0/0 00000100:00100000:2.0:1789131028.054251:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000004:00080000:2.0:1789131028.054661:0:3625:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff91ddd1df83c0/2, rc 0, transno 4294967322 00000100:00100000:2.0:1789131028.054668:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd1df83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508856320:0@lo:2:osp-syn-1-0.0 00000020:00080000:0.0:1789131028.054882:0:6479:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff91ddc4e080c0 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:0.0:1789131028.054888:0:6479:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff91ddff894400 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff91ddc4e089c0 00000020:00080000:0.0:1789131028.054892:0:6479:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff91ddff894300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff91dcc6db0a00 00000100:00100000:1.0:1789131028.055135:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd1dfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+21:12723:x1876039498312832:12345-192.168.203.11@tcp:44:lhsmtool_posix.0 Request processed in 9259us (17082us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131028.055146:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 244 00000001:00080000:0.0:1789131028.055285:0:8410:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:0.0:1789131028.055294:0:8410:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000020:00080000:2.0:1789131028.055677:0:6532:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:2.0:1789131028.055738:0:6532:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:1.0:1789131028.061640:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131028.061866:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498312960 00000100:00100000:0.0:1789131028.061885:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498312960 00010000:00010000:0.0:1789131028.061966:0:6485:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f8a483ec/0xf3fe2838e1fc3004 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269c5f expref: 13 pid: 8416 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131028.062629:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 111 00000100:00100000:0.0:1789131028.062648:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc33a9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+13:2388:x1876039498312960:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789131028.062672:0:6485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789131028.062679:0:6485:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f8a483ec/0xf3fe2838e1fc3004 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269c5f expref: 13 pid: 8416 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131028.062699:0:6485:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f8a483ec/0xf3fe2838e1fc3004 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269c5f expref: 13 pid: 8416 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131028.062740:0:6485:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789131028.062747:0:6485:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789131028.062764:0:6485:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b4c05e0e/0xf3fe2838e1fc3257 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131028.062777:0:6485:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4c05e0e/0xf3fe2838e1fc3257 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131028.062808:0:6485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789131028.062919:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc33a9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+13:2388:x1876039498312960:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 279us (1287us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131028.062928:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 111 00010000:00010000:3.0:1789131028.067236:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f8a483ec/0xf3fe2838e1fc3004 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269c5f expref: 12 pid: 8416 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131028.067261:0:8414:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8609a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8414:1876039508856448:192.168.203.11@tcp:104: 00010000:00010000:3.0:1789131028.067284:0:8414:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b4c05e0e/0xf3fe2838e1fc3257 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131028.067297:0:8414:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b4c05e0e/0xf3fe2838e1fc3257 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131028.067305:0:8414:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b4c05e0e/0xf3fe2838e1fc3257 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131028.067318:0:8414:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4c05e0e/0xf3fe2838e1fc3257 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131028.067327:0:8414:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b4c05e0e/0xf3fe2838e1fc3257 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131028.067350:0:8414:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789131028.067454:0:7442:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789131028.067505:0:7442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b4c05e0e/0xf3fe2838e1fc3257 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131028.067519:0:7442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddfd0b5400 already unused, calling callback (ffffffffc0c4e550) 00010000:00010000:1.0:1789131028.067525:0:7442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4c05e0e/0xf3fe2838e1fc3257 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131028.067537:0:7442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4c05e0e/0xf3fe2838e1fc3257 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131028.067567:0:7442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b4c05e0e/0xf3fe2838e1fc3257 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131028.067574:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4c05e0e/0xf3fe2838e1fc3257 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131028.067604:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789131028.067606:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789131028.067608:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789131028.067872:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789131028.067957:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498313088 00000100:00100000:1.0:1789131028.067967:0:9827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498313088 00000100:00100000:1.0:1789131028.068066:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 77 00000100:00100000:3.0:1789131028.068108:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc860b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3627:x1876039508856192:12345-0@lo:6:osp-syn-1-0.0 Request processed in 14771us (15093us total) trans 4294967323 rc 0/0 00000100:00100000:1.0:1789131028.068111:0:9827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7d9ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+12:2388:x1876039498313088:12345-192.168.203.11@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1789131028.068132:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000004:00080000:0.0:1789131028.068353:0:3627:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff91ddd1df92c0/2, rc 0, transno 4294967323 00000100:00100000:0.0:1789131028.068374:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd1df92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1876039508856192:0@lo:6:osp-syn-1-0.0 00000001:00080000:0.0:1789131028.075037:0:9493:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00000001:00080000:0.0:1789131028.075061:0:9493:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000100:00100000:3.0:1789131028.075307:0:9827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7d9ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+7:2388:x1876039498313088:12345-192.168.203.11@tcp:16:lhsmtool_posix.0 Request processed in 7193us (7430us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131028.075322:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 77 00000100:00100000:1.0:1789131028.081268:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131028.081802:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498313344 00000100:00100000:3.0:1789131028.081816:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498313344 00000100:00100000:3.0:1789131028.081944:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 245 00000100:00100000:3.0:1789131028.081955:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd1dfa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+21:12723:x1876039498313344:12345-192.168.203.11@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789131028.082023:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789131028.082055:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e400/0xf3fe2838e1fc323b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269cf9 expref: 21 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131028.082081:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff91dde1922200) 00010000:00010000:3.0:1789131028.082087:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789131028.082131:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5800/0xf3fe2838e1fc325e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131028.082149:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5800/0xf3fe2838e1fc325e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131028.082161:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5800/0xf3fe2838e1fc325e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789131028.082346:0:6501:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000bc6fc8d4 reply state 000000007cef41cd transno 4294967509 ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5800/0xf3fe2838e1fc325e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131028.082361:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5800/0xf3fe2838e1fc325e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131028.082367:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff91dde1922200) 00010000:00010000:3.0:1789131028.082371:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789131028.082386:0:6501:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789131028.082574:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd1dfa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+22:12723:x1876039498313344:12345-192.168.203.11@tcp:36:lhsmtool_posix.0 Request processed in 620us (1328us total) trans 4294967509 rc 0/0 00000100:00100000:3.0:1789131028.082583:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 245 00000100:00100000:1.0:1789131028.093999:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131028.094085:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498313472 00000100:00100000:2.0:1789131028.094099:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498313472 00000100:00100000:2.0:1789131028.094165:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 78 00000100:00100000:2.0:1789131028.094176:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd1dfad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+7:2387:x1876039498313472:12345-192.168.203.11@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1789131028.095001:0:8416:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1789131028.095007:0:8416:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb mtime from disk: 1789131027 -> 1789131026 00002000:00010000:2.0:1789131028.095009:0:8416:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb atime from disk: 0 -> 1789131026 00002000:00010000:2.0:1789131028.095011:0:8416:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb ctime from disk: 1789131027 -> 1789131026 00002000:00010000:2.0:1789131028.095013:0:8416:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1789131028.095097:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd1dfad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+8:2387:x1876039498313472:12345-192.168.203.11@tcp:2:lhsmtool_posix.0 Request processed in 921us (1111us total) trans 4294967324 rc 0/0 00000100:00100000:2.0:1789131028.095124:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 78 00000100:00100000:0.0:1789131028.110084:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131028.110377:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498313728 00000100:00100000:2.0:1789131028.110390:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498313728 00000100:00100000:2.0:1789131028.110514:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 246 00000100:00100000:2.0:1789131028.110527:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7d9bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+22:12723:x1876039498313728:12345-192.168.203.11@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1789131028.110766:0:6502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fc00/0xf3fe2838e1fc3265 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131028.110787:0:6502:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e200/0xf3fe2838e1fc321f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269ceb expref: 22 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131028.110798:0:6502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fc00/0xf3fe2838e1fc3265 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131028.110840:0:6502:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e200/0xf3fe2838e1fc321f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269ceb expref: 22 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131028.110857:0:6502:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e200/0xf3fe2838e1fc321f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269ceb expref: 22 pid: 6500 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131028.110872:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd286ad00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6502:1876039508856576:192.168.203.11@tcp:104: 00000100:00100000:2.0:1789131028.111035:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddc4ccf840 going to sleep for 11 seconds 00000100:00100000:3.0:1789131028.115238:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131028.115351:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498313856 00000100:00100000:0.0:1789131028.115363:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498313856 00010000:00010000:0.0:1789131028.115409:0:6487:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e200/0xf3fe2838e1fc321f lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269ceb expref: 23 pid: 6500 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131028.115502:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 112 00000100:00100000:0.0:1789131028.115513:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8609a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+23:2388:x1876039498313856:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789131028.115532:0:6487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789131028.115541:0:6487:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e200/0xf3fe2838e1fc321f lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269ceb expref: 23 pid: 6500 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131028.115556:0:6487:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e200/0xf3fe2838e1fc321f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269ceb expref: 23 pid: 6500 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131028.115586:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff91dde1922200) 00010000:00010000:0.0:1789131028.115592:0:6487:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fc00/0xf3fe2838e1fc3265 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131028.115604:0:6487:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fc00/0xf3fe2838e1fc3265 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131028.115613:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fc00/0xf3fe2838e1fc3265 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131028.115635:0:6487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789131028.115693:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e200/0xf3fe2838e1fc321f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269ceb expref: 23 pid: 6500 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131028.115717:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd286ad00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6502:1876039508856576:192.168.203.11@tcp:104: 00000100:00100000:0.0:1789131028.115726:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8609a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+22:2388:x1876039498313856:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 213us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131028.115741:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 112 00010000:00010000:2.0:1789131028.115950:0:6502:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fc00/0xf3fe2838e1fc3265 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131028.115962:0:6502:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fc00/0xf3fe2838e1fc3265 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131028.115968:0:6502:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fc00/0xf3fe2838e1fc3265 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131028.116014:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fc00/0xf3fe2838e1fc3265 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131028.116020:0:6502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fc00/0xf3fe2838e1fc3265 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131028.116027:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fc00/0xf3fe2838e1fc3265 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131028.116034:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc7f7fc00 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:2.0:1789131028.116040:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fc00/0xf3fe2838e1fc3265 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131028.116048:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fc00/0xf3fe2838e1fc3265 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131028.116058:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff91dde1922200) 00010000:00010000:2.0:1789131028.116061:0:6502:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1789131028.116065:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fc00/0xf3fe2838e1fc3265 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131028.116072:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fc00/0xf3fe2838e1fc3265 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6502 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131028.116175:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7d9bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+21:12723:x1876039498313728:12345-192.168.203.11@tcp:55:lhsmtool_posix.0 Request processed in 5650us (6106us total) trans 0 rc -22/-22 00000100:00100000:2.0:1789131028.116184:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 246 00000100:00100000:3.0:1789131028.120900:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131028.120991:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498313984 00000100:00100000:0.0:1789131028.121004:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498313984 00000100:00100000:0.0:1789131028.121081:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 79 00000100:00100000:0.0:1789131028.121093:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc860a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+8:2388:x1876039498313984:12345-192.168.203.11@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1789131028.121156:0:8414:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000057b08fdb/0xf3fe2838e1fc326c lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131028.121182:0:8414:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bc148169/0xf3fe2838e1fc3249 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269d07 expref: 8 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131028.121193:0:8414:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x6:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1789131028.121198:0:8414:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789131028.121204:0:8414:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000057b08fdb/0xf3fe2838e1fc326c lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131028.121262:0:8414:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bc148169/0xf3fe2838e1fc3249 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269d07 expref: 8 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131028.121280:0:8414:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bc148169/0xf3fe2838e1fc3249 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269d07 expref: 8 pid: 8414 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131028.121297:0:8414:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7d98b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8414:1876039508856704:192.168.203.11@tcp:104: 00000100:00100000:0.0:1789131028.122909:0:8414:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddc7cf09c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789131028.126884:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131028.126903:0:8414:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7d98b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8414:1876039508856704:192.168.203.11@tcp:104: 00000100:00100000:2.0:1789131028.126939:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498314112 00010000:00010000:3.0:1789131028.126942:0:8414:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000057b08fdb/0xf3fe2838e1fc326c lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131028.126949:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498314112 00010000:00010000:2.0:1789131028.126999:0:8431:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bc148169/0xf3fe2838e1fc3249 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269d07 expref: 9 pid: 8414 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131028.127048:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 113 00000100:00100000:2.0:1789131028.127059:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd1dfbc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+9:2388:x1876039498314112:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789131028.127091:0:8431:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789131028.127120:0:8431:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bc148169/0xf3fe2838e1fc3249 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269d07 expref: 9 pid: 8414 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131028.127134:0:8431:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bc148169/0xf3fe2838e1fc3249 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269d07 expref: 9 pid: 8414 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131028.127165:0:8431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bc148169/0xf3fe2838e1fc3249 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269d07 expref: 9 pid: 8414 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131028.127186:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789131028.127191:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789131028.127198:0:8431:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000057b08fdb/0xf3fe2838e1fc326c lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131028.127661:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000057b08fdb/0xf3fe2838e1fc326c lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131028.127698:0:8431:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789131028.127781:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd1dfbc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+8:2388:x1876039498314112:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 722us (911us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131028.127790:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 113 00010000:00010000:3.0:1789131028.127867:0:8414:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000057b08fdb/0xf3fe2838e1fc326c lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131028.127878:0:8414:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000057b08fdb/0xf3fe2838e1fc326c lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131028.127904:0:8414:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000057b08fdb/0xf3fe2838e1fc326c lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131028.127913:0:8414:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000057b08fdb/0xf3fe2838e1fc326c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131028.127921:0:8414:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000057b08fdb/0xf3fe2838e1fc326c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131028.127929:0:8414:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91de01ad7c00 already unused, calling callback (ffffffffc0c4e550) 00010000:00010000:3.0:1789131028.127934:0:8414:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000057b08fdb/0xf3fe2838e1fc326c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131028.127952:0:8414:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000057b08fdb/0xf3fe2838e1fc326c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131028.127979:0:8414:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000057b08fdb/0xf3fe2838e1fc326c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131028.127988:0:8414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000057b08fdb/0xf3fe2838e1fc326c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131028.128046:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc860a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+7:2388:x1876039498313984:12345-192.168.203.11@tcp:1:lhsmtool_posix.0 Request processed in 6954us (7161us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131028.128056:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 79 00000100:00100000:2.0:1789131028.155432:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789131028.155862:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498314368 00000100:00100000:1.0:1789131028.155876:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498314368 00000100:00100000:1.0:1789131028.155956:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 247 00000100:00100000:1.0:1789131028.155969:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd286ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+21:12723:x1876039498314368:12345-192.168.203.11@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789131028.156074:0:9769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca000/0xf3fe2838e1fc3273 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131028.156096:0:9769:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc3162 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269cb3 expref: 21 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131028.156107:0:9769:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca000/0xf3fe2838e1fc3273 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131028.156152:0:9769:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc3162 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269cb3 expref: 21 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131028.156169:0:9769:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc3162 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269cb3 expref: 21 pid: 14851 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131028.156186:0:9769:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd1df8f00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9769:1876039508856832:192.168.203.11@tcp:104: 00000100:00100000:1.0:1789131028.156299:0:9769:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddff8be0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789131028.164419:0:9769:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd1df8f00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9769:1876039508856832:192.168.203.11@tcp:104: 00010000:00010000:3.0:1789131028.164790:0:9769:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca000/0xf3fe2838e1fc3273 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131028.165185:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131028.165559:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498314496 00000100:00100000:0.0:1789131028.165578:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498314496 00010000:00010000:0.0:1789131028.165638:0:6487:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc3162 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269cb3 expref: 22 pid: 14851 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131028.165698:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 114 00000100:00100000:0.0:1789131028.165709:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd28692c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+22:2388:x1876039498314496:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789131028.165728:0:6487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789131028.165735:0:6487:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc3162 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269cb3 expref: 22 pid: 14851 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131028.165748:0:6487:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc3162 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269cb3 expref: 22 pid: 14851 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131028.165789:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc3162 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269cb3 expref: 22 pid: 14851 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131028.165808:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff91ddca4e4f00) 00010000:00010000:0.0:1789131028.165815:0:6487:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6e00/0xf3fe2838e1fc31c4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269cd6 expref: 21 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131028.165826:0:6487:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca000/0xf3fe2838e1fc3273 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131028.165835:0:6487:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca000/0xf3fe2838e1fc3273 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131028.165843:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca000/0xf3fe2838e1fc3273 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131028.165901:0:6487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789131028.165923:0:9769:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca000/0xf3fe2838e1fc3273 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131028.165930:0:9769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca000/0xf3fe2838e1fc3273 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131028.165988:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd28692c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+21:2388:x1876039498314496:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 280us (805us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131028.165997:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 114 00010000:00010000:0.0:1789131028.167333:0:9769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6800/0xf3fe2838e1fc327a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131028.167353:0:9769:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e600/0xf3fe2838e1fc322d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269cf2 expref: 21 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131028.167364:0:9769:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6800/0xf3fe2838e1fc327a lrc: 4/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131028.167412:0:9769:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e600/0xf3fe2838e1fc322d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269cf2 expref: 21 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131028.167428:0:9769:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e600/0xf3fe2838e1fc322d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269cf2 expref: 21 pid: 6502 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131028.167444:0:9769:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7d98000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9769:1876039508856960:192.168.203.11@tcp:104: 00000100:00100000:0.0:1789131028.167576:0:9769:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddc3049b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789131028.172636:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131028.173356:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498314624 00000100:00100000:3.0:1789131028.173368:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498314624 00000100:00100000:0.0:1789131028.173500:0:9769:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7d98000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9769:1876039508856960:192.168.203.11@tcp:104: 00010000:00010000:0.0:1789131028.173535:0:9769:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6800/0xf3fe2838e1fc327a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131028.173560:0:6485:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e600/0xf3fe2838e1fc322d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269cf2 expref: 22 pid: 6502 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131028.173775:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 115 00000100:00100000:2.0:1789131028.173791:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd286a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+22:2388:x1876039498314624:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789131028.173811:0:8431:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789131028.173820:0:8431:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e600/0xf3fe2838e1fc322d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269cf2 expref: 22 pid: 6502 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131028.173836:0:8431:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e600/0xf3fe2838e1fc322d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269cf2 expref: 22 pid: 6502 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131028.173863:0:8431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e600/0xf3fe2838e1fc322d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269cf2 expref: 22 pid: 6502 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131028.173882:0:8431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff91dde1922200) 00010000:00010000:2.0:1789131028.173887:0:8431:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6800/0xf3fe2838e1fc327a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131028.173910:0:8431:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6800/0xf3fe2838e1fc327a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131028.173920:0:8431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6800/0xf3fe2838e1fc327a lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131028.173953:0:8431:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789131028.174051:0:9769:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6800/0xf3fe2838e1fc327a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131028.174069:0:9769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6800/0xf3fe2838e1fc327a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789131028.174204:0:9769:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:2.0:1789131028.175301:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd286a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+22:2388:x1876039498314624:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 1506us (2671us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131028.175315:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 115 00000001:00080000:0.0:1789131028.175550:0:9769:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000001:00080000:0.0:1789131028.175613:0:9769:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:0.0:1789131028.175796:0:9769:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7d98000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9769:1876039508857088:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1789131028.175873:0:9769:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131028.175917:0:9769:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddca7153c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789131028.176447:0:11069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508857088 00000100:00100000:2.0:1789131028.176484:0:11069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508857088 00000100:00100000:2.0:1789131028.176543:0:11069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1789131028.176555:0:11069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7d99a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:9769:x1876039508857088:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1789131028.176666:0:11069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7d99a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:9769:x1876039508857088:12345-0@lo:1000:mdt00_003.0 Request processed in 114us (793us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131028.176688:0:11069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1789131028.176731:0:9769:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967323 gen 2 00000004:00080000:2.0:1789131028.176739:0:9769:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967318 committed transno 4294967323 00000004:00080000:2.0:1789131028.176792:0:9769:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff91ddd1df83c0, transno 4294967322 00000004:00080000:2.0:1789131028.176807:0:9769:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff91ddd1df92c0, transno 4294967323 00000100:00100000:2.0:1789131028.176817:0:9769:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7d98000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9769:1876039508857088:0@lo:1000:mdt00_003.0 00000001:00080000:2.0:1789131028.177175:0:9769:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00000100:00100000:2.0:1789131028.177230:0:9769:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd2868000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9769:1876039508857216:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1789131028.177273:0:9769:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131028.177315:0:9769:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddc4ccf600 going to sleep for 11 seconds 00000100:00100000:2.0:1789131028.177635:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508857216 00000100:00100000:2.0:1789131028.177655:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508857216 00000100:00100000:2.0:1789131028.177774:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1789131028.177783:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff750b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:9769:x1876039508857216:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1789131028.177907:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff750b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:9769:x1876039508857216:12345-0@lo:1000:mdt00_003.0 Request processed in 125us (633us total) trans 4294967325 rc 0/0 00000100:00100000:2.0:1789131028.177915:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1789131028.177958:0:9769:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd2868000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9769:1876039508857216:0@lo:1000:mdt00_003.0 00010000:00010000:2.0:1789131028.179827:0:9769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6800/0xf3fe2838e1fc327a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131028.179847:0:9769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6800/0xf3fe2838e1fc327a lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131028.179855:0:9769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6800/0xf3fe2838e1fc327a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131028.179863:0:9769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91de01ad6800 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:2.0:1789131028.179868:0:9769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6800/0xf3fe2838e1fc327a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131028.179877:0:9769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6800/0xf3fe2838e1fc327a lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131028.179897:0:9769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff91dde1922200) 00010000:00010000:2.0:1789131028.179901:0:9769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789131028.179907:0:9769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6800/0xf3fe2838e1fc327a lrc: 2/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131028.179913:0:9769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6800/0xf3fe2838e1fc327a lrc: 0/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131028.180134:0:9769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6a00/0xf3fe2838e1fc31bd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131028.180142:0:9769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6a00/0xf3fe2838e1fc31bd lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131028.180148:0:9769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6a00/0xf3fe2838e1fc31bd lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131028.180154:0:9769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91de01ad6a00 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:2.0:1789131028.180157:0:9769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6a00/0xf3fe2838e1fc31bd lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131028.180163:0:9769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6a00/0xf3fe2838e1fc31bd lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131028.180172:0:9769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff91ddca4e4f00) 00010000:00010000:2.0:1789131028.180175:0:9769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789131028.180185:0:9769:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6e00/0xf3fe2838e1fc31c4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269cd6 expref: 24 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131028.180197:0:9769:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6e00/0xf3fe2838e1fc31c4 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269cd6 expref: 24 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131028.180207:0:9769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6e00/0xf3fe2838e1fc31c4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269cd6 expref: 24 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131028.180254:0:9769:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6e00/0xf3fe2838e1fc31c4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269cd6 expref: 24 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131028.180369:0:9769:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff753840 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9769:1876039508857344:192.168.203.11@tcp:105: 00000100:00100000:2.0:1789131028.180734:0:9769:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddc4ccf600 going to sleep for 11 seconds 00000100:00100000:3.0:1789131028.185202:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789131028.185307:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498314752 00000100:00100000:1.0:1789131028.185320:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498314752 00000100:00100000:1.0:1789131028.185413:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 61 00000100:00100000:1.0:1789131028.185436:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc860a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+25:12722:x1876039498314752:12345-192.168.203.11@tcp:49:lfs.0 00000100:00100000:1.0:1789131028.185646:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc860a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+25:12722:x1876039498314752:12345-192.168.203.11@tcp:49:lfs.0 Request processed in 221us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131028.185655:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 61 00000100:00100000:2.0:1789131028.190003:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131028.190145:0:14851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498315008 00000100:00100000:3.0:1789131028.190160:0:14851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498315008 00000100:00100000:3.0:1789131028.190238:0:14851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 248 00000100:00100000:3.0:1789131028.190251:0:14851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff753480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+25:12722:x1876039498315008:12345-192.168.203.11@tcp:58:lfs.0 00000100:00100000:0.0:1789131028.191033:0:9769:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff753840 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9769:1876039508857344:192.168.203.11@tcp:105: 00010000:00010000:0.0:1789131028.191070:0:9769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6a00/0xf3fe2838e1fc31bd lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131028.191083:0:9769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6a00/0xf3fe2838e1fc31bd lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131028.191126:0:9769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7e00/0xf3fe2838e1fc3281 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131028.191144:0:9769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7e00/0xf3fe2838e1fc3281 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131028.191157:0:9769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7e00/0xf3fe2838e1fc3281 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131028.191167:0:9769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7e00/0xf3fe2838e1fc3281 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131028.191172:0:9769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7e00/0xf3fe2838e1fc3281 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131028.191201:0:9769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7e00/0xf3fe2838e1fc3281 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131028.191207:0:9769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91de01ad7e00 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:0.0:1789131028.191211:0:9769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7e00/0xf3fe2838e1fc3281 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131028.191218:0:9769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7e00/0xf3fe2838e1fc3281 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131028.191231:0:9769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff91ddca4e4f00) 00010000:00010000:0.0:1789131028.191234:0:9769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789131028.191238:0:9769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7e00/0xf3fe2838e1fc3281 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131028.191244:0:9769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7e00/0xf3fe2838e1fc3281 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131028.191253:0:9769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca000/0xf3fe2838e1fc3273 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131028.191259:0:9769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca000/0xf3fe2838e1fc3273 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131028.191265:0:9769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca000/0xf3fe2838e1fc3273 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131028.191269:0:9769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc85ca000 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:0.0:1789131028.191271:0:9769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca000/0xf3fe2838e1fc3273 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131028.191299:0:9769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca000/0xf3fe2838e1fc3273 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131028.191308:0:9769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff91ddca4e4f00) 00010000:00010000:0.0:1789131028.191310:0:9769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789131028.191313:0:9769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca000/0xf3fe2838e1fc3273 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131028.191318:0:9769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca000/0xf3fe2838e1fc3273 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131028.191571:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd286ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+25:12723:x1876039498314368:12345-192.168.203.11@tcp:57:lhsmtool_posix.0 Request processed in 35603us (36153us total) trans 4294967514 rc 0/0 00000100:00100000:0.0:1789131028.191583:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 247 00000020:00080000:0.0:1789131028.191589:0:9769:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1789131028.192006:0:14851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:2.0:1789131028.192077:0:14851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff753480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+24:12722:x1876039498315008:12345-192.168.203.11@tcp:58:lfs.0 Request processed in 1826us (2098us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131028.192086:0:14851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 248 00000040:00080000:3.0:1789131028.192259:0:14475:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789131028.192266:0:14475:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789131028.192292:0:14475:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1789131028.192301:0:14475:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789131028.192427:0:14475:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8608000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14475:1876039508857472:192.168.203.11@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789131028.192528:0:14475:0:(client.c:2715:ptlrpc_set_wait()) set ffff91de01a870c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789131028.200701:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131028.200794:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131028.200935:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498315136 00000100:00100000:0.0:1789131028.200947:0:14273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498315136 00000100:00100000:0.0:1789131028.201028:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 249 00000100:00100000:0.0:1789131028.201041:0:14273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff750000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+25:12724:x1876039498315136:12345-192.168.203.11@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789131028.201088:0:14273:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789131028.201232:0:14273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff750000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+25:12724:x1876039498315136:12345-192.168.203.11@tcp:53:lhsmtool_posix.0 Request processed in 193us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131028.201241:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 249 00000100:00100000:1.0:1789131028.201408:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498315392 00000100:00100000:1.0:1789131028.201414:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498315392 00000100:00100000:1.0:1789131028.201483:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 62 00000100:00100000:1.0:1789131028.201492:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dded1d0c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+25:12723:x1876039498315392:12345-192.168.203.11@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1789131028.201789:0:6504:0:(mdd_object.c:4024:mdd_close()) Object [0x200000402:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1789131028.201829:0:6504:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967515 00010000:00010000:1.0:1789131028.201869:0:6504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85caa00/0xf3fe2838e1fc3288 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131028.201890:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85caa00/0xf3fe2838e1fc3288 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131028.201904:0:6504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85caa00/0xf3fe2838e1fc3288 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131028.201915:0:6504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85caa00/0xf3fe2838e1fc3288 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131028.201922:0:6504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85caa00/0xf3fe2838e1fc3288 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131028.201930:0:6504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85caa00/0xf3fe2838e1fc3288 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131028.201946:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789131028.202048:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dded1d0c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+27:12723:x1876039498315392:12345-192.168.203.11@tcp:35:lhsmtool_posix.0 Request processed in 555us (1251us total) trans 4294967516 rc 0/0 00000100:00100000:1.0:1789131028.202056:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 62 00000020:00080000:1.0:1789131028.202060:0:6504:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789131028.202876:0:6489:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789131028.202887:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85caa00/0xf3fe2838e1fc3288 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131028.202897:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc85caa00 already unused, calling callback (ffffffffc0c4e550) 00010000:00010000:2.0:1789131028.202902:0:6489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85caa00/0xf3fe2838e1fc3288 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131028.202912:0:6489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85caa00/0xf3fe2838e1fc3288 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131028.202930:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff91dde1922200) 00010000:00010000:2.0:1789131028.202934:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789131028.202941:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85caa00/0xf3fe2838e1fc3288 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131028.202948:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85caa00/0xf3fe2838e1fc3288 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131028.202994:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131028.202996:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131028.202997:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789131028.203399:0:14475:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8608000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14475:1876039508857472:192.168.203.11@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789131028.210079:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789131028.210432:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498315648 00000100:00100000:1.0:1789131028.210445:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498315648 00000100:00100000:1.0:1789131028.210551:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 250 00000100:00100000:1.0:1789131028.210565:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff750f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+26:12724:x1876039498315648:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789131028.210593:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789131028.210622:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb600/0xf3fe2838e1fc328f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269d0e expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131028.210832:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb200/0xf3fe2838e1fc3296 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131028.210851:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb200/0xf3fe2838e1fc3296 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131028.210865:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb200/0xf3fe2838e1fc3296 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789131028.210879:0:6500:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:1.0:1789131028.211502:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb600/0xf3fe2838e1fc328f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269d0e expref: 29 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131028.211524:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb200/0xf3fe2838e1fc3296 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269d0e expref: 28 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131028.211535:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff91ddca4e4f00) 00010000:00010000:1.0:1789131028.211557:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789131028.211562:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dcc85cb200, rc 0) 00000100:00100000:1.0:1789131028.211638:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff750f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+28:12724:x1876039498315648:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 1075us (1573us total) trans 4294967517 rc 0/0 00000100:00100000:1.0:1789131028.211647:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 250 00000100:00100000:0.0:1789131028.226075:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131028.226238:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498315904 00000100:00100000:2.0:1789131028.226251:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498315904 00000100:00100000:2.0:1789131028.226341:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 251 00000100:00100000:2.0:1789131028.226353:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7d98780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+28:12724:x1876039498315904:12345-192.168.203.11@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789131028.226504:0:9769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e600/0xf3fe2838e1fc32a4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131028.226528:0:9769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e600/0xf3fe2838e1fc32a4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131028.226543:0:9769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e600/0xf3fe2838e1fc32a4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131028.227013:0:9769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e600/0xf3fe2838e1fc32a4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131028.227023:0:9769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e600/0xf3fe2838e1fc32a4 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131028.227030:0:9769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e600/0xf3fe2838e1fc32a4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131028.227036:0:9769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc7f7e600 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:2.0:1789131028.227041:0:9769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e600/0xf3fe2838e1fc32a4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131028.227074:0:9769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e600/0xf3fe2838e1fc32a4 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131028.227090:0:9769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff91ddca4e4f00) 00010000:00010000:2.0:1789131028.227094:0:9769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789131028.227100:0:9769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e600/0xf3fe2838e1fc32a4 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131028.227107:0:9769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7e600/0xf3fe2838e1fc32a4 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131028.227364:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7d98780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+29:12724:x1876039498315904:12345-192.168.203.11@tcp:57:lhsmtool_posix.0 Request processed in 1011us (1302us total) trans 4294967518 rc 0/0 00000100:00100000:2.0:1789131028.227374:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 251 00000100:00100000:0.0:1789131028.242134:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789131028.242665:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498316160 00000100:00100000:1.0:1789131028.242689:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498316160 00000100:00100000:1.0:1789131028.242773:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 63 00000100:00100000:1.0:1789131028.242785:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7d992c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+29:12724:x1876039498316160:12345-192.168.203.11@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789131028.243106:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7d992c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+30:12724:x1876039498316160:12345-192.168.203.11@tcp:35:lhsmtool_posix.0 Request processed in 322us (986us total) trans 4294967519 rc 0/0 00000100:00100000:1.0:1789131028.243116:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 63 00000040:00080000:2.0:1789131028.246686:0:14475:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789131028.246701:0:14475:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789131028.247352:0:14475:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1789131028.247368:0:14475:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789131028.251903:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131028.252026:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498316288 00000100:00100000:0.0:1789131028.252041:0:14273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498316288 00000100:00100000:0.0:1789131028.252118:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 252 00000100:00100000:0.0:1789131028.252153:0:14273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd1df9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+30:12726:x1876039498316288:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:0.0:1789131028.252181:0:14273:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789131028.252208:0:14273:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6a00/0xf3fe2838e1fc32ab lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269d15 expref: -99 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131028.252291:0:14273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6400/0xf3fe2838e1fc32b2 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131028.252310:0:14273:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6400/0xf3fe2838e1fc32b2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131028.252323:0:14273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6400/0xf3fe2838e1fc32b2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131028.252340:0:14273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc32b9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131028.252347:0:14273:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc32b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131028.252355:0:14273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc32b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131028.252498:0:14273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7c00/0xf3fe2838e1fc32c0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131028.252510:0:14273:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca200/0xf3fe2838e1fc31af lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269ccf expref: 31 pid: 9769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131028.252519:0:14273:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7c00/0xf3fe2838e1fc32c0 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131028.252573:0:14273:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca200/0xf3fe2838e1fc31af lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269ccf expref: 31 pid: 9769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131028.252590:0:14273:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca200/0xf3fe2838e1fc31af lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269ccf expref: 31 pid: 9769 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131028.252608:0:14273:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7d9b480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14273:1876039508857600:192.168.203.11@tcp:104: 00000100:00100000:0.0:1789131028.252734:0:14273:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddca715d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789131028.256650:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789131028.256902:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498316544 00000100:00100000:1.0:1789131028.256916:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498316544 00000100:00100000:1.0:1789131028.257016:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 64 00000100:00100000:1.0:1789131028.257029:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8608000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+32:6158:x1876039498316544:12345-192.168.203.11@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1789131028.257347:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8608000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+33:6158:x1876039498316544:12345-192.168.203.11@tcp:35:ldlm_bl.0 Request processed in 320us (710us total) trans 4294967520 rc 0/0 00000100:00100000:1.0:1789131028.257357:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 64 00000100:00100000:0.0:1789131028.257852:0:14273:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7d9b480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:14273:1876039508857600:192.168.203.11@tcp:104: 00010000:00010000:0.0:1789131028.257883:0:14273:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7c00/0xf3fe2838e1fc32c0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131028.260555:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131028.260719:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498316672 00000100:00100000:3.0:1789131028.260732:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498316672 00010000:00010000:3.0:1789131028.260798:0:6486:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca200/0xf3fe2838e1fc31af lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269ccf expref: 33 pid: 9769 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131028.260849:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 116 00000100:00100000:3.0:1789131028.260861:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd1dfb840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+33:2387:x1876039498316672:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789131028.260879:0:6486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789131028.260887:0:6486:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca200/0xf3fe2838e1fc31af lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269ccf expref: 33 pid: 9769 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131028.260903:0:6486:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca200/0xf3fe2838e1fc31af lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269ccf expref: 33 pid: 9769 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131028.260958:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca200/0xf3fe2838e1fc31af lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269ccf expref: 33 pid: 9769 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131028.260989:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff91ddca4e4f00) 00010000:00010000:3.0:1789131028.260996:0:6486:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7c00/0xf3fe2838e1fc32c0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131028.261008:0:6486:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7c00/0xf3fe2838e1fc32c0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131028.261016:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7c00/0xf3fe2838e1fc32c0 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131028.261058:0:6486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789131028.261131:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd1dfb840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+32:2387:x1876039498316672:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 272us (591us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131028.261140:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 116 00010000:00010000:1.0:1789131028.261799:0:14273:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7c00/0xf3fe2838e1fc32c0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131028.261812:0:14273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7c00/0xf3fe2838e1fc32c0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789131028.261898:0:14273:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:1.0:1789131028.261904:0:14273:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789131028.261932:0:14273:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7c00/0xf3fe2838e1fc32c0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131028.261950:0:14273:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7c00/0xf3fe2838e1fc32c0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131028.261961:0:14273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6400/0xf3fe2838e1fc32b2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131028.261980:0:14273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6400/0xf3fe2838e1fc32b2 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131028.261987:0:14273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6400/0xf3fe2838e1fc32b2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131028.261993:0:14273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91de01ad6400 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:1.0:1789131028.261998:0:14273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6400/0xf3fe2838e1fc32b2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131028.262007:0:14273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6400/0xf3fe2838e1fc32b2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131028.262019:0:14273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff91dcc7d6bf00) 00010000:00010000:1.0:1789131028.262022:0:14273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789131028.262026:0:14273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6400/0xf3fe2838e1fc32b2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131028.262033:0:14273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6400/0xf3fe2838e1fc32b2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131028.262058:0:14273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc32b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131028.262065:0:14273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc32b9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131028.262070:0:14273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc32b9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131028.262075:0:14273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91de01ad7600 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:1.0:1789131028.262078:0:14273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc32b9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131028.262085:0:14273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc32b9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131028.262094:0:14273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff91ddcf5ff800) 00010000:00010000:1.0:1789131028.262096:0:14273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789131028.262099:0:14273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc32b9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131028.262105:0:14273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc32b9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131028.262154:0:14273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6a00/0xf3fe2838e1fc32ab lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269d15 expref: 32 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131028.262172:0:14273:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7c00/0xf3fe2838e1fc32c0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269d15 expref: 31 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131028.262191:0:14273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff91ddca4e4f00) 00010000:00010000:1.0:1789131028.262194:0:14273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789131028.262197:0:14273:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91de01ad7c00, rc 0) 00000100:00100000:1.0:1789131028.262267:0:14273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd1df9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+31:12726:x1876039498316288:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 10117us (10378us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131028.262277:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 252 00000100:00100000:1.0:1789131028.320526:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789131028.320580:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789131028.320612:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789131028.320651:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789131028.320681:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131028.320788:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498316800 00000100:00100000:3.0:1789131028.320802:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498316800 00000100:00100000:3.0:1789131028.320881:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 456 00000100:00100000:3.0:1789131028.320895:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8606c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+13:2386:x1876039498316800:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1789131028.321008:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8606c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+13:2386:x1876039498316800:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 116us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131028.321018:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 456 00000100:00100000:2.0:1789131028.321566:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498317056 00000100:00100000:2.0:1789131028.321573:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498317056 00000100:00100000:2.0:1789131028.321635:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 142 00000100:00100000:2.0:1789131028.321644:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd1df8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+5:2385:x1876039498317056:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1789131028.321691:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd1df8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+5:2385:x1876039498317056:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 48us (1039us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131028.321699:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 142 00000100:00100000:2.0:1789131028.321721:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498317184 00000100:00100000:2.0:1789131028.321726:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498317184 00000100:00100000:2.0:1789131028.321775:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498316928 00000100:00100000:2.0:1789131028.321799:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498316928 00000100:00100000:2.0:1789131028.321826:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 363 00000100:00100000:2.0:1789131028.321833:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd1df9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fde8d4a8-44db-4e6b-8249-c1c295e4901d+5:2385:x1876039498317184:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1789131028.321865:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd1df9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fde8d4a8-44db-4e6b-8249-c1c295e4901d+5:2385:x1876039498317184:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 33us (1285us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131028.321872:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 363 00000100:00100000:2.0:1789131028.321884:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498317312 00000100:00100000:2.0:1789131028.321887:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498317312 00000100:00100000:2.0:1789131028.321907:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 364 00000100:00100000:2.0:1789131028.321913:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd1df8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+5:2386:x1876039498316928:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1789131028.321938:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd1df8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+5:2386:x1876039498316928:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 25us (1326us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131028.321944:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 364 00000100:00100000:2.0:1789131028.321957:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 365 00000100:00100000:2.0:1789131028.321963:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd1df8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fde8d4a8-44db-4e6b-8249-c1c295e4901d+5:2385:x1876039498317312:12345-192.168.203.11@tcp:400:kworker.0 00000100:00080000:3.0:1789131028.322051:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789131028.322056:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789131028.322058:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789131028.322508:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd1df8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fde8d4a8-44db-4e6b-8249-c1c295e4901d+5:2385:x1876039498317312:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 457us (1738us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131028.322517:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 365 00010000:00010000:2.0:1789131028.369805:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789131029.049514:0:15389:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789131029.049522:0:15389:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789131029.049554:0:15389:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1789131029.049561:0:15389:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789131029.074551:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff753840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3627:1876039508857856:0@lo:400:kworker.0 00000100:00100000:0.0:1789131029.074627:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131029.074689:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd1dad2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3627:1876039508858368:0@lo:400:kworker.0 00000100:00100000:0.0:1789131029.074712:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131029.074763:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789131029.074770:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd1daf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508857984:0@lo:400:kworker.0 00000100:00100000:0.0:1789131029.074797:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131029.074816:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd1dade00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3627:1876039508858496:0@lo:400:kworker.0 00000100:00100000:0.0:1789131029.074836:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131029.074864:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508857856 00000100:00100000:0.0:1789131029.074870:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508857856 00000100:00100000:0.0:1789131029.074913:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508858368 00000100:00100000:0.0:1789131029.074918:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508858368 00000100:00100000:0.0:1789131029.074958:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508858496 00000100:00100000:0.0:1789131029.074962:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508858496 00000100:00100000:0.0:1789131029.074983:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:0.0:1789131029.074991:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7d9b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1876039508857856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789131029.075045:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7d9b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1876039508857856:12345-0@lo:400:kworker.0 Request processed in 53us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131029.075053:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:2.0:1789131029.075057:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd1dae580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3625:1876039508858112:0@lo:400:kworker.0 00000100:00100000:0.0:1789131029.075076:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:0.0:1789131029.075085:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7d9a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1876039508858368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131029.075091:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131029.080150:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff7530c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3626:1876039508857728:0@lo:400:kworker.0 00000100:00100000:0.0:1789131029.080292:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7d9a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1876039508858368:12345-0@lo:400:kworker.0 Request processed in 5206us (5576us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131029.080303:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00100000:0.0:1789131029.080333:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508858112 00000100:00100000:0.0:1789131029.080339:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508858112 00000100:00100000:0.0:1789131029.080369:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:0.0:1789131029.080377:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7d98b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1876039508858496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789131029.080422:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7d98b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1876039508858496:12345-0@lo:400:kworker.0 Request processed in 47us (5584us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131029.080428:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:0.0:1789131029.080439:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:0.0:1789131029.080445:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8416d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1876039508858112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789131029.080490:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8416d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1876039508858112:12345-0@lo:400:kworker.0 Request processed in 45us (5399us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131029.080496:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00000100:00080000:0.0:1789131029.080518:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789131029.080524:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789131029.080643:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508857984 00000100:00100000:0.0:1789131029.080655:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508857984 00000100:00100000:0.0:1789131029.080688:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1789131029.080695:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7d98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508857984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789131029.080739:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7d98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508857984:12345-0@lo:400:kworker.0 Request processed in 45us (5941us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131029.080758:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1789131029.080781:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd1daf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3628:1876039508859008:0@lo:400:kworker.0 00000100:00100000:0.0:1789131029.080809:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131029.080846:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1789131029.080853:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd1dac3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1876039508858880:0@lo:400:kworker.0 00000100:00100000:0.0:1789131029.080877:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131029.080897:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc86092c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1876039508859392:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789131029.080920:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131029.080943:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508859008 00000100:00100000:0.0:1789131029.080947:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508859008 00000100:00100000:0.0:1789131029.080975:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:0.0:1789131029.080981:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7d983c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3628:x1876039508859008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789131029.081013:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7d983c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3628:x1876039508859008:12345-0@lo:400:kworker.0 Request processed in 32us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131029.081018:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00080000:0.0:1789131029.081033:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789131029.081057:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd1daf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3628:1876039508859008:0@lo:400:kworker.0 00000100:00100000:0.0:1789131029.081390:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd1daf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508857984:0@lo:400:kworker.0 00010000:00080000:0.0:1789131029.081410:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91ddd1dade00 x1876039508858496/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789131045 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789131029.081434:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd1dade00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3627:1876039508858496:0@lo:400:kworker.0 00000100:00100000:0.0:1789131029.081450:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff753840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3627:1876039508857856:0@lo:400:kworker.0 00000100:00100000:0.0:1789131029.081487:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd1dad2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3627:1876039508858368:0@lo:400:kworker.0 00000100:00100000:0.0:1789131029.081532:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508859392 00000100:00100000:0.0:1789131029.081536:0:8418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508859392 00000100:00100000:0.0:1789131029.081576:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1789131029.081583:0:8418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7d99e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1876039508859392:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789131029.081599:0:8418:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923525632 avail 3691974656 00000100:00100000:2.0:1789131029.082016:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd1dae580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3625:1876039508858112:0@lo:400:kworker.0 00000100:00100000:2.0:1789131029.082027:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd1dac780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508858624:0@lo:400:kworker.0 00000100:00100000:0.0:1789131029.083609:0:8418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7d99e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1876039508859392:12345-0@lo:13:osp-pre-1-1.0 Request processed in 2021us (2682us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131029.083621:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1789131029.083661:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508858880 00000100:00100000:0.0:1789131029.083668:0:9827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508858880 00000100:00100000:0.0:1789131029.083705:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1789131029.083712:0:9827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7d9b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3628:x1876039508858880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789131029.083776:0:9827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7d9b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3628:x1876039508858880:12345-0@lo:400:kworker.0 Request processed in 64us (2898us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131029.083783:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00080000:0.0:1789131029.083805:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789131029.083832:0:3628:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:0.0:1789131029.083839:0:3628:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967307 committed transno 4294967310 00000004:00080000:0.0:1789131029.083856:0:3628:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff91ddff7503c0, transno 4294967308 00000004:00080000:0.0:1789131029.083872:0:3628:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967310 committed transno 4294967310 00000100:00100000:0.0:1789131029.083889:0:3628:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff91ddd2869e00 x1876039508856064/t4294967311(4294967311) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789131044 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789131029.083912:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd1dac3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1876039508858880:0@lo:400:kworker.0 00000100:00100000:0.0:1789131029.083935:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc86092c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1876039508859392:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789131029.086820:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131029.086901:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd1dada40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3625:1876039508859136:0@lo:400:kworker.0 00000100:00100000:2.0:1789131029.086937:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131029.087148:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508859136 00000100:00100000:2.0:1789131029.087156:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508859136 00000100:00100000:2.0:1789131029.087212:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00100000:2.0:1789131029.087221:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8415e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1876039508859136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131029.087267:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8415e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1876039508859136:12345-0@lo:400:kworker.0 Request processed in 47us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131029.087273:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00000100:00080000:2.0:1789131029.087296:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1789131029.087325:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91ddd1dada40 x1876039508859136/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789131045 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789131029.087338:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd1dada40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3625:1876039508859136:0@lo:400:kworker.0 00000100:00100000:3.0:1789131029.090354:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131029.090616:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd1daed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508858240:0@lo:400:kworker.0 00000100:00100000:1.0:1789131029.090668:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508857728 00000100:00100000:1.0:1789131029.090677:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508857728 00000100:00100000:1.0:1789131029.090731:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 457 00000100:00100000:1.0:1789131029.090741:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8605450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+24:3626:x1876039508857728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789131029.090829:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131029.090844:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8605450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+24:3626:x1876039508857728:12345-0@lo:400:kworker.0 Request processed in 102us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131029.090853:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 457 00000100:00100000:3.0:1789131029.090864:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd1dfa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508858752:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789131029.090867:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508858624 00000100:00100000:0.0:1789131029.090872:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508858624 00000100:00100000:3.0:1789131029.090897:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131029.090901:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508858240 00000100:00100000:2.0:1789131029.090908:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508858240 00000100:00100000:0.0:1789131029.090921:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1789131029.090923:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508858752 00000100:00100000:3.0:1789131029.090927:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508858752 00000100:00100000:0.0:1789131029.090931:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc84143c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508858624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131029.090950:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1789131029.090959:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1789131029.090968:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc86092c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508858240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789131029.090970:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc860a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3626:x1876039508858752:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789131029.090977:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc84143c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508858624:12345-0@lo:400:kworker.0 Request processed in 48us (4164us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131029.090983:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00002000:00000024:3.0:1789131029.090996:0:8419:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1789131029.091025:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc86092c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508858240:12345-0@lo:400:kworker.0 Request processed in 66us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131029.091034:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1789131029.091042:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc860a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3626:x1876039508858752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (144us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131029.091050:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00080000:2.0:1789131029.091059:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789131029.091094:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd1dac780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508858624:0@lo:400:kworker.0 00000100:00100000:3.0:1789131029.091107:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd1dfa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508858752:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789131029.091117:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dde0b80f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1876039508859264:0@lo:400:kworker.0 00000100:00100000:3.0:1789131029.091228:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131029.091272:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff7530c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3626:1876039508857728:0@lo:400:kworker.0 00000100:00100000:3.0:1789131029.091283:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd1daed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508858240:0@lo:400:kworker.0 00000100:00100000:0.0:1789131029.091527:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508859264 00000100:00100000:0.0:1789131029.091532:0:9827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508859264 00000100:00100000:0.0:1789131029.091558:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1789131029.091565:0:9827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc86083c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3626:x1876039508859264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789131029.091605:0:9827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc86083c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3626:x1876039508859264:12345-0@lo:400:kworker.0 Request processed in 41us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131029.091613:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1789131029.091658:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dde0b80f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1876039508859264:0@lo:400:kworker.0 00000100:00100000:3.0:1789131029.238711:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131029.238825:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498317568 00000100:00100000:0.0:1789131029.238835:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498317568 00000100:00100000:0.0:1789131029.239244:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 253 00000100:00100000:0.0:1789131029.239257:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc860b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+31:12749:x1876039498317568:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:0.0:1789131029.239282:0:6500:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789131029.239303:0:6500:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6a00/0xf3fe2838e1fc32c7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269d1c expref: -99 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131029.240120:0:6500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc32ce lrc: 3/1,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131029.240149:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc32ce lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131029.240162:0:6500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc32ce lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6500 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789131029.240175:0:6500:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:0.0:1789131029.240280:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6a00/0xf3fe2838e1fc32c7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269d1c expref: 34 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131029.240299:0:6500:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc32ce lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269d1c expref: 33 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131029.240308:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff91ddca4e4f00) 00010000:00010000:0.0:1789131029.240311:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1789131029.240315:0:6500:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91de01ad7600, rc 0) 00000100:00100000:0.0:1789131029.240370:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc860b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+33:12749:x1876039498317568:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 1116us (1668us total) trans 4294967521 rc 0/0 00000100:00100000:0.0:1789131029.240378:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 253 00000100:00100000:3.0:1789131029.244373:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131029.244439:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498317696 00000100:00100000:0.0:1789131029.244448:0:14273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498317696 00000100:00100000:0.0:1789131029.244532:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 254 00000100:00100000:0.0:1789131029.244543:0:14273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8608f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+33:12749:x1876039498317696:12345-192.168.203.11@tcp:54:lfs.0 00010000:00010000:0.0:1789131029.244603:0:14273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6400/0xf3fe2838e1fc32dc lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131029.244620:0:14273:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6400/0xf3fe2838e1fc32dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131029.244642:0:14273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6400/0xf3fe2838e1fc32dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131029.244685:0:14273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6400/0xf3fe2838e1fc32dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131029.244693:0:14273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6400/0xf3fe2838e1fc32dc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131029.244699:0:14273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6400/0xf3fe2838e1fc32dc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131029.244706:0:14273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91de01ad6400 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:0.0:1789131029.244711:0:14273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6400/0xf3fe2838e1fc32dc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131029.244717:0:14273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6400/0xf3fe2838e1fc32dc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131029.244739:0:14273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff91ddca4e4f00) 00010000:00010000:0.0:1789131029.244742:0:14273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789131029.244754:0:14273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6400/0xf3fe2838e1fc32dc lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131029.244761:0:14273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6400/0xf3fe2838e1fc32dc lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14273 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131029.244833:0:14273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8608f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+33:12749:x1876039498317696:12345-192.168.203.11@tcp:54:lfs.0 Request processed in 292us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131029.244841:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 254 00000100:00100000:3.0:1789131029.336839:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131029.337101:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498317824 00000100:00100000:0.0:1789131029.337111:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498317824 00000100:00080000:2.0:1789131029.337188:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789131029.337200:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 80 00000100:00100000:0.0:1789131029.337212:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc860a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+7:2385:x1876039498317824:12345-192.168.203.11@tcp:101:cat.0 00010000:00010000:0.0:1789131029.337229:0:8416:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789131029.337250:0:8416:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000146d23ab/0xf3fe2838e1fc32e3 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269d23 expref: -99 pid: 8416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789131029.337276:0:8416:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 13, mtime: 0x6aa3f912, atime: 0x6aa3f912, ctime: 0x6aa3f912, blocks: 0x8 00010000:00010000:0.0:1789131029.337297:0:8416:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=385s v=(0 0) 00010000:00010000:0.0:1789131029.337302:0:8416:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789131029.337312:0:8416:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000146d23ab/0xf3fe2838e1fc32e3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269d23 expref: 8 pid: 8416 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131029.337332:0:8416:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000146d23ab/0xf3fe2838e1fc32e3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269d23 expref: 8 pid: 8416 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131029.337345:0:8416:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91de01ad6400, rc 0) 00000100:00100000:0.0:1789131029.337403:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc860a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+8:2385:x1876039498317824:12345-192.168.203.11@tcp:101:cat.0 Request processed in 194us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131029.337411:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 80 00000100:00100000:0.0:1789131029.346382:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131029.346500:0:8420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498317952 00000100:00100000:3.0:1789131029.346519:0:8420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498317952 00002000:00100000:3.0:1789131029.346569:0:8420:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x6:0x0] (0->4095) req@ffff91dcc7d9b480 x1876039498317952/t0(0) o3->b99c111d-b9b6-4590-88e4-9fefd4d4c3a4@192.168.203.11@tcp:745/0 lens 488/0 e 0 to 0 dl 1789131040 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789131029.346580:0:8420:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff91dcc7d9b480 with x1876039498317952 ext(0->4095) 00002000:00010000:3.0:1789131029.346586:0:8420:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91dcc7d9b480 00000100:00100000:3.0:1789131029.346610:0:8420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 8 00000100:00100000:3.0:1789131029.346618:0:8420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7d9b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+8:2388:x1876039498317952:12345-192.168.203.11@tcp:3:cat.0 00000100:00100000:3.0:1789131029.346784:0:8420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7d9b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+8:2388:x1876039498317952:12345-192.168.203.11@tcp:3:cat.0 Request processed in 166us (409us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1789131029.346792:0:8420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 8 00002000:00100000:3.0:1789131029.346798:0:8420:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x6:0x0] (0->4095) req@ffff91dcc7d9b480 x1876039498317952/t0(0) o3->b99c111d-b9b6-4590-88e4-9fefd4d4c3a4@192.168.203.11@tcp:745/0 lens 488/4536 e 0 to 0 dl 1789131040 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789131029.346805:0:8420:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff91dcc7d9b480 with x1876039498317952 ext(0->4095) 00002000:00010000:3.0:1789131029.346808:0:8420:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91dcc7d9b480 00010000:00010000:1.0:1789131029.393662:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789131029.586231:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff7530c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1876039508859520:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789131029.586299:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131029.586420:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508859520 00000100:00100000:3.0:1789131029.586427:0:8418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508859520 00000100:00100000:3.0:1789131029.586496:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1789131029.586505:0:8418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8417480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3628:x1876039508859520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789131029.586535:0:8418:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789131029.605441:0:8418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8417480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3628:x1876039508859520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 18927us (19131us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131029.605469:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789131029.605624:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff7530c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1876039508859520:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789131030.097732:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789131030.097778:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff7503c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1876039508859648:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789131030.097851:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131030.098124:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508859648 00000100:00100000:3.0:1789131030.098144:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508859648 00000100:00100000:3.0:1789131030.098200:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1789131030.098210:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff753840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1876039508859648:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789131030.098232:0:8419:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789131030.098287:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff753840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1876039508859648:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131030.098294:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1789131030.101128:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff7503c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1876039508859648:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1789131030.420556:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789131031.444316:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789131032.085875:0:14478:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789131032.146120:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff7530c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1876039508859776:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789131032.146218:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131032.146567:0:11069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508859776 00000100:00100000:2.0:1789131032.146577:0:11069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508859776 00000100:00100000:0.0:1789131032.147082:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1789131032.147151:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd1df83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1876039508859776:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789131032.147217:0:6506:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1789131032.147299:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd1df83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1876039508859776:12345-0@lo:41:osp-pre-0-1.0 Request processed in 204us (1079us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131032.147307:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1789131032.147441:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff7530c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1876039508859776:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789131032.148116:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8416580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1876039508859904:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789131032.148170:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131032.148495:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508859904 00000100:00100000:0.0:1789131032.148503:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508859904 00000100:00100000:0.0:1789131032.148545:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1789131032.148553:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd1df92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1876039508859904:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789131032.148580:0:6505:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789131032.148800:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd1df92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1876039508859904:12345-0@lo:41:osp-pre-1-0.0 Request processed in 246us (629us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131032.148808:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1789131032.156865:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8416580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1876039508859904:0@lo:41:osp-pre-1-0.0 00000040:00080000:2.0:1789131032.337755:0:14475:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789131032.337766:0:14475:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789131032.337791:0:14475:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1789131032.337800:0:14475:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1789131032.465659:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789131033.456992:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131033.457027:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131033.457050:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131033.457070:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131033.457088:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131033.457105:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131033.457126:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131033.457148:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498318080 00000100:00100000:0.0:1789131033.457157:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498318080 00000100:00100000:0.0:1789131033.457205:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 458 00000100:00100000:0.0:1789131033.457215:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8604450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+13:2386:x1876039498318080:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1789131033.457278:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8604450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+13:2386:x1876039498318080:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 65us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131033.457285:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 458 00000100:00100000:0.0:1789131033.457314:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498318208 00000100:00100000:0.0:1789131033.457328:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498318208 00000100:00100000:0.0:1789131033.457363:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498318720 00000100:00100000:0.0:1789131033.457366:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498318720 00000100:00100000:0.0:1789131033.457384:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498318336 00000100:00100000:0.0:1789131033.457386:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498318336 00000100:00100000:0.0:1789131033.457397:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498318848 00000100:00100000:0.0:1789131033.457399:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498318848 00000100:00100000:0.0:1789131033.457411:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 372 00000100:00100000:0.0:1789131033.457417:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff7530c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+33:2385:x1876039498318208:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1789131033.457446:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff7530c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+33:2385:x1876039498318208:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 29us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131033.457452:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 372 00000100:00100000:0.0:1789131033.457486:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 373 00000100:00100000:0.0:1789131033.457493:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd1daed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fde8d4a8-44db-4e6b-8249-c1c295e4901d+5:2385:x1876039498318720:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1789131033.457517:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd1daed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fde8d4a8-44db-4e6b-8249-c1c295e4901d+5:2385:x1876039498318720:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 25us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131033.457523:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 373 00000100:00100000:0.0:1789131033.457535:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 374 00000100:00100000:0.0:1789131033.457541:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd1dac780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+5:2385:x1876039498318336:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1789131033.457563:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd1dac780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+5:2385:x1876039498318336:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 23us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131033.457569:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 374 00000100:00100000:0.0:1789131033.457579:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 375 00000100:00100000:0.0:1789131033.457585:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd1dae580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fde8d4a8-44db-4e6b-8249-c1c295e4901d+5:2385:x1876039498318848:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1789131033.457606:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd1dae580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fde8d4a8-44db-4e6b-8249-c1c295e4901d+5:2385:x1876039498318848:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 21us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131033.457618:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 375 00000100:00100000:0.0:1789131033.457641:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498318464 00000100:00100000:0.0:1789131033.457644:0:9827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498318464 00000100:00100000:0.0:1789131033.457667:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498318592 00000100:00100000:0.0:1789131033.457670:0:9827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498318592 00000100:00100000:0.0:1789131033.457688:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 146 00000100:00100000:0.0:1789131033.457694:0:9827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff7503c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+5:2385:x1876039498318464:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1789131033.457733:0:9827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff7503c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+5:2385:x1876039498318464:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 37us (680us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131033.457738:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 146 00000100:00100000:0.0:1789131033.457749:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 147 00000100:00100000:0.0:1789131033.457755:0:9827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd1dada40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+8:2385:x1876039498318592:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1789131033.457777:0:9827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd1dada40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+8:2385:x1876039498318592:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 23us (671us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131033.457783:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 147 00000100:00080000:0.0:1789131033.457940:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789131033.457944:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789131033.457947:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789131033.457949:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789131033.489959:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789131034.037818:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131034.037922:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498318976 00000100:00100000:0.0:1789131034.037941:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498318976 00000100:00100000:0.0:1789131034.038004:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 255 00000100:00100000:0.0:1789131034.038014:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8415a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+33:12411:x1876039498318976:12345-192.168.203.11@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1789131034.038126:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8415a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+33:12411:x1876039498318976:12345-192.168.203.11@tcp:60:lhsmtool_posix.0 Request processed in 113us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131034.038155:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 255 00000100:00100000:0.0:1789131034.042615:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131034.042788:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498319104 00000100:00100000:2.0:1789131034.042799:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498319104 00000100:00100000:2.0:1789131034.042859:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 256 00000100:00100000:2.0:1789131034.042869:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd1dac3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+5:12411:x1876039498319104:12345-192.168.203.11@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1789131034.043065:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd1dac3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+5:12411:x1876039498319104:12345-192.168.203.11@tcp:60:lhsmtool_posix.0 Request processed in 196us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131034.043074:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 256 00000100:00100000:3.0:1789131034.050115:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789131034.050261:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498319360 00000100:00100000:1.0:1789131034.050271:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498319360 00000100:00100000:1.0:1789131034.050333:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 65 00000100:00100000:1.0:1789131034.050343:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8608780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+33:12411:x1876039498319360:12345-192.168.203.11@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789131034.050603:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8608780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+34:12411:x1876039498319360:12345-192.168.203.11@tcp:35:lhsmtool_posix.0 Request processed in 261us (497us total) trans 4294967522 rc 0/0 00000100:00100000:1.0:1789131034.050611:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 65 00000001:00080000:0.0:1789131034.056651:0:6479:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967522 is committed 00000020:00080000:0.0:1789131034.056695:0:6479:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff91ddc4ccf300 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:0.0:1789131034.056700:0:6479:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff91ddff410800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff91ddc4ccf840 00000020:00080000:0.0:1789131034.056703:0:6479:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff91ddff410900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff91dcc7f35200 00000020:00080000:0.0:1789131034.056733:0:6479:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:2.0:1789131034.057208:0:6532:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:2.0:1789131034.057297:0:6532:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:1.0:1789131034.057965:0:3612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5800/0xf3fe2838e1fc325e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131034.057978:0:3612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5800/0xf3fe2838e1fc325e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131034.057986:0:3612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5800/0xf3fe2838e1fc325e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131034.057993:0:3612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddfd0b5800 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:1.0:1789131034.057997:0:3612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5800/0xf3fe2838e1fc325e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131034.058024:0:3612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5800/0xf3fe2838e1fc325e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131034.058040:0:3612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff91dde1922200) 00010000:00010000:1.0:1789131034.058103:0:3612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789131034.058110:0:3612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5800/0xf3fe2838e1fc325e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131034.058117:0:3612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5800/0xf3fe2838e1fc325e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131034.195613:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd1df8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1876039508860032:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789131034.195643:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddc12a9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508860160:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789131034.195735:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131034.196038:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131034.196116:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd1daf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1876039508860544:0@lo:400:kworker.0 00000100:00100000:1.0:1789131034.196170:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131034.196209:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc6d661c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3628:1876039508861056:0@lo:400:kworker.0 00000100:00100000:2.0:1789131034.196319:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508860160 00000100:00100000:2.0:1789131034.196328:0:8418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508860160 00000100:00100000:0.0:1789131034.196332:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd1dade00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3627:1876039508860416:0@lo:400:kworker.0 00000100:00100000:1.0:1789131034.196380:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131034.196387:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508860032 00000100:00100000:2.0:1789131034.196390:0:8418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508860032 00000100:00100000:2.0:1789131034.196407:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1789131034.196416:0:8418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc12a9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508860160:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789131034.196550:0:8418:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1789131034.196601:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1789131034.196618:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd1df9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3628:x1876039508860032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789131034.196641:0:14495:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1789131034.196887:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc6d652c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3628:1876039508861568:0@lo:400:kworker.0 00000100:00100000:1.0:1789131034.197008:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131034.197643:0:11069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508860544 00000100:00100000:0.0:1789131034.198290:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131034.198295:0:11069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508860544 00000100:00100000:0.0:1789131034.198480:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc6d67c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3627:1876039508860928:0@lo:400:kworker.0 00000100:00100000:0.0:1789131034.198521:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131034.199003:0:11069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1789131034.199016:0:11069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd1dfa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3628:x1876039508860544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789131034.200081:0:11069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd1dfa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3628:x1876039508860544:12345-0@lo:400:kworker.0 Request processed in 1064us (3908us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131034.200091:0:11069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1789131034.200367:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc6d65a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3627:1876039508861440:0@lo:400:kworker.0 00000100:00100000:0.0:1789131034.200785:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131034.200889:0:8418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc12a9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508860160:12345-0@lo:13:osp-pre-1-1.0 Request processed in 4470us (5150us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131034.200900:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1789131034.201937:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd1df9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3628:x1876039508860032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 5319us (5894us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131034.201951:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00080000:0.0:1789131034.203225:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789131034.205846:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508861056 00000100:00100000:1.0:1789131034.205861:0:14273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508861056 00000100:00100000:3.0:1789131034.205951:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508861568 00000100:00100000:3.0:1789131034.205966:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508861568 00000100:00100000:1.0:1789131034.206027:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508860416 00000100:00100000:1.0:1789131034.206035:0:14273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508860416 00000100:00100000:3.0:1789131034.206042:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508860928 00000100:00100000:3.0:1789131034.206049:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508860928 00000100:00100000:3.0:1789131034.206069:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508861440 00000100:00100000:3.0:1789131034.206072:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508861440 00000100:00100000:3.0:1789131034.206097:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:3.0:1789131034.206110:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd1dfb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3628:x1876039508861056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789131034.206233:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd1dfb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3628:x1876039508861056:12345-0@lo:400:kworker.0 Request processed in 126us (9854us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131034.206259:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00100000:3.0:1789131034.206282:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00000100:00100000:3.0:1789131034.206288:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dde0b80f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3628:x1876039508861568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789131034.206322:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dde0b80f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3628:x1876039508861568:12345-0@lo:400:kworker.0 Request processed in 34us (9314us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131034.206329:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00000100:00100000:3.0:1789131034.206358:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:3.0:1789131034.206368:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc6d66580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1876039508860928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789131034.206385:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 379 00000100:00100000:1.0:1789131034.206401:0:14273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc6d670c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3627:x1876039508861440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789131034.206806:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:0.0:1789131034.206826:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc6d67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1876039508860416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789131034.206908:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc6d66580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1876039508860928:12345-0@lo:400:kworker.0 Request processed in 542us (8386us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131034.206915:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00100000:3.0:1789131034.207226:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc6d67c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3627:1876039508860928:0@lo:400:kworker.0 00000100:00100000:3.0:1789131034.207301:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd1dad2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3626:1876039508860288:0@lo:400:kworker.0 00000100:00100000:3.0:1789131034.207363:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131034.207411:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc6d66d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508860800:0@lo:400:kworker.0 00000100:00100000:3.0:1789131034.207440:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131034.207545:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc6d64780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508861312:0@lo:400:kworker.0 00000100:00100000:3.0:1789131034.208062:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131034.208098:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1789131034.208108:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd1daf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3626:1876039508860672:0@lo:400:kworker.0 00000100:00100000:3.0:1789131034.208138:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131034.208159:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc6d64b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1876039508861184:0@lo:400:kworker.0 00000100:00100000:3.0:1789131034.208183:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131034.208266:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddc12a9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508860160:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789131034.208301:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508860672 00000100:00100000:3.0:1789131034.208308:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508860672 00000100:00100000:3.0:1789131034.208359:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 381 00000100:00100000:3.0:1789131034.208369:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc12aad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1876039508860672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789131034.208417:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc12aad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1876039508860672:12345-0@lo:400:kworker.0 Request processed in 50us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131034.208425:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 381 00000100:00100000:3.0:1789131034.208454:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd1daf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3626:1876039508860672:0@lo:400:kworker.0 00000001:00080000:3.0:1789131034.209051:0:8410:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000100:00100000:3.0:1789131034.209110:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508861312 00000100:00100000:3.0:1789131034.209116:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508861312 00000100:00100000:3.0:1789131034.209153:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508861184 00000100:00100000:3.0:1789131034.209156:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508861184 00000100:00100000:3.0:1789131034.209176:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1789131034.209185:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc12a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508861312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789131034.209237:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc12a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508861312:12345-0@lo:400:kworker.0 Request processed in 53us (1176us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131034.209245:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1789131034.209256:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1789131034.209262:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc12a92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1876039508861184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789131034.209290:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc12a92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1876039508861184:12345-0@lo:400:kworker.0 Request processed in 29us (1107us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131034.209297:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1789131034.209321:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508860800 00000100:00100000:3.0:1789131034.209325:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508860800 00000100:00100000:3.0:1789131034.209416:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1789131034.209436:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc12aa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508860800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789131034.209497:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc12aa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508860800:12345-0@lo:400:kworker.0 Request processed in 63us (2056us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131034.209504:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1789131034.209542:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc6d64b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1876039508861184:0@lo:400:kworker.0 00000100:00100000:3.0:1789131034.209616:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc6d66d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508860800:0@lo:400:kworker.0 00000100:00100000:3.0:1789131034.209633:0:3626:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:3.0:1789131034.209639:0:3626:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff91ddd2869e00, transno 4294967311 00000100:00100000:3.0:1789131034.209652:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc6d64780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508861312:0@lo:400:kworker.0 00000100:00100000:3.0:1789131034.209704:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508860288 00000100:00100000:3.0:1789131034.209709:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508860288 00000100:00100000:3.0:1789131034.209748:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 459 00000100:00100000:3.0:1789131034.209756:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8607c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+24:3626:x1876039508860288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789131034.209795:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8607c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+24:3626:x1876039508860288:12345-0@lo:400:kworker.0 Request processed in 40us (2432us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131034.209801:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 459 00000100:00080000:3.0:1789131034.209837:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789131034.209843:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789131034.209846:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1789131034.209874:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc6d661c0 x1876039508861056/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789131050 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789131034.209887:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc6d661c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3628:1876039508861056:0@lo:400:kworker.0 00010000:00080000:3.0:1789131034.209902:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc6d652c0 x1876039508861568/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789131050 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789131034.209910:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc6d652c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3628:1876039508861568:0@lo:400:kworker.0 00000100:00100000:3.0:1789131034.210004:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd1daf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1876039508860544:0@lo:400:kworker.0 00000100:00100000:3.0:1789131034.210029:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd1df8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1876039508860032:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789131034.210071:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd1dad2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3626:1876039508860288:0@lo:400:kworker.0 00000100:00100000:0.0:1789131034.210430:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc6d67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1876039508860416:12345-0@lo:400:kworker.0 Request processed in 3611us (12142us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131034.210442:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00000100:00100000:3.0:1789131034.210667:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd1dade00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3627:1876039508860416:0@lo:400:kworker.0 00000001:00080000:2.0:1789131034.212038:0:9493:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967325 is committed 00000001:00080000:2.0:1789131034.212073:0:9493:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000100:00100000:1.0:1789131034.215046:0:14273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc6d670c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3627:x1876039508861440:12345-0@lo:400:kworker.0 Request processed in 8640us (14250us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131034.215069:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 379 00000100:00100000:3.0:1789131034.221641:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc6d65a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3627:1876039508861440:0@lo:400:kworker.0 00000100:00100000:2.0:1789131034.234586:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131034.234692:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498319488 00000100:00100000:2.0:1789131034.234706:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498319488 00000100:00100000:3.0:1789131034.237170:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 257 00000100:00100000:3.0:1789131034.237185:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc84170c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fde8d4a8-44db-4e6b-8249-c1c295e4901d+5:13206:x1876039498319488:12345-192.168.203.11@tcp:101:lsof.0 00010000:00010000:3.0:1789131034.237213:0:6501:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789131034.237238:0:6501:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5200/0xf3fe2838e1fc32ea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269d2a expref: -99 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131034.237321:0:6501:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5000/0xf3fe2838e1fc32f1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131034.237336:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5000/0xf3fe2838e1fc32f1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131034.237351:0:6501:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5000/0xf3fe2838e1fc32f1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789131034.237410:0:6501:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789131034.237414:0:6501:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789131034.237445:0:6501:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5000/0xf3fe2838e1fc32f1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6501 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131034.237655:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5200/0xf3fe2838e1fc32ea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269d2a expref: 7 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131034.237695:0:6501:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5000/0xf3fe2838e1fc32f1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269d2a expref: 6 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131034.237704:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91dded3a2600) 00010000:00010000:3.0:1789131034.237708:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789131034.237726:0:6501:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ddfd0b5000, rc 0) 00000100:00100000:3.0:1789131034.237812:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc84170c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fde8d4a8-44db-4e6b-8249-c1c295e4901d+6:13206:x1876039498319488:12345-192.168.203.11@tcp:101:lsof.0 Request processed in 628us (3242us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131034.238013:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 257 00010000:00010000:1.0:1789131034.515641:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789131034.706038:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc6d64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508861696:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789131034.706302:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131034.707256:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508861696 00000100:00100000:1.0:1789131034.707269:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508861696 00000100:00100000:1.0:1789131034.707500:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1789131034.707513:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc12a9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1876039508861696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789131034.707553:0:8419:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789131034.707645:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc12a9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1876039508861696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 135us (1504us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131034.707653:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1789131034.707759:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc6d64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508861696:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789131035.217917:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc6d643c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1876039508861824:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789131035.218168:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131035.218607:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508861824 00000100:00100000:3.0:1789131035.218619:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508861824 00000100:00100000:3.0:1789131035.218685:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1789131035.218697:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd2869e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1876039508861824:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789131035.218736:0:14495:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789131035.218802:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd2869e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1876039508861824:12345-0@lo:13:osp-pre-0-1.0 Request processed in 107us (634us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131035.218927:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1789131035.219046:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc6d643c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1876039508861824:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1789131035.537779:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789131036.562045:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789131037.266217:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789131037.266261:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8414780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1876039508861952:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789131037.266365:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131037.269004:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508861952 00000100:00100000:0.0:1789131037.269025:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508861952 00000100:00100000:0.0:1789131037.269174:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1789131037.269187:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd286b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3628:x1876039508861952:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789131037.269268:0:6506:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789131037.269835:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd286b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3628:x1876039508861952:12345-0@lo:41:osp-pre-1-0.0 Request processed in 648us (3477us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131037.269844:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:2.0:1789131037.272771:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd286a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1876039508862080:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789131037.273032:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131037.280633:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8414780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1876039508861952:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789131037.280758:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508862080 00000100:00100000:3.0:1789131037.280769:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508862080 00000100:00100000:3.0:1789131037.285704:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1789131037.285723:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8417840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3628:x1876039508862080:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789131037.286005:0:6505:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1789131037.286147:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8417840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3628:x1876039508862080:12345-0@lo:41:osp-pre-0-1.0 Request processed in 427us (13114us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131037.286156:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1789131037.286404:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd286a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1876039508862080:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789131037.585807:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789131038.271320:0:15587:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 08:50:36 (1789131036) 00000100:00100000:2.0:1789131038.577073:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131038.577107:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131038.577125:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131038.577150:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131038.577169:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131038.577186:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131038.577206:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131038.579250:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498319744 00000100:00100000:2.0:1789131038.579264:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498319744 00000100:00100000:2.0:1789131038.579328:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498320256 00000100:00100000:2.0:1789131038.579331:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498320256 00000100:00100000:2.0:1789131038.581024:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498319872 00000100:00100000:2.0:1789131038.581035:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498319872 00000100:00100000:2.0:1789131038.581066:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498320384 00000100:00100000:2.0:1789131038.581069:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498320384 00000100:00100000:2.0:1789131038.581091:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 382 00000100:00100000:2.0:1789131038.581100:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8414000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+19:2388:x1876039498319744:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1789131038.581190:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8414000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+19:2388:x1876039498319744:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 90us (4126us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131038.581198:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 382 00000100:00100000:2.0:1789131038.581225:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 383 00000100:00100000:2.0:1789131038.581233:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8415680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fde8d4a8-44db-4e6b-8249-c1c295e4901d+6:2388:x1876039498320256:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1789131038.581264:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8415680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fde8d4a8-44db-4e6b-8249-c1c295e4901d+6:2388:x1876039498320256:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 32us (4138us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131038.581269:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 383 00000100:00100000:2.0:1789131038.581281:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 384 00000100:00100000:2.0:1789131038.581286:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8417c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+5:2388:x1876039498319872:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1789131038.581310:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8417c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+5:2388:x1876039498319872:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 23us (4140us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131038.581315:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 384 00000100:00100000:2.0:1789131038.581326:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 385 00000100:00100000:2.0:1789131038.581332:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8414b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fde8d4a8-44db-4e6b-8249-c1c295e4901d+5:2388:x1876039498320384:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1789131038.583509:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8414b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fde8d4a8-44db-4e6b-8249-c1c295e4901d+5:2388:x1876039498320384:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 2164us (6290us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131038.583523:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 385 00000100:00100000:2.0:1789131038.583566:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498320000 00000100:00100000:2.0:1789131038.583572:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498320000 00000100:00100000:2.0:1789131038.583619:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498320128 00000100:00100000:2.0:1789131038.583623:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498320128 00000100:00100000:2.0:1789131038.583649:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 150 00000100:00100000:2.0:1789131038.583657:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8414f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+5:2388:x1876039498320000:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1789131038.583881:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8414f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+5:2388:x1876039498320000:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 224us (6773us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131038.583889:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 150 00000100:00100000:3.0:1789131038.589492:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 151 00000100:00100000:3.0:1789131038.589517:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8416940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+7:2388:x1876039498320128:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1789131038.589592:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8416940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+7:2388:x1876039498320128:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 87us (12404us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131038.589600:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 151 00000100:00080000:2.0:1789131038.597234:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789131038.597242:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789131038.597245:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789131038.597248:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789131038.603799:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498319616 00000100:00100000:3.0:1789131038.603813:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498319616 00000100:00100000:3.0:1789131038.603865:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 460 00000100:00100000:3.0:1789131038.603876:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8605850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+13:2388:x1876039498319616:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1789131038.604181:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8605850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+13:2388:x1876039498319616:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 306us (27028us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131038.604190:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 460 00010000:00010000:0.0:1789131038.614633:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789131039.317629:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddc12ab840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508862208:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789131039.317709:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131039.317785:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508862208 00000100:00100000:3.0:1789131039.317792:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508862208 00000100:00100000:3.0:1789131039.317842:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1789131039.317851:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc12aa1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1876039508862208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789131039.317878:0:8419:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1789131039.317921:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc12aa1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1876039508862208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131039.317944:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1789131039.317982:0:3625:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 2 00000004:00080000:3.0:1789131039.317988:0:3625:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967325 committed transno 4294967325 00000100:00100000:3.0:1789131039.318013:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddc12ab840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508862208:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1789131039.318284:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789131039.318296:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789131039.318305:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8414780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508862336:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789131039.318335:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131039.318371:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508862336 00000100:00100000:2.0:1789131039.318375:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508862336 00000100:00100000:2.0:1789131039.318405:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1789131039.318412:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8416580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508862336:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789131039.318423:0:14495:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1789131039.318454:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8416580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508862336:12345-0@lo:13:osp-pre-1-1.0 Request processed in 42us (117us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131039.318482:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00080000:2.0:1789131039.318497:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789131039.318520:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8414780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508862336:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789131039.320148:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff7c12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3628:1876039508862592:0@lo:400:kworker.0 00000100:00100000:1.0:1789131039.320209:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131039.320243:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff7c0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3628:1876039508863104:0@lo:400:kworker.0 00000100:00100000:1.0:1789131039.320265:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131039.320288:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff7c03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3628:1876039508863616:0@lo:400:kworker.0 00000100:00100000:1.0:1789131039.320309:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131039.320332:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1789131039.320337:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd2868000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3628:1876039508862464:0@lo:400:kworker.0 00000100:00100000:1.0:1789131039.320364:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131039.320383:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff7c2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1876039508862976:0@lo:400:kworker.0 00000100:00100000:1.0:1789131039.320406:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131039.320421:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff7c21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1876039508863488:0@lo:400:kworker.0 00000100:00100000:1.0:1789131039.320442:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131039.320489:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508862592 00000100:00100000:1.0:1789131039.320495:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508862592 00000100:00100000:1.0:1789131039.320528:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508863104 00000100:00100000:1.0:1789131039.320531:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508863104 00000100:00100000:1.0:1789131039.320555:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508863616 00000100:00100000:1.0:1789131039.320558:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508863616 00000100:00100000:1.0:1789131039.320576:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:1.0:1789131039.320583:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff7c1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1876039508862592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789131039.320629:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff7c1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1876039508862592:12345-0@lo:400:kworker.0 Request processed in 46us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131039.320637:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00000100:00100000:1.0:1789131039.320652:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 387 00000100:00100000:1.0:1789131039.320659:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff7c2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3628:x1876039508863104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789131039.320721:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff7c2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3628:x1876039508863104:12345-0@lo:400:kworker.0 Request processed in 62us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131039.320728:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 387 00000100:00100000:1.0:1789131039.320740:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00000100:00100000:1.0:1789131039.320746:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff7c0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3628:x1876039508863616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789131039.320772:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff7c0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3628:x1876039508863616:12345-0@lo:400:kworker.0 Request processed in 26us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131039.320778:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00000100:00080000:1.0:1789131039.320799:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789131039.320809:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff7c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508862720:0@lo:400:kworker.0 00000100:00100000:1.0:1789131039.320835:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131039.320852:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff7c3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3625:1876039508863232:0@lo:400:kworker.0 00000100:00100000:1.0:1789131039.320871:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131039.320887:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff7c2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3625:1876039508863744:0@lo:400:kworker.0 00000100:00100000:1.0:1789131039.320906:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131039.320921:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789131039.320926:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff7c1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3625:1876039508862848:0@lo:400:kworker.0 00000100:00100000:1.0:1789131039.320943:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131039.320956:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff7c30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508863360:0@lo:400:kworker.0 00000100:00100000:1.0:1789131039.320972:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131039.320995:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508863488 00000100:00100000:1.0:1789131039.320998:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508863488 00000100:00100000:1.0:1789131039.321024:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508863360 00000100:00100000:1.0:1789131039.321027:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508863360 00000100:00100000:1.0:1789131039.321042:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1789131039.321048:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff7c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3628:x1876039508863488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789131039.321087:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff7c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3628:x1876039508863488:12345-0@lo:400:kworker.0 Request processed in 39us (643us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131039.321094:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1789131039.321105:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1789131039.321111:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01ad2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508863360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789131039.321142:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01ad2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508863360:12345-0@lo:400:kworker.0 Request processed in 31us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131039.321147:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1789131039.321167:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508863232 00000100:00100000:1.0:1789131039.321170:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508863232 00000100:00100000:1.0:1789131039.321186:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508863744 00000100:00100000:1.0:1789131039.321188:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508863744 00000100:00100000:1.0:1789131039.321199:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508862848 00000100:00100000:1.0:1789131039.321201:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508862848 00000100:00100000:1.0:1789131039.321212:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 389 00000100:00100000:1.0:1789131039.321218:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01ad0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1876039508863232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789131039.321248:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01ad0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1876039508863232:12345-0@lo:400:kworker.0 Request processed in 30us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131039.321255:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 389 00000100:00100000:1.0:1789131039.321266:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 390 00000100:00100000:1.0:1789131039.321271:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01ad1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1876039508863744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789131039.321296:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01ad1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1876039508863744:12345-0@lo:400:kworker.0 Request processed in 25us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131039.321302:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 390 00000100:00100000:1.0:1789131039.321313:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 391 00000100:00100000:1.0:1789131039.321318:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01ad0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1876039508862848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789131039.321355:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01ad0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1876039508862848:12345-0@lo:400:kworker.0 Request processed in 36us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131039.321361:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 391 00000100:00080000:1.0:1789131039.321377:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789131039.321380:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789131039.321407:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff7c21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1876039508863488:0@lo:400:kworker.0 00000100:00100000:1.0:1789131039.321419:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff7c12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3628:1876039508862592:0@lo:400:kworker.0 00000100:00100000:1.0:1789131039.321427:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff7c0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3628:1876039508863104:0@lo:400:kworker.0 00000100:00100000:1.0:1789131039.321436:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff7c03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3628:1876039508863616:0@lo:400:kworker.0 00000100:00100000:1.0:1789131039.321490:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff7c1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3625:1876039508862848:0@lo:400:kworker.0 00000100:00100000:1.0:1789131039.321499:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff7c30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508863360:0@lo:400:kworker.0 00010000:00080000:1.0:1789131039.321509:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91ddff7c3c00 x1876039508863232/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789131055 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789131039.321517:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff7c3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3625:1876039508863232:0@lo:400:kworker.0 00010000:00080000:1.0:1789131039.321526:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91ddff7c2940 x1876039508863744/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789131055 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789131039.321535:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff7c2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3625:1876039508863744:0@lo:400:kworker.0 00000100:00100000:3.0:1789131039.321685:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508862464 00000100:00100000:3.0:1789131039.321690:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508862464 00000100:00100000:3.0:1789131039.321732:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 461 00000100:00100000:3.0:1789131039.321740:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8604850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+24:3628:x1876039508862464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789131039.321781:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8604850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+24:3628:x1876039508862464:12345-0@lo:400:kworker.0 Request processed in 42us (1416us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131039.321787:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 461 00000100:00100000:3.0:1789131039.321815:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508862976 00000100:00100000:3.0:1789131039.321818:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508862976 00000100:00100000:3.0:1789131039.321841:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508862720 00000100:00100000:3.0:1789131039.321844:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508862720 00000100:00100000:3.0:1789131039.321858:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1789131039.321864:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff7c0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3628:x1876039508862976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789131039.321896:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff7c0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3628:x1876039508862976:12345-0@lo:400:kworker.0 Request processed in 32us (1488us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131039.321902:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1789131039.321913:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1789131039.321918:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01ad0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508862720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789131039.321946:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01ad0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508862720:12345-0@lo:400:kworker.0 Request processed in 28us (1110us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131039.321952:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1789131039.321999:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd2868000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3628:1876039508862464:0@lo:400:kworker.0 00000100:00100000:3.0:1789131039.322019:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff7c2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1876039508862976:0@lo:400:kworker.0 00000100:00100000:3.0:1789131039.322042:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff7c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508862720:0@lo:400:kworker.0 00010000:00010000:2.0:1789131039.635753:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789131039.825698:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc6d64f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508863872:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789131039.825765:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131039.826163:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508863872 00000100:00100000:0.0:1789131039.826171:0:8418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508863872 00000100:00100000:0.0:1789131039.826222:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1789131039.826233:0:8418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc12ab840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508863872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789131039.826261:0:8418:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789131039.826311:0:8418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc12ab840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508863872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131039.826318:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1789131039.827152:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc6d64f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508863872:0@lo:13:osp-pre-0-0.0 00000020:00080000:0.0:1789131039.830736:0:6479:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:2.0:1789131039.830797:0:6532:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:2.0:1789131039.830807:0:6532:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000100:00100000:3.0:1789131040.345320:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789131040.345343:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddc12a8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1876039508864000:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789131040.345614:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131040.346541:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508864000 00000100:00100000:1.0:1789131040.346551:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508864000 00000100:00100000:1.0:1789131040.346598:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1789131040.346607:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc12a83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1876039508864000:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789131040.346629:0:8419:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789131040.346706:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc12a83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1876039508864000:12345-0@lo:13:osp-pre-0-1.0 Request processed in 99us (1092us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131040.346714:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1789131040.347118:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddc12a8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1876039508864000:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1789131040.665277:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789131041.682346:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789131041.851338:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131041.851491:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498320640 00000100:00100000:2.0:1789131041.851500:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498320640 00000100:00100000:2.0:1789131041.851576:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 66 00000100:00100000:2.0:1789131041.851598:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc12a8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+19:13431:x1876039498320640:12345-192.168.203.11@tcp:35:umount.0 00000100:00100000:2.0:1789131041.851850:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc12a8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+20:13431:x1876039498320640:12345-192.168.203.11@tcp:35:umount.0 Request processed in 264us (520us total) trans 4294967523 rc 0/0 00000100:00100000:2.0:1789131041.851858:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 66 00000100:00080000:1.0:1789131041.851933:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789131041.855632:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131041.855887:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498320896 00000100:00100000:3.0:1789131041.855899:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498320896 00000100:00100000:3.0:1789131041.855972:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 67 00000100:00100000:3.0:1789131041.855984:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc6d67840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+20:13431:x1876039498320896:12345-192.168.203.11@tcp:35:umount.0 00000100:00100000:3.0:1789131041.856841:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc6d67840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+21:13431:x1876039498320896:12345-192.168.203.11@tcp:35:umount.0 Request processed in 855us (1219us total) trans 4294967524 rc 0/0 00000100:00100000:3.0:1789131041.856852:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 67 00000100:00100000:0.0:1789131041.860595:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131041.860712:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498321152 00000100:00100000:2.0:1789131041.860725:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498321152 00000100:00100000:2.0:1789131041.860793:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 68 00000100:00100000:2.0:1789131041.860804:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dded1d1050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+21:13431:x1876039498321152:12345-192.168.203.11@tcp:35:umount.0 00000100:00100000:2.0:1789131041.861069:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dded1d1050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+22:13431:x1876039498321152:12345-192.168.203.11@tcp:35:umount.0 Request processed in 265us (486us total) trans 4294967525 rc 0/0 00000100:00100000:2.0:1789131041.861077:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 68 00000100:00100000:0.0:1789131041.864308:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131041.864683:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498321408 00000100:00100000:3.0:1789131041.864696:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498321408 00000100:00100000:3.0:1789131041.864770:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 69 00000100:00100000:3.0:1789131041.864781:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc6d66940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+22:13431:x1876039498321408:12345-192.168.203.11@tcp:35:umount.0 00000100:00100000:3.0:1789131041.865138:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc6d66940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+23:13431:x1876039498321408:12345-192.168.203.11@tcp:35:umount.0 Request processed in 358us (843us total) trans 4294967526 rc 0/0 00000100:00100000:3.0:1789131041.865170:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 69 00000100:00100000:0.0:1789131041.875623:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131041.875680:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131041.875712:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131041.875750:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789131041.875825:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498321536 00000100:00100000:1.0:1789131041.875838:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498321536 00000100:00100000:1.0:1789131041.875921:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498322176 00000100:00100000:1.0:1789131041.875925:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498322176 00000100:00100000:1.0:1789131041.875946:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498321920 00000100:00100000:1.0:1789131041.875949:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498321920 00000100:00100000:1.0:1789131041.875968:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 21 00000100:00100000:1.0:1789131041.875979:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc6d65680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+15:2388:x1876039498321536:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789131041.875998:0:6487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789131041.876025:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91dde19aa200/0xf3fe2838e1fc222e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269861 expref: 15 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131041.876045:0:6487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789131041.876113:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc6d65680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+14:2388:x1876039498321536:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 135us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131041.876136:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 21 00000100:00100000:1.0:1789131041.876157:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 22 00000100:00100000:1.0:1789131041.876164:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc33a8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+13:2388:x1876039498322176:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789131041.876173:0:6487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789131041.876192:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91de01ad6c00/0xf3fe2838e1fc24e3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269956 expref: 13 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131041.876201:0:6487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789131041.876220:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc33a8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+12:2388:x1876039498322176:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 56us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131041.876245:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 22 00000100:00100000:1.0:1789131041.876293:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 23 00000100:00100000:1.0:1789131041.876300:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc6d67840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+11:2388:x1876039498321920:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789131041.876308:0:6487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789131041.876317:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91dcc7e37200/0xf3fe2838e1fc2171 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269822 expref: 11 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131041.876338:0:6487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789131041.876358:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc6d67840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+10:2388:x1876039498321920:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 58us (645us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131041.876364:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 23 00000100:00100000:1.0:1789131041.876390:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498322048 00000100:00100000:1.0:1789131041.876394:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498322048 00000100:00100000:1.0:1789131041.876441:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 81 00000100:00100000:1.0:1789131041.876449:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc6d64f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+7:2384:x1876039498322048:12345-192.168.203.11@tcp:9:umount.0 00000020:00000080:1.0:1789131041.876503:0:8416:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf3fe2838e1fc2855 00000020:00010000:1.0:1789131041.876512:0:8416:0:(genops.c:1921:obd_stale_export_put()) Put export ffff91de01bf9800: total 0 00000100:00080000:1.0:1789131041.876518:0:8416:0:(import.c:65:import_set_state_nolock()) ffff91de01bfb000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789131041.876573:0:8416:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:1.0:1789131041.876727:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc6d64f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+5:2384:x1876039498322048:12345-192.168.203.11@tcp:9:umount.0 Request processed in 278us (975us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131041.876734:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 81 00000020:00010000:1.0:1789131041.876757:0:6489:0:(genops.c:1907:obd_stale_export_get()) Get export ffff91de01bf9800: total 0 00010000:00010000:1.0:1789131041.876782:0:6489:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff91de01bf9800, canceled 0 locks, left on hash table 2. 00010000:00010000:1.0:1789131041.876829:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000146d23ab/0xf3fe2838e1fc32e3 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269d23 expref: 4 pid: 8416 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131041.876879:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ac7d66f9/0xf3fe2838e1fc2c14 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269b40 expref: 3 pid: 8417 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131041.876894:0:6489:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff91de01bf9800, canceled 2 locks, left on hash table 0. 00010000:00010000:1.0:1789131041.876907:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789131041.876909:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789131041.876911:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789131041.876921:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789131041.881604:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131041.882035:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498322304 00000100:00100000:3.0:1789131041.882049:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498322304 00000100:00100000:3.0:1789131041.882138:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 82 00000100:00100000:3.0:1789131041.882150:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc6d65e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+5:2384:x1876039498322304:12345-192.168.203.11@tcp:9:umount.0 00000020:00000080:3.0:1789131041.882197:0:8414:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf3fe2838e1fc25e6 00000100:00080000:3.0:1789131041.882209:0:8414:0:(import.c:65:import_set_state_nolock()) ffff91ddc2e92800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789131041.882273:0:8414:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:3.0:1789131041.882502:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc6d65e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+2:2384:x1876039498322304:12345-192.168.203.11@tcp:9:umount.0 Request processed in 354us (911us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131041.882511:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 82 00000100:00080000:1.0:1789131041.882643:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789131041.882958:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789131041.900010:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131041.900176:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498323328 00000100:00100000:2.0:1789131041.900196:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498323328 00000100:00100000:2.0:1789131041.900275:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 258 00000100:00100000:2.0:1789131041.900287:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01ad03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+23:2384:x1876039498323328:12345-192.168.203.11@tcp:39:umount.0 00000020:00000080:2.0:1789131041.900738:0:6501:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf3fe2838e1fc217f 00000020:00010000:2.0:1789131041.900760:0:6501:0:(genops.c:1921:obd_stale_export_put()) Put export ffff91dcc7ee5000: total 0 00000100:00080000:2.0:1789131041.900766:0:6501:0:(import.c:65:import_set_state_nolock()) ffff91dcc7ee0800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789131041.900795:0:6501:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000020:00010000:0.0:1789131041.900959:0:7442:0:(genops.c:1907:obd_stale_export_get()) Get export ffff91dcc7ee5000: total 0 00010000:00010000:0.0:1789131041.901033:0:7442:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff91dcc7ee5000, canceled 0 locks, left on hash table 14. 00010000:00010000:0.0:1789131041.901077:0:7442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff91ddc4c81500) 00010000:00010000:0.0:1789131041.901099:0:7442:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789131041.901112:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc7f7fe00/0xf3fe2838e1fc2bd5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269b2b expref: 22 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131041.901148:0:7442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff91ddc4c81500) 00010000:00010000:0.0:1789131041.901152:0:7442:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1789131041.901157:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5e00/0xf3fe2838e1fc2bff lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269b39 expref: 21 pid: 14851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131041.901173:0:7442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91dded3a2600) 00010000:00010000:0.0:1789131041.901176:0:7442:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789131041.901188:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5c00/0xf3fe2838e1fc2c7d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269b5c expref: 20 pid: 9769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131041.901204:0:7442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff91ddcf5ffa00) 00010000:00010000:0.0:1789131041.901207:0:7442:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789131041.901211:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6000/0xf3fe2838e1fc2561 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d26996b expref: 19 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131041.901232:0:7442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff91ddca4e4f00) 00010000:00010000:0.0:1789131041.901235:0:7442:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789131041.901239:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6e00/0xf3fe2838e1fc31c4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269cd6 expref: 18 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131041.901253:0:7442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff91ddca4e4f00) 00010000:00010000:0.0:1789131041.901255:0:7442:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789131041.901259:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7c00/0xf3fe2838e1fc32c0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269d15 expref: 17 pid: 14273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131041.901289:0:7442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff91dded3a2b00) 00010000:00010000:0.0:1789131041.901292:0:7442:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789131041.901296:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6600/0xf3fe2838e1fc28b7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269a59 expref: 16 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131041.901309:0:7442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff91ddcf5ff000) 00010000:00010000:0.0:1789131041.901312:0:7442:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789131041.901315:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7a00/0xf3fe2838e1fc2545 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269964 expref: 15 pid: 9769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131041.901343:0:7442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff91dcc7d6bf00) 00010000:00010000:0.0:1789131041.901345:0:7442:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789131041.901349:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4400/0xf3fe2838e1fc2c99 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269b63 expref: 14 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131041.901362:0:7442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff91ddc4c81500) 00010000:00010000:0.0:1789131041.901365:0:7442:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789131041.901368:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4200/0xf3fe2838e1fc2af5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269af3 expref: 13 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131041.901384:0:7442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff91ddca4e4f00) 00010000:00010000:0.0:1789131041.901387:0:7442:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1789131041.901391:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc32ce lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269d1c expref: 12 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131041.901404:0:7442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff91dded3a2b00) 00010000:00010000:0.0:1789131041.901406:0:7442:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789131041.901416:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4800/0xf3fe2838e1fc25bc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269980 expref: 11 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131041.901435:0:7442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff91dcc7d6bf00) 00010000:00010000:0.0:1789131041.901438:0:7442:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789131041.901441:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cbe00/0xf3fe2838e1fc2f86 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269c3c expref: 10 pid: 9769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131041.901792:0:7442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff91ddca4e4f00) 00010000:00010000:0.0:1789131041.901796:0:7442:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789131041.901801:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cb200/0xf3fe2838e1fc3296 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269d0e expref: 9 pid: 6500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131041.901818:0:7442:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff91dcc7ee5000, canceled 14 locks, left on hash table 0. 00010000:00010000:0.0:1789131041.901837:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789131041.901839:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789131041.901841:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789131041.902824:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01ad03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+7:2384:x1876039498323328:12345-192.168.203.11@tcp:39:umount.0 Request processed in 2534us (2824us total) trans 4294967527 rc 0/0 00000100:00100000:2.0:1789131041.902838:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 258 00000100:00100000:0.0:1789131041.915641:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789131041.916127:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498323456 00000100:00100000:1.0:1789131041.916138:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498323456 00000100:00080000:2.0:1789131041.916268:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789131041.916374:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 259 00000100:00100000:1.0:1789131041.916387:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc6d643c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+5:2384:x1876039498323456:12345-192.168.203.11@tcp:39:umount.0 00000020:00000080:1.0:1789131041.916433:0:6502:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf3fe2838e1fc2186 00000100:00080000:1.0:1789131041.916767:0:6502:0:(import.c:65:import_set_state_nolock()) ffff91dcc7871000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789131041.916805:0:6502:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1789131041.917062:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc6d643c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99c111d-b9b6-4590-88e4-9fefd4d4c3a4+3:2384:x1876039498323456:12345-192.168.203.11@tcp:39:umount.0 Request processed in 675us (1433us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1789131041.917072:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 259 00010000:00010000:2.0:1789131041.917237:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789131042.324066:0:14478:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789131042.387344:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789131042.387385:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc84152c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1876039508864128:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789131042.387520:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131042.389490:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508864128 00000100:00100000:2.0:1789131042.389503:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508864128 00000100:00100000:2.0:1789131042.389581:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1789131042.389593:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc6d64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1876039508864128:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789131042.389649:0:6505:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789131042.389755:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc6d64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1876039508864128:12345-0@lo:41:osp-pre-1-0.0 Request processed in 164us (2235us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131042.389974:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1789131042.390047:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc84152c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1876039508864128:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789131042.391231:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01ad1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508864256:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789131042.391300:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131042.398129:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508864256 00000100:00100000:2.0:1789131042.398151:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508864256 00000100:00100000:2.0:1789131042.398234:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1789131042.398247:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc6d65a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508864256:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789131042.398302:0:6506:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1789131042.398430:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc6d65a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508864256:12345-0@lo:41:osp-pre-0-1.0 Request processed in 185us (7129us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131042.398439:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1789131042.398725:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01ad1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508864256:0@lo:41:osp-pre-0-1.0 00000040:00080000:2.0:1789131042.585061:0:14475:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789131042.585074:0:14475:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789131042.585203:0:14475:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:2.0:1789131042.585213:0:14475:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1789131042.705857:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789131043.064593:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131043.064737:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789131043.064928:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498323584 00000100:00100000:2.0:1789131043.064939:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498323712 00000100:00100000:1.0:1789131043.064942:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498323584 00000100:00100000:2.0:1789131043.064947:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498323712 00000100:00100000:2.0:1789131043.065035:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 24 00000100:00100000:1.0:1789131043.065054:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 25 00000100:00100000:2.0:1789131043.065059:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc6d661c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+11:2387:x1876039498323712:12345-192.168.203.11@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1789131043.065068:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc6d652c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+11:2387:x1876039498323584:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789131043.065079:0:8431:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789131043.065080:0:6487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789131043.065106:0:8431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91dde19ab400/0xf3fe2838e1fc2289 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d2698a7 expref: 11 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131043.065110:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91dcc7e36400/0xf3fe2838e1fc2282 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269876 expref: 11 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131043.065133:0:8431:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789131043.065134:0:6487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789131043.066281:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc6d652c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+9:2387:x1876039498323584:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 1200us (1688us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131043.066294:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 25 00000100:00100000:2.0:1789131043.066605:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc6d661c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+8:2387:x1876039498323712:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 1549us (1865us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131043.066627:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 24 00000100:00100000:0.0:1789131043.068162:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131043.068223:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498323840 00000100:00100000:2.0:1789131043.068234:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498323840 00000100:00100000:2.0:1789131043.068297:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 26 00000100:00100000:2.0:1789131043.068306:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc6d64780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+8:2388:x1876039498323840:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789131043.068327:0:6485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789131043.068348:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91dcc85cb000/0xf3fe2838e1fc24dc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d26994f expref: 8 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131043.068365:0:6485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789131043.068415:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc6d64780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+7:2388:x1876039498323840:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 109us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131043.068423:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 26 00000100:00100000:1.0:1789131043.074282:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131043.074552:0:14851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498324096 00000100:00100000:3.0:1789131043.074566:0:14851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498324096 00000100:00080000:1.0:1789131043.075419:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789131043.075421:0:14851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 260 00000100:00100000:2.0:1789131043.075435:0:14851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01ad0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fde8d4a8-44db-4e6b-8249-c1c295e4901d+6:2384:x1876039498324096:12345-192.168.203.11@tcp:39:umount.0 00000020:00000080:2.0:1789131043.076139:0:14851:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf3fe2838e1fc2297 00000020:00010000:2.0:1789131043.076154:0:14851:0:(genops.c:1921:obd_stale_export_put()) Put export ffff91dcc78a1000: total 0 00000100:00080000:2.0:1789131043.076160:0:14851:0:(import.c:65:import_set_state_nolock()) ffff91dcc78a2000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789131043.076251:0:14851:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000100:00100000:2.0:1789131043.076475:0:14851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01ad0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fde8d4a8-44db-4e6b-8249-c1c295e4901d+5:2384:x1876039498324096:12345-192.168.203.11@tcp:39:umount.0 Request processed in 1023us (2255us total) trans 4294967528 rc 0/0 00000100:00100000:2.0:1789131043.076487:0:14851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 260 00000020:00010000:0.0:1789131043.076593:0:7442:0:(genops.c:1907:obd_stale_export_get()) Get export ffff91dcc78a1000: total 0 00010000:00010000:0.0:1789131043.076615:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789131043.076744:0:7442:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff91dcc78a1000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1789131043.076846:0:7442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91dded3a2600) 00010000:00010000:0.0:1789131043.076851:0:7442:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789131043.076861:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5000/0xf3fe2838e1fc32f1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269d2a expref: 4 pid: 6501 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131043.076889:0:7442:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff91dcc78a1000, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1789131043.076901:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789131043.076903:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789131043.076905:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789131043.087536:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131043.088096:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498324224 00000100:00100000:2.0:1789131043.088111:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498324224 00000100:00080000:1.0:1789131043.088520:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789131043.088601:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 261 00000100:00100000:2.0:1789131043.088616:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01ad3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fde8d4a8-44db-4e6b-8249-c1c295e4901d+5:2384:x1876039498324224:12345-192.168.203.11@tcp:39:umount.0 00000020:00000080:2.0:1789131043.088708:0:6501:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf3fe2838e1fc229e 00000100:00080000:2.0:1789131043.088721:0:6501:0:(import.c:65:import_set_state_nolock()) ffff91dcc78a5000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789131043.088754:0:6501:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:2.0:1789131043.089054:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01ad3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fde8d4a8-44db-4e6b-8249-c1c295e4901d+3:2384:x1876039498324224:12345-192.168.203.11@tcp:39:umount.0 Request processed in 442us (1530us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1789131043.089064:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 261 00010000:00010000:1.0:1789131043.090691:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789131043.129624:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131043.129837:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498324480 00000100:00100000:0.0:1789131043.129850:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498324480 00000100:00100000:0.0:1789131043.129991:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 462 00000100:00100000:0.0:1789131043.130004:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8604050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+7:2384:x1876039498324480:12345-192.168.203.11@tcp:251:umount.0 00000020:00000080:0.0:1789131043.130063:0:6493:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf3fe2838e1fc215c 00000020:00010000:0.0:1789131043.130073:0:6493:0:(genops.c:1921:obd_stale_export_put()) Put export ffff91dcc78a5800: total 0 00000100:00080000:0.0:1789131043.130081:0:6493:0:(import.c:65:import_set_state_nolock()) ffff91dcc78a6800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1789131043.130181:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8604050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6+3:2384:x1876039498324480:12345-192.168.203.11@tcp:251:umount.0 Request processed in 179us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131043.130190:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 462 00000020:00010000:2.0:1789131043.130944:0:6488:0:(genops.c:1907:obd_stale_export_get()) Get export ffff91dcc78a5800: total 0 00010000:00010000:2.0:1789131043.131029:0:6488:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff91dcc78a5800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1789131043.131080:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91dde19abe00/0xf3fe2838e1fc2235 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269868 expref: 2 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131043.131099:0:6488:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff91dcc78a5800, canceled 1 locks, left on hash table 0. 00000020:00000080:2.0:1789131043.131113:0:6488:0:(genops.c:885:class_export_put()) final put ffff91dcc78a5800/dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6 00010000:00010000:2.0:1789131043.131171:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131043.131174:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131043.131177:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789131043.131378:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff91dcc78a5800/dbd36dd7-fbbe-42ed-8d85-f45a30ae6ed6 for MGS 00000020:00000080:0.0:1789131043.131542:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff91dcc78a6800 for MGS 00010000:00010000:0.0:1789131043.730551:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789131044.433680:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddc12a9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508864384:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789131044.433773:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131044.433877:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508864384 00000100:00100000:3.0:1789131044.433885:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508864384 00000100:00100000:3.0:1789131044.433959:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1789131044.433971:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc12abc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508864384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789131044.434008:0:14495:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1789131044.434061:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc12abc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508864384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131044.434069:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00080000:3.0:1789131044.434308:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789131044.434372:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddc12a9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508864384:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789131044.437835:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc84152c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508864512:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789131044.437929:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131044.438029:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508864512 00000100:00100000:2.0:1789131044.438038:0:8418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508864512 00000100:00100000:2.0:1789131044.438106:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1789131044.438116:0:8418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8414780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508864512:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789131044.438143:0:8418:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1789131044.438191:0:8418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8414780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508864512:12345-0@lo:13:osp-pre-1-1.0 Request processed in 76us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131044.438199:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00080000:2.0:1789131044.438234:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789131044.438298:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc84152c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508864512:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789131044.438385:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc84152c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3628:1876039508864640:0@lo:400:kworker.0 00000100:00100000:3.0:1789131044.438426:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131044.438443:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7d992c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3625:1876039508864768:0@lo:400:kworker.0 00000100:00100000:3.0:1789131044.438482:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8608780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1876039508865152:0@lo:400:kworker.0 00000100:00100000:2.0:1789131044.438495:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131044.438507:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131044.438515:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7ffcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3625:1876039508865280:0@lo:400:kworker.0 00000100:00100000:3.0:1789131044.438525:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7ffc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1876039508865664:0@lo:400:kworker.0 00000100:00100000:2.0:1789131044.438535:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131044.438547:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131044.438552:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7ffe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3625:1876039508865792:0@lo:400:kworker.0 00000100:00100000:2.0:1789131044.438572:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131044.438573:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789131044.438590:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8608000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3628:1876039508865024:0@lo:400:kworker.0 00000100:00100000:2.0:1789131044.438590:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1789131044.438595:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8609a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508864896:0@lo:400:kworker.0 00000100:00100000:3.0:1789131044.438615:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131044.438615:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131044.438633:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7ffd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3625:1876039508865408:0@lo:400:kworker.0 00000100:00100000:3.0:1789131044.440125:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7ffe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1876039508865536:0@lo:400:kworker.0 00000100:00100000:2.0:1789131044.441534:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508864768 00000100:00100000:2.0:1789131044.441550:0:14273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508864768 00000100:00100000:2.0:1789131044.441621:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508865280 00000100:00100000:2.0:1789131044.441624:0:14273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508865280 00000100:00100000:2.0:1789131044.441667:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508865792 00000100:00100000:2.0:1789131044.441671:0:14273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508865792 00000100:00100000:2.0:1789131044.441684:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508865024 00000100:00100000:2.0:1789131044.441687:0:14273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508865024 00000100:00100000:2.0:1789131044.441702:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 392 00000100:00100000:2.0:1789131044.441711:0:14273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7fff0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1876039508864768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131044.441864:0:14273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7fff0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1876039508864768:12345-0@lo:400:kworker.0 Request processed in 153us (3368us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131044.441872:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 392 00000100:00100000:2.0:1789131044.441891:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 393 00000100:00100000:2.0:1789131044.441897:0:14273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7fffc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1876039508865280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131044.441944:0:14273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7fffc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1876039508865280:12345-0@lo:400:kworker.0 Request processed in 48us (3407us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131044.441951:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 393 00000100:00100000:2.0:1789131044.441963:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 394 00000100:00100000:2.0:1789131044.441968:0:14273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7ffc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1876039508865792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131044.442071:0:14273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7ffc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1876039508865792:12345-0@lo:400:kworker.0 Request processed in 103us (3498us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131044.442079:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 394 00000100:00100000:2.0:1789131044.442090:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 395 00000100:00100000:2.0:1789131044.442096:0:14273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc12a8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3628:x1876039508865024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131044.442124:0:14273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc12a8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3628:x1876039508865024:12345-0@lo:400:kworker.0 Request processed in 29us (3509us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131044.442130:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 395 00000100:00100000:2.0:1789131044.442163:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508865152 00000100:00100000:2.0:1789131044.442167:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508865152 00000100:00100000:2.0:1789131044.442201:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508864896 00000100:00100000:2.0:1789131044.442205:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508864896 00000100:00100000:2.0:1789131044.442218:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1789131044.442226:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131044.442303:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8608000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3628:1876039508865024:0@lo:400:kworker.0 00000100:00100000:3.0:1789131044.442341:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508864640 00000100:00100000:3.0:1789131044.442345:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508864640 00000100:00100000:3.0:1789131044.442377:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 463 00000100:00100000:3.0:1789131044.442383:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8606850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+24:3628:x1876039508864640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789131044.442423:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8606850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+24:3628:x1876039508864640:12345-0@lo:400:kworker.0 Request processed in 40us (3996us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131044.442430:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 463 00000100:00100000:3.0:1789131044.442494:0:11069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1789131044.442501:0:11069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7ffda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508864896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789131044.442538:0:11069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7ffda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508864896:12345-0@lo:400:kworker.0 Request processed in 38us (3922us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131044.442544:0:11069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1789131044.442574:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508865664 00000100:00100000:3.0:1789131044.442590:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508865664 00000100:00100000:3.0:1789131044.442619:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508865536 00000100:00100000:3.0:1789131044.442622:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508865536 00000100:00100000:3.0:1789131044.442658:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1789131044.442666:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc12a8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3628:x1876039508865664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789131044.442703:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc12a8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3628:x1876039508865664:12345-0@lo:400:kworker.0 Request processed in 38us (4154us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131044.442710:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1789131044.442721:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1789131044.442728:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd28692c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3628:x1876039508865536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789131044.442765:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd28692c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3628:x1876039508865536:12345-0@lo:400:kworker.0 Request processed in 37us (2582us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131044.442771:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1789131044.442813:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7ffe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1876039508865536:0@lo:400:kworker.0 00000100:00100000:3.0:1789131044.442825:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7ffc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1876039508865664:0@lo:400:kworker.0 00000100:00100000:3.0:1789131044.442834:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc84152c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3628:1876039508864640:0@lo:400:kworker.0 00000100:00100000:1.0:1789131044.443784:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131044.443870:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7ffde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3625:1876039508865920:0@lo:400:kworker.0 00000100:00100000:1.0:1789131044.443916:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131044.445566:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc12a9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3628:x1876039508865152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131044.445712:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc12a9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3628:x1876039508865152:12345-0@lo:400:kworker.0 Request processed in 3486us (7203us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131044.445723:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00080000:1.0:1789131044.450033:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789131044.450048:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789131044.450111:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7d992c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3625:1876039508864768:0@lo:400:kworker.0 00000100:00100000:1.0:1789131044.450131:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7ffcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3625:1876039508865280:0@lo:400:kworker.0 00000100:00100000:1.0:1789131044.450143:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7ffe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3625:1876039508865792:0@lo:400:kworker.0 00000100:00100000:3.0:1789131044.450882:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508865408 00000100:00100000:3.0:1789131044.450893:0:14273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508865408 00000100:00100000:3.0:1789131044.450981:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508865920 00000100:00100000:3.0:1789131044.450985:0:14273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508865920 00000100:00100000:3.0:1789131044.451013:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 396 00000100:00100000:3.0:1789131044.451024:0:14273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01ad1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1876039508865408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789131044.451132:0:14273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01ad1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1876039508865408:12345-0@lo:400:kworker.0 Request processed in 109us (7351us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131044.451140:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 396 00000100:00100000:3.0:1789131044.451180:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 397 00000100:00100000:3.0:1789131044.451197:0:14273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01ad30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1876039508865920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789131044.451350:0:14273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01ad30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1876039508865920:12345-0@lo:400:kworker.0 Request processed in 164us (7432us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131044.451357:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 397 00000100:00100000:2.0:1789131044.451666:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8608780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1876039508865152:0@lo:400:kworker.0 00000100:00080000:0.0:1789131044.451855:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789131044.456712:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8609a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508864896:0@lo:400:kworker.0 00010000:00080000:0.0:1789131044.457073:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc7ffd680 x1876039508865408/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789131060 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789131044.457087:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7ffd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3625:1876039508865408:0@lo:400:kworker.0 00010000:00080000:0.0:1789131044.457121:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc7ffde00 x1876039508865920/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789131060 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789131044.457130:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7ffde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3625:1876039508865920:0@lo:400:kworker.0 00000020:01000004:2.0:1789131044.516601:0:15782:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1789131044.536230:0:15782:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1789131044.536300:0:15782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff91dde19ab200/0xf3fe2838e1fc2204 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc220b expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131044.536315:0:15782:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff91dde19ab200/0xf3fe2838e1fc2204 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3fe2838e1fc220b expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131044.536342:0:15782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff91dde19ab200/0xf3fe2838e1fc2204 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xf3fe2838e1fc220b expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131044.536349:0:15782:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.111@tcp lock: ffff91dde19ab200/0xf3fe2838e1fc2204 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xf3fe2838e1fc220b expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131044.536368:0:15782:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1789131044.536374:0:15782:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:1.0:1789131044.536403:0:6489:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789131044.536409:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff91dde19ab200/0xf3fe2838e1fc2204 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xf3fe2838e1fc220b expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131044.536417:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dde19ab200 already unused, calling callback (ffffffffc124bc20) 10000000:00010000:1.0:1789131044.536420:0:6489:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff91dde19ab200/0xf3fe2838e1fc2204 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xf3fe2838e1fc220b expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131044.536429:0:6489:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff91dde19ab200/0xf3fe2838e1fc2204 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xf3fe2838e1fc220b expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789131044.536437:0:6489:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff91dde19ab200/0xf3fe2838e1fc2204 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xf3fe2838e1fc220b expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789131044.536443:0:6489:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789131044.536446:0:6489:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1789131044.536448:0:6489:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1789131044.536523:0:6489:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff91dde19ab200/0xf3fe2838e1fc2204 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xf3fe2838e1fc220b expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131044.536928:0:6489:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789131044.536979:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff91dde19ab200/0xf3fe2838e1fc2204 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xf3fe2838e1fc220b expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131044.536988:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff91dde19ab200/0xf3fe2838e1fc2204 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xf3fe2838e1fc220b expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131044.537000:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789131044.537003:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789131044.537005:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789131044.537020:0:15782:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789131044.537025:0:15782:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1789131044.537031:0:15782:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1789131044.537045:0:15782:0:(import.c:65:import_set_state_nolock()) ffff91ddfce32000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1789131044.538376:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01ad21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3624:1876039508866176:0@lo:39:umount.0 00000100:00100000:2.0:1789131044.538540:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789131044.538564:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01ad2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3628:1876039508866048:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789131044.538664:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131044.538676:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131044.538997:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508866048 00000100:00100000:2.0:1789131044.539006:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508866048 00000100:00100000:2.0:1789131044.539066:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789131044.539074:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7fff840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+24:3628:x1876039508866048:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789131044.539088:0:6487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789131044.539105:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91dcc7e36800/0xf3fe2838e1fc220b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf3fe2838e1fc2204 expref: 24 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131044.539118:0:6487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789131044.540728:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508866176 00000100:00100000:3.0:1789131044.540743:0:14273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508866176 00000100:00100000:3.0:1789131044.540817:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1789131044.540829:0:14273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd286a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1876039508866176:12345-0@lo:39:umount.0 00000020:00000080:3.0:1789131044.540878:0:14273:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf3fe2838e1fc1d73 00000100:00080000:3.0:1789131044.540890:0:14273:0:(import.c:65:import_set_state_nolock()) ffff91ddd0e4d800 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1789131044.540935:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789131044.540993:0:14273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd286a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+1:3624:x1876039508866176:12345-0@lo:39:umount.0 Request processed in 166us (2320us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131044.541003:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000020:00000080:3.0:1789131044.541016:0:14273:0:(genops.c:885:class_export_put()) final put ffff91ddc39da000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1789131044.541058:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff91ddc39da000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000100:00080000:1.0:1789131044.541086:0:3624:0:(import.c:65:import_set_state_nolock()) ffff91ddfce32000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1789131044.541111:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01ad21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3624:1876039508866176:0@lo:39:umount.0 00000020:00000080:3.0:1789131044.541120:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff91ddd0e4d800 for lustre-MDT0000 00000100:00080000:1.0:1789131044.541152:0:15782:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789131044.541157:0:15782:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1789131044.541172:0:15782:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:2.0:1789131044.543412:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7fff840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+23:3628:x1876039508866048:12345-0@lo:103:ldlm_bl.0 Request processed in 4330us (4744us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131044.543426:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789131044.543761:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01ad2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3628:1876039508866048:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789131044.544920:0:15782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff91dcc7e37400/0xf3fe2838e1fc2212 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc2219 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131044.545000:0:15782:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff91dcc7e37400/0xf3fe2838e1fc2212 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3fe2838e1fc2219 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131044.545009:0:15782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff91dcc7e37400/0xf3fe2838e1fc2212 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xf3fe2838e1fc2219 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131044.545016:0:15782:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.111@tcp lock: ffff91dcc7e37400/0xf3fe2838e1fc2212 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xf3fe2838e1fc2219 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131044.545055:0:15782:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789131044.545063:0:15782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff91dcc7e37800/0xf3fe2838e1fc2116 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc211d expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131044.545070:0:15782:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff91dcc7e37800/0xf3fe2838e1fc2116 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3fe2838e1fc211d expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131044.545076:0:15782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff91dcc7e37800/0xf3fe2838e1fc2116 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf3fe2838e1fc211d expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131044.545083:0:15782:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.111@tcp lock: ffff91dcc7e37800/0xf3fe2838e1fc2116 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf3fe2838e1fc211d expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131044.545098:0:15782:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789131044.545104:0:15782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7f200/0xf3fe2838e1fc2514 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc251b expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131044.545111:0:15782:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7f200/0xf3fe2838e1fc2514 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3fe2838e1fc251b expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131044.545118:0:15782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7f200/0xf3fe2838e1fc2514 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xf3fe2838e1fc251b expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131044.545124:0:15782:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7f200/0xf3fe2838e1fc2514 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xf3fe2838e1fc251b expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131044.545141:0:15782:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1789131044.545156:0:6488:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789131044.546069:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff91dcc7e37400/0xf3fe2838e1fc2212 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xf3fe2838e1fc2219 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131044.546078:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc7e37400 already unused, calling callback (ffffffffc124bc20) 10000000:00010000:1.0:1789131044.546082:0:6488:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff91dcc7e37400/0xf3fe2838e1fc2212 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xf3fe2838e1fc2219 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131044.546090:0:6488:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff91dcc7e37400/0xf3fe2838e1fc2212 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xf3fe2838e1fc2219 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789131044.546098:0:6488:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff91dcc7e37400/0xf3fe2838e1fc2212 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xf3fe2838e1fc2219 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789131044.546104:0:6488:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789131044.546106:0:6488:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:1.0:1789131044.546143:0:6488:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff91dcc7e37400/0xf3fe2838e1fc2212 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xf3fe2838e1fc2219 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131044.546150:0:6488:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789131044.546249:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff91dcc7e37400/0xf3fe2838e1fc2212 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xf3fe2838e1fc2219 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131044.546256:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff91dcc7e37400/0xf3fe2838e1fc2212 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xf3fe2838e1fc2219 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131044.546272:0:6488:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789131044.546276:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff91dcc7e37800/0xf3fe2838e1fc2116 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf3fe2838e1fc211d expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131044.546282:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc7e37800 already unused, calling callback (ffffffffc124bc20) 10000000:00010000:1.0:1789131044.546285:0:6488:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff91dcc7e37800/0xf3fe2838e1fc2116 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf3fe2838e1fc211d expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131044.546367:0:6488:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff91dcc7e37800/0xf3fe2838e1fc2116 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xf3fe2838e1fc211d expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789131044.546374:0:6488:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff91dcc7e37800/0xf3fe2838e1fc2116 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xf3fe2838e1fc211d expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789131044.546380:0:6488:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1789131044.546382:0:6488:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1789131044.546385:0:6488:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1789131044.546402:0:6488:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff91dcc7e37800/0xf3fe2838e1fc2116 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf3fe2838e1fc211d expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131044.546407:0:6488:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789131044.546428:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff91dcc7e37800/0xf3fe2838e1fc2116 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf3fe2838e1fc211d expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131044.546434:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff91dcc7e37800/0xf3fe2838e1fc2116 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf3fe2838e1fc211d expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131044.546445:0:6488:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789131044.546449:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7f200/0xf3fe2838e1fc2514 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xf3fe2838e1fc251b expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131044.546482:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc7f7f200 already unused, calling callback (ffffffffc124bc20) 00000100:00100000:0.0:1789131044.546482:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01ad2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3625:1876039508866432:0@lo:103:ldlm_bl.0 10000000:00010000:1.0:1789131044.546498:0:6488:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7f200/0xf3fe2838e1fc2514 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xf3fe2838e1fc251b expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131044.546507:0:6488:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7f200/0xf3fe2838e1fc2514 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xf3fe2838e1fc251b expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789131044.546525:0:6488:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7f200/0xf3fe2838e1fc2514 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xf3fe2838e1fc251b expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789131044.546530:0:6488:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1789131044.546533:0:6488:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1789131044.546535:0:6488:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1789131044.546553:0:6488:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7f200/0xf3fe2838e1fc2514 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xf3fe2838e1fc251b expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131044.546559:0:6488:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789131044.546567:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7f200/0xf3fe2838e1fc2514 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xf3fe2838e1fc251b expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131044.546574:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7f200/0xf3fe2838e1fc2514 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xf3fe2838e1fc251b expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131044.546586:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789131044.546588:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789131044.546590:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789131044.546597:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131044.546605:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789131044.546629:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01ad21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3627:1876039508866304:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789131044.546693:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789131044.546705:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01ad1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3625:1876039508866560:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789131044.546715:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131044.546751:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131044.546787:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508866432 00000100:00100000:1.0:1789131044.546796:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508866432 00000100:00100000:0.0:1789131044.546808:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508866304 00000100:00100000:0.0:1789131044.546817:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508866304 00000100:00100000:1.0:1789131044.546844:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508866560 00000100:00100000:1.0:1789131044.546851:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508866560 00000100:00100000:0.0:1789131044.546870:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789131044.546883:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc6d66d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+25:3625:x1876039508866432:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789131044.546900:0:6485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789131044.546921:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91dcc7e37c00/0xf3fe2838e1fc211d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf3fe2838e1fc2116 expref: 25 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131044.546938:0:6485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789131044.546942:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789131044.547050:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789131044.548287:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789131044.548316:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc33abc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+24:3627:x1876039508866304:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789131044.548333:0:6486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789131044.548361:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91dde19aac00/0xf3fe2838e1fc2219 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf3fe2838e1fc2212 expref: 24 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131044.548377:0:6486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789131044.548442:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc33abc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+23:3627:x1876039508866304:12345-0@lo:103:ldlm_bl.0 Request processed in 135us (1732us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131044.548452:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789131044.548488:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789131044.548495:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc6d64b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+22:3625:x1876039508866560:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789131044.548503:0:6486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789131044.548511:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91dcc7f7f400/0xf3fe2838e1fc251b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf3fe2838e1fc2514 expref: 22 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131044.548521:0:6486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789131044.548543:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc6d64b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+21:3625:x1876039508866560:12345-0@lo:103:ldlm_bl.0 Request processed in 49us (1797us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131044.548549:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789131044.548588:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01ad21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3627:1876039508866304:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789131044.548621:0:15782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff91ddfa939800/0xf3fe2838e1fc1cd2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc1cd9 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131044.548630:0:15782:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff91ddfa939800/0xf3fe2838e1fc1cd2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3fe2838e1fc1cd9 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131044.548646:0:15782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff91ddfa939800/0xf3fe2838e1fc1cd2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf3fe2838e1fc1cd9 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131044.548653:0:15782:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.111@tcp lock: ffff91ddfa939800/0xf3fe2838e1fc1cd2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf3fe2838e1fc1cd9 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131044.548677:0:15782:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1789131044.548682:0:15782:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:1.0:1789131044.548686:0:15782:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:1.0:1789131044.548725:0:6488:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789131044.548731:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff91ddfa939800/0xf3fe2838e1fc1cd2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf3fe2838e1fc1cd9 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131044.548739:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddfa939800 already unused, calling callback (ffffffffc124bc20) 10000000:00010000:1.0:1789131044.548742:0:6488:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff91ddfa939800/0xf3fe2838e1fc1cd2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf3fe2838e1fc1cd9 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131044.548750:0:6488:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff91ddfa939800/0xf3fe2838e1fc1cd2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xf3fe2838e1fc1cd9 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789131044.548757:0:6488:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff91ddfa939800/0xf3fe2838e1fc1cd2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xf3fe2838e1fc1cd9 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789131044.548763:0:6488:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1789131044.548765:0:6488:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1789131044.548767:0:6488:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1789131044.548789:0:6488:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff91ddfa939800/0xf3fe2838e1fc1cd2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf3fe2838e1fc1cd9 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131044.548795:0:6488:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789131044.548813:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff91ddfa939800/0xf3fe2838e1fc1cd2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf3fe2838e1fc1cd9 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131044.548820:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff91ddfa939800/0xf3fe2838e1fc1cd2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf3fe2838e1fc1cd9 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131044.548841:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789131044.548842:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789131044.548844:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789131044.548856:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01ad21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3627:1876039508866688:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789131044.548892:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131044.548932:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508866688 00000100:00100000:1.0:1789131044.551396:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508866688 00000100:00100000:1.0:1789131044.551506:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789131044.551517:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7d992c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+21:3627:x1876039508866688:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789131044.551534:0:6486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789131044.551553:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91dde19ab800/0xf3fe2838e1fc1cd9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf3fe2838e1fc1cd2 expref: 21 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131044.551572:0:6486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789131044.551585:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc6d66d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+20:3625:x1876039508866432:12345-0@lo:103:ldlm_bl.0 Request processed in 4696us (4981us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131044.551602:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789131044.551670:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7d992c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+19:3627:x1876039508866688:12345-0@lo:103:ldlm_bl.0 Request processed in 154us (2775us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131044.551680:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789131044.551770:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01ad1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3625:1876039508866560:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789131044.551771:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01ad21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3627:1876039508866688:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789131044.551803:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01ad2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3625:1876039508866432:0@lo:103:ldlm_bl.0 00000020:01000004:1.0:1789131044.551828:0:15782:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:1.0:1789131044.551835:0:15782:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:1.0:1789131044.551841:0:15782:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789131044.551847:0:15782:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000020:00080000:1.0:1789131044.551854:0:15782:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff91dcc7870800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789131044.551860:0:15782:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff91dcc1ee3800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789131044.551864:0:15782:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff91ddff54b800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789131044.551882:0:15782:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff91ddfd25a000 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294967298 stale:0 00000020:00080000:1.0:1789131044.551889:0:15782:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff91dcc78a1000 fde8d4a8-44db-4e6b-8249-c1c295e4901d 192.168.203.11@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789131044.551894:0:15782:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff91dcc7ee5000 b99c111d-b9b6-4590-88e4-9fefd4d4c3a4 192.168.203.11@tcp 6 (0 6 0) 1 0 0 0: 0000000000000000 4294967522 stale:0 00000020:00080000:1.0:1789131044.551899:0:15782:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff91ddc5724ed8) has exports, disconnecting them 00000020:00080000:1.0:1789131044.551903:0:15782:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff91dcc7870800), last request at 1789131044 00000020:00000080:1.0:1789131044.551910:0:15782:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf3fe2838e1fc2083 00000100:00080000:1.0:1789131044.551927:0:15782:0:(import.c:65:import_set_state_nolock()) ffff91dcc7874000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1789131044.551992:0:15782:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff91dcc7870800): rc 0 00000020:00000080:1.0:1789131044.551995:0:15782:0:(genops.c:885:class_export_put()) final put ffff91dcc7870800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:1.0:1789131044.552011:0:15782:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff91dcc1ee3800), last request at 1789131044 00000020:00000080:1.0:1789131044.552014:0:15782:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf3fe2838e1fc1f5d 00000100:00080000:1.0:1789131044.552020:0:15782:0:(import.c:65:import_set_state_nolock()) ffff91dcc1ee7800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1789131044.552028:0:15782:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff91dcc1ee3800): rc 0 00000020:00000080:1.0:1789131044.552030:0:15782:0:(genops.c:885:class_export_put()) final put ffff91dcc1ee3800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:1.0:1789131044.552033:0:15782:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff91ddff54b800), last request at 1789130796 00000020:00000080:1.0:1789131044.552036:0:15782:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf3fe2838e1fc1e5a 00000100:00080000:1.0:1789131044.552039:0:15782:0:(import.c:65:import_set_state_nolock()) ffff91ddff54f800 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1789131044.552050:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1789131044.552057:0:15782:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff91ddff54b800): rc 0 00000020:00000080:1.0:1789131044.552059:0:15782:0:(genops.c:885:class_export_put()) final put ffff91ddff54b800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:1.0:1789131044.552063:0:15782:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff91ddfd25a000), last request at 1789130796 00000020:00000080:1.0:1789131044.552067:0:15782:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf3fe2838e1fc1e29 00000100:00080000:1.0:1789131044.552070:0:15782:0:(import.c:65:import_set_state_nolock()) ffff91ddfd282800 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1789131044.552080:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:1.0:1789131044.552086:0:15782:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000020:00080000:1.0:1789131044.552154:0:15782:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff91ddfd25a000): rc 0 00000004:00000080:1.0:1789131044.552352:0:15782:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb3f441a3bae0 00000100:00080000:1.0:1789131044.552370:0:15782:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1789131044.552373:0:15782:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 3 00010000:00010000:0.0:1789131044.553524:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789131044.553924:0:15782:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1789131044.553968:0:15782:0:(import.c:65:import_set_state_nolock()) ffff91ddff662800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000020:00000080:3.0:1789131044.554138:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff91dcc7870800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1789131044.554201:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff91dcc1ee3800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1789131044.554236:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff91ddff54b800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1789131044.554259:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff91dcc7874000 for lustre-MDT0000 00000020:00000080:3.0:1789131044.554264:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff91dcc1ee7800 for lustre-MDT0000 00000020:00000080:3.0:1789131044.554281:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff91ddff54f800 for lustre-MDT0000 00010000:00010000:3.0:1789131044.554303:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789131044.557856:0:15782:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1789131044.557863:0:15782:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 3 00000004:00080000:1.0:1789131044.557890:0:15782:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1789131044.557966:0:15782:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1789131044.557990:0:15782:0:(import.c:65:import_set_state_nolock()) ffff91de01a0f800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1789131044.558001:0:15782:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1789131044.558004:0:15782:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 3 00000004:00080000:1.0:1789131044.558027:0:15782:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1789131044.558085:0:15782:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1789131044.558093:0:15782:0:(import.c:65:import_set_state_nolock()) ffff91dcc7876000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1789131044.558120:0:15782:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff91ddc5724ed8) has no exports 00000100:00100000:0.0:1789131044.558251:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01ad2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3624:1876039508866816:0@lo:39:umount.0 00000100:00100000:0.0:1789131044.558347:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131044.558391:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01ad1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3624:1876039508866944:0@lo:9:umount.0 00000100:00100000:0.0:1789131044.558416:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131044.558435:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01ad21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3624:1876039508867072:0@lo:9:umount.0 00000100:00100000:0.0:1789131044.558489:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131044.558532:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508866944 00000100:00100000:0.0:1789131044.558539:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508866944 00000100:00100000:0.0:1789131044.558577:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508867072 00000100:00100000:0.0:1789131044.558581:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508867072 00000100:00100000:0.0:1789131044.558603:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789131044.558611:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc6d652c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1876039508866944:12345-0@lo:9:umount.0 00000020:00000080:0.0:1789131044.558634:0:8416:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf3fe2838e1fc2005 00000100:00080000:0.0:1789131044.558652:0:8416:0:(import.c:65:import_set_state_nolock()) ffff91de01a0a000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789131044.558693:0:8416:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:0.0:1789131044.558809:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc6d652c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3624:x1876039508866944:12345-0@lo:9:umount.0 Request processed in 198us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131044.558817:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789131044.558833:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789131044.558839:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc6d661c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1876039508867072:12345-0@lo:9:umount.0 00000020:00000080:0.0:1789131044.558850:0:8416:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf3fe2838e1fc2155 00000100:00080000:0.0:1789131044.558856:0:8416:0:(import.c:65:import_set_state_nolock()) ffff91dcc7ee5800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789131044.558877:0:8416:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:0.0:1789131044.558945:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc6d661c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3624:x1876039508867072:12345-0@lo:9:umount.0 Request processed in 106us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131044.558951:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00010000:00010000:0.0:1789131044.558977:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789131044.558983:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789131044.559015:0:3624:0:(import.c:65:import_set_state_nolock()) ffff91de01a0f800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1789131044.559025:0:3624:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1789131044.559027:0:3624:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789131044.559031:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01ad1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3624:1876039508866944:0@lo:9:umount.0 00000100:00080000:0.0:1789131044.559043:0:3624:0:(import.c:65:import_set_state_nolock()) ffff91dcc7876000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1789131044.559046:0:3624:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1789131044.559047:0:3624:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789131044.559049:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01ad21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3624:1876039508867072:0@lo:9:umount.0 00000100:00100000:1.0:1789131044.559210:0:11069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508866816 00000100:00100000:1.0:1789131044.559215:0:11069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508866816 00000100:00100000:1.0:1789131044.559251:0:11069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1789131044.559257:0:11069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc6d67840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1876039508866816:12345-0@lo:39:umount.0 00000020:00000080:1.0:1789131044.559275:0:11069:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf3fe2838e1fc1eb5 00000100:00080000:1.0:1789131044.559280:0:11069:0:(import.c:65:import_set_state_nolock()) ffff91ddc574a000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789131044.559310:0:11069:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:1.0:1789131044.559420:0:11069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc6d67840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+3:3624:x1876039508866816:12345-0@lo:39:umount.0 Request processed in 162us (1072us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1789131044.559427:0:11069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00080000:0.0:1789131044.559728:0:3624:0:(import.c:65:import_set_state_nolock()) ffff91ddff662800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1789131044.559737:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01ad2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3624:1876039508866816:0@lo:39:umount.0 00010000:00010000:0.0:1789131044.565168:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1789131044.592735:0:15782:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff91ddc5724ed8) has no exports 00000020:00000080:3.0:1789131044.670286:0:15782:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf3fe2838e1fc1d2d 00000020:00000080:3.0:1789131044.670388:0:15782:0:(genops.c:885:class_export_put()) final put ffff91ddfce04000/lustre-QMT0000_UUID 00000020:01000000:3.0:1789131044.670407:0:15782:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1789131044.670503:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff91ddfce04000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1789131044.672848:0:15782:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789131044.672863:0:15782:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789131044.672868:0:15782:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff91ddfcdf9a48) has no exports 00000020:00000080:0.0:1789131044.673243:0:15782:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf3fe2838e1fc1d26 00000020:00000080:0.0:1789131044.673253:0:15782:0:(genops.c:885:class_export_put()) final put ffff91ddfce05800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1789131044.673374:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff91ddfce05800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789131044.673451:0:15782:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789131044.675662:0:15782:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1789131044.675673:0:15782:0:(genops.c:885:class_export_put()) final put ffff91ddd0e4a000/lustre-QMT0000_UUID 00000020:00000080:0.0:1789131044.675678:0:15782:0:(genops.c:844:class_export_destroy()) destroying export ffff91ddd0e4a000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1789131044.675689:0:15782:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00010000:00010000:0.0:1789131044.753621:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789131045.457705:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789131045.457742:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd286a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508867200:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789131045.457821:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131045.458066:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508867200 00000100:00100000:3.0:1789131045.458074:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508867200 00000100:00100000:3.0:1789131045.458120:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1789131045.458129:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01ad21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508867200:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789131045.458155:0:8419:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789131045.458209:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01ad21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508867200:12345-0@lo:13:osp-pre-0-1.0 Request processed in 81us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131045.458217:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1789131045.458366:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd286a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508867200:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1789131045.779373:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789131046.802170:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789131047.505756:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789131047.505778:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01ad1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1876039508867328:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789131047.506167:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131047.507757:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508867328 00000100:00100000:0.0:1789131047.507769:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508867328 00000100:00100000:0.0:1789131047.508180:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1789131047.508188:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7fff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3626:x1876039508867328:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:0.0:1789131047.508197:0:6505:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1789131047.508416:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7fff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3626:x1876039508867328:12345-0@lo:41:osp-pre-0-1.0 Request processed in 226us (2248us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789131047.508424:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:02020000:2.0:1789131047.511708:0:3626:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:2.0:1789131047.530393:0:3626:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1789131047.530403:0:3626:0:(import.c:65:import_set_state_nolock()) ffff91ddff30d800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1789131047.530408:0:3626:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1789131047.562165:0:3626:0:(import.c:65:import_set_state_nolock()) ffff91ddff30d800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789131047.562178:0:3626:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 152 00000100:00080000:2.0:1789131047.562188:0:3626:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff91ddff30d800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:2.0:1789131047.562263:0:3626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91dcc7ffd2c0 x1876039508867456/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789131047.562475:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7ffd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3624:1876039508867456:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1789131047.562544:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131047.563264:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508867456 00000100:00100000:2.0:1789131047.563273:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508867456 00000100:00100000:2.0:1789131047.563306:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1789131047.563314:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff7c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3624:x1876039508867456:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:2.0:1789131047.563330:0:6506:0:(ldlm_lib.c:1241:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1789131047.566936:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff7c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3624:x1876039508867456:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 3613us (4383us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789131047.566951:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00080000:1.0:1789131047.566982:0:3624:0:(import.c:65:import_set_state_nolock()) ffff91ddff30d800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789131047.566987:0:3624:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789131047.566991:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7ffd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3624:1876039508867456:0@lo:38:ptlrpcd_00_01.0 00010000:00010000:1.0:1789131047.826124:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789131048.035215:0:8410:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789131048.035230:0:8410:0:(genops.c:885:class_export_put()) final put ffff91de01a0a800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1789131048.035265:0:8410:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of b99c111d-b9b6-4590-88e4-9fefd4d4c3a4 00000020:00000080:0.0:1789131048.035269:0:8410:0:(genops.c:885:class_export_put()) final put ffff91ddc2e93000/b99c111d-b9b6-4590-88e4-9fefd4d4c3a4 00000001:00100000:1.0:1789131048.036028:0:6479:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1789131048.036034:0:6479:0:(genops.c:885:class_export_put()) final put ffff91ddfd25a000/lustre-MDT0001-mdtlov_UUID 00000001:00100000:1.0:1789131048.036046:0:6479:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of fde8d4a8-44db-4e6b-8249-c1c295e4901d 00000001:00080000:1.0:1789131048.036057:0:6479:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967528 is committed 00000020:00000080:1.0:1789131048.036060:0:6479:0:(genops.c:885:class_export_put()) final put ffff91dcc78a1000/fde8d4a8-44db-4e6b-8249-c1c295e4901d 00000001:00100000:1.0:1789131048.036071:0:6479:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of b99c111d-b9b6-4590-88e4-9fefd4d4c3a4 00000001:00080000:1.0:1789131048.036075:0:6479:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00000080:1.0:1789131048.036082:0:6479:0:(genops.c:885:class_export_put()) final put ffff91dcc7ee5000/b99c111d-b9b6-4590-88e4-9fefd4d4c3a4 00000001:00100000:0.0:1789131048.036229:0:7432:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1789131048.036239:0:7432:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967301 is committed 00000020:00000080:0.0:1789131048.036243:0:7432:0:(genops.c:885:class_export_put()) final put ffff91ddc5702800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1789131048.036253:0:7432:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of fde8d4a8-44db-4e6b-8249-c1c295e4901d 00000001:00080000:0.0:1789131048.036258:0:7432:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967300 is committed 00000020:00000080:0.0:1789131048.036269:0:7432:0:(genops.c:885:class_export_put()) final put ffff91dcc78a6000/fde8d4a8-44db-4e6b-8249-c1c295e4901d 00000001:00100000:0.0:1789131048.036276:0:7432:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of b99c111d-b9b6-4590-88e4-9fefd4d4c3a4 00000001:00080000:0.0:1789131048.036282:0:7432:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967299 is committed 00000020:00000080:0.0:1789131048.036284:0:7432:0:(genops.c:885:class_export_put()) final put ffff91dcc7ee0000/b99c111d-b9b6-4590-88e4-9fefd4d4c3a4 00000020:00000080:3.0:1789131048.036398:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff91de01a0a800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1789131048.036492:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff91ddc2e93000/b99c111d-b9b6-4590-88e4-9fefd4d4c3a4 for lustre-OST0000 00000020:00000080:3.0:1789131048.036520:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff91ddfd25a000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:3.0:1789131048.036542:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff91dcc78a1000/fde8d4a8-44db-4e6b-8249-c1c295e4901d for lustre-MDT0000 00000020:00000080:3.0:1789131048.036563:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff91dcc7ee5000/b99c111d-b9b6-4590-88e4-9fefd4d4c3a4 for lustre-MDT0000 00000020:00000080:3.0:1789131048.036605:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff91ddc5702800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:3.0:1789131048.036762:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff91dcc78a6000/fde8d4a8-44db-4e6b-8249-c1c295e4901d for lustre-MDT0001 00000020:00000080:3.0:1789131048.036796:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff91dcc7ee0000/b99c111d-b9b6-4590-88e4-9fefd4d4c3a4 for lustre-MDT0001 00000020:00000080:3.0:1789131048.036898:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff91de01a0a000 for lustre-OST0000 00000020:00000080:3.0:1789131048.036908:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff91ddc2e92800 for lustre-OST0000 00000020:00000080:3.0:1789131048.036913:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff91ddfd282800 for lustre-MDT0000 00000020:00000080:3.0:1789131048.036918:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff91dcc78a2000 for lustre-MDT0000 00000020:00000080:3.0:1789131048.036924:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff91dcc7ee0800 for lustre-MDT0000 00000020:00000080:3.0:1789131048.036933:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff91ddc574a000 for lustre-MDT0001 00000001:00100000:2.0:1789131048.036941:0:9493:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789131048.036949:0:9493:0:(genops.c:885:class_export_put()) final put ffff91dcc7ee6800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789131048.036953:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff91dcc78a5000 for lustre-MDT0001 00000020:00000080:3.0:1789131048.036970:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff91dcc7871000 for lustre-MDT0001 00000001:00100000:2.0:1789131048.036977:0:9493:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of b99c111d-b9b6-4590-88e4-9fefd4d4c3a4 00000020:00000080:3.0:1789131048.036978:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff91dcc7ee6800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1789131048.036984:0:9493:0:(genops.c:885:class_export_put()) final put ffff91de01bf9800/b99c111d-b9b6-4590-88e4-9fefd4d4c3a4 00000020:00000080:3.0:1789131048.037018:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff91dcc7ee5800 for lustre-OST0001 00000020:00000080:3.0:1789131048.037025:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff91de01bf9800/b99c111d-b9b6-4590-88e4-9fefd4d4c3a4 for lustre-OST0001 00000020:00000080:3.0:1789131048.037046:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff91de01bfb000 for lustre-OST0001 00010000:00010000:0.0:1789131048.849788:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789131049.554206:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789131049.554237:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc6d64780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508867584:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789131049.554326:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131049.558335:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508867584 00000100:00100000:2.0:1789131049.558354:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508867584 00000100:00100000:2.0:1789131049.558521:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1789131049.558545:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc6d66d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508867584:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789131049.558598:0:14495:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1789131049.558736:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc6d66d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508867584:12345-0@lo:13:osp-pre-1-1.0 Request processed in 200us (4405us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131049.558744:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1789131049.558828:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc6d64780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508867584:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1789131049.559127:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789131049.559133:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1789131049.559137:0:38:0:(import.c:65:import_set_state_nolock()) ffff91ddff30d800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789131049.559143:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 403 00000100:00080000:3.0:1789131049.559148:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789131049.559153:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff91ddff30d800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:3.0:1789131049.559177:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91ddd286a1c0 x1876039508867840/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789131049.559248:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc84152c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3628:1876039508867968:0@lo:400:kworker.0 00000100:00100000:3.0:1789131049.559295:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131049.559331:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd1dfbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3628:1876039508868480:0@lo:400:kworker.0 00000100:00100000:3.0:1789131049.559351:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131049.559372:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789131049.559377:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd2868000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3628:1876039508867712:0@lo:400:kworker.0 00000100:00100000:3.0:1789131049.559404:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131049.559422:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8608000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1876039508868352:0@lo:400:kworker.0 00000100:00100000:3.0:1789131049.559444:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131049.559499:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508867712 00000100:00100000:3.0:1789131049.559504:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508867712 00000100:00100000:3.0:1789131049.559563:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 464 00000100:00100000:3.0:1789131049.559589:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc8606450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+19:3628:x1876039508867712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789131049.559643:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc8606450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b+19:3628:x1876039508867712:12345-0@lo:400:kworker.0 Request processed in 60us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131049.559651:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 464 00000100:00100000:3.0:1789131049.559700:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd2868000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3628:1876039508867712:0@lo:400:kworker.0 00000100:00080000:1.0:1789131049.559900:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789131049.559915:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd286a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3624:1876039508867840:0@lo:38:kworker.0 00000100:00100000:1.0:1789131049.559953:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131049.560060:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508868352 00000100:00100000:0.0:1789131049.560065:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508868352 00000100:00100000:0.0:1789131049.560113:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1789131049.560121:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd1dad2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3628:x1876039508868352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789131049.560163:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd1dad2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3628:x1876039508868352:12345-0@lo:400:kworker.0 Request processed in 44us (719us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131049.560170:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00080000:1.0:1789131049.560288:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789131049.561982:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508867968 00000100:00100000:2.0:1789131049.562001:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508867968 00000100:00100000:2.0:1789131049.562059:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508868480 00000100:00100000:2.0:1789131049.562063:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508868480 00000100:00100000:2.0:1789131049.562125:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1789131049.562133:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd1df8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3628:x1876039508867968:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1789131049.562148:0:6502:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1789131049.562230:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd1df8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3628:x1876039508867968:12345-0@lo:400:kworker.0 Request processed in 96us (2933us total) trans 0 rc -107/-107 00000100:00100000:2.0:1789131049.562244:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1789131049.562261:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1789131049.562265:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd1dade00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3628:x1876039508868480:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1789131049.562276:0:6502:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1789131049.562305:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd1dade00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3628:x1876039508868480:12345-0@lo:400:kworker.0 Request processed in 38us (2952us total) trans 0 rc -107/-107 00000100:00100000:2.0:1789131049.562311:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1789131049.562361:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8608780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3626:1876039508868224:0@lo:400:kworker.0 00000100:00100000:2.0:1789131049.562407:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131049.562445:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1789131049.562507:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8609a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3626:1876039508868096:0@lo:400:kworker.0 00000100:00100000:2.0:1789131049.562542:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131049.562653:0:14851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508868224 00000100:00100000:1.0:1789131049.562658:0:14851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508868224 00000100:00100000:1.0:1789131049.562712:0:14851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508868096 00000100:00100000:1.0:1789131049.562715:0:14851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508868096 00000100:00100000:1.0:1789131049.562740:0:14851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 398 00000100:00100000:1.0:1789131049.562747:0:14851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7ffe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1876039508868224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789131049.562813:0:14851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7ffe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1876039508868224:12345-0@lo:400:kworker.0 Request processed in 67us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131049.562820:0:14851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 398 00000100:00100000:1.0:1789131049.562833:0:14851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1789131049.562837:0:14851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7ffcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3626:x1876039508868096:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1789131049.562842:0:14851:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1789131049.562860:0:14851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7ffcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3626:x1876039508868096:12345-0@lo:400:kworker.0 Request processed in 22us (328us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789131049.562873:0:14851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00080000:1.0:1789131049.562913:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789131049.563274:0:3626:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1789131049.563280:0:3626:0:(import.c:65:import_set_state_nolock()) ffff91ddfce36800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1789131049.563285:0:3626:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:3.0:1789131049.564835:0:11069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508867840 00000100:00100000:3.0:1789131049.564848:0:11069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508867840 00000100:00100000:3.0:1789131049.564912:0:11069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1789131049.564921:0:11069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff7c2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3624:x1876039508867840:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1789131049.564949:0:11069:0:(ldlm_lib.c:1241:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1789131049.565106:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8608000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1876039508868352:0@lo:400:kworker.0 00000100:00080000:0.0:1789131049.565143:0:3628:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1789131049.565147:0:3628:0:(import.c:65:import_set_state_nolock()) ffff91ddff54a000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1789131049.565152:0:3628:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1789131049.565164:0:3628:0:(import.c:65:import_set_state_nolock()) ffff91ddff54a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789131049.565168:0:3628:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 152 00000100:00080000:0.0:1789131049.565176:0:3628:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff91ddff54a000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:0.0:1789131049.565218:0:3628:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91dcc6d67c00 x1876039508868736/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789131049.565250:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc84152c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3628:1876039508867968:0@lo:400:kworker.0 00000100:00080000:0.0:1789131049.565265:0:3628:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1789131049.565269:0:3628:0:(import.c:65:import_set_state_nolock()) ffff91dcc7b4d800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1789131049.565273:0:3628:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1789131049.565275:0:3628:0:(import.c:65:import_set_state_nolock()) ffff91dcc7b4d800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789131049.565279:0:3628:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 194 00000100:00080000:0.0:1789131049.565283:0:3628:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff91dcc7b4d800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:0.0:1789131049.565297:0:3628:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91dcc6d64780 x1876039508868864/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789131049.565307:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd1dfbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3628:1876039508868480:0@lo:400:kworker.0 00000100:00100000:1.0:1789131049.565594:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc6d67c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3624:1876039508868736:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1789131049.565692:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131049.565745:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc6d64780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3624:1876039508868864:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1789131049.565776:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131049.565816:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508868736 00000100:00100000:1.0:1789131049.565821:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508868736 00000100:00100000:1.0:1789131049.565847:0:9769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508868864 00000100:00100000:1.0:1789131049.565857:0:9769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508868864 00000100:00100000:1.0:1789131049.565873:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1789131049.565879:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff7c2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3624:x1876039508868736:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:1.0:1789131049.565896:0:9769:0:(ldlm_lib.c:1241:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1789131049.565942:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff7c2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3624:x1876039508868736:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 62us (250us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789131049.565950:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1789131049.565971:0:9769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1789131049.565975:0:9769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff7c3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3624:x1876039508868864:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:1.0:1789131049.565987:0:9769:0:(ldlm_lib.c:1241:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1789131049.566025:0:9769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff7c3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3624:x1876039508868864:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 48us (255us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789131049.566032:0:9769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00080000:1.0:1789131049.566067:0:3624:0:(import.c:65:import_set_state_nolock()) ffff91ddff54a000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789131049.566078:0:3624:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789131049.566081:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc6d67c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3624:1876039508868736:0@lo:38:ptlrpcd_00_03.0 00000100:00080000:1.0:1789131049.566090:0:3624:0:(import.c:65:import_set_state_nolock()) ffff91dcc7b4d800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789131049.566093:0:3624:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789131049.566095:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc6d64780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3624:1876039508868864:0@lo:38:ptlrpcd_00_03.0 00000100:00080000:2.0:1789131049.587724:0:3626:0:(import.c:65:import_set_state_nolock()) ffff91ddfce36800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789131049.587737:0:3626:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 173 00000100:00080000:2.0:1789131049.587749:0:3626:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff91ddfce36800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:2.0:1789131049.587799:0:3626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91dcc7ffed00 x1876039508868992/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789131049.591413:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7ffed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3624:1876039508868992:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1789131049.591624:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131049.591905:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508868992 00000100:00100000:0.0:1789131049.591915:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508868992 00000100:00100000:0.0:1789131049.591981:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1789131049.591990:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff7c30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3624:x1876039508868992:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:0.0:1789131049.592016:0:6501:0:(ldlm_lib.c:1241:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1789131049.592138:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8609a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3626:1876039508868096:0@lo:400:kworker.0 00000100:00100000:2.0:1789131049.592155:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd1dfb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3626:1876039508868608:0@lo:400:kworker.0 00000100:00100000:2.0:1789131049.592193:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1789131049.592257:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc8608780 x1876039508868224/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789131065 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789131049.592273:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8608780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3626:1876039508868224:0@lo:400:kworker.0 00000100:00100000:2.0:1789131049.594169:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508868608 00000100:00100000:2.0:1789131049.594180:0:14273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508868608 00000100:00100000:2.0:1789131049.594275:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 399 00000100:00100000:2.0:1789131049.594290:0:14273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7ffc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1876039508868608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131049.594395:0:14273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7ffc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1876039508868608:12345-0@lo:400:kworker.0 Request processed in 108us (2197us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131049.594403:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 399 00010000:00080000:2.0:1789131049.594492:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91ddd1dfb840 x1876039508868608/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789131065 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789131049.594507:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd1dfb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3626:1876039508868608:0@lo:400:kworker.0 00000100:00080000:2.0:1789131049.597336:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789131049.619809:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff7c30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3624:x1876039508868992:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 27805us (28177us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789131049.619830:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1789131049.620728:0:11069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff7c2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3624:x1876039508867840:12345-0@lo:38:kworker.0 Request processed in 52670us (57635us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789131049.620748:0:11069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00080000:1.0:1789131049.630370:0:3624:0:(import.c:65:import_set_state_nolock()) ffff91ddfce36800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789131049.630388:0:3624:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789131049.630395:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7ffed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3624:1876039508868992:0@lo:38:ptlrpcd_00_01.0 00000100:00080000:1.0:1789131049.630415:0:3624:0:(import.c:65:import_set_state_nolock()) ffff91ddff30d800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789131049.630419:0:3624:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789131049.630422:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd286a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3624:1876039508867840:0@lo:38:kworker.0 00010000:00010000:0.0:1789131049.874290:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789131050.584254:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd1daf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1876039508869120:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789131050.584353:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131050.584668:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508869120 00000100:00100000:0.0:1789131050.584678:0:8418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508869120 00000100:00100000:0.0:1789131050.584746:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1789131050.584758:0:8418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7ffed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1876039508869120:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789131050.584799:0:8418:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789131050.584863:0:8418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7ffed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1876039508869120:12345-0@lo:13:osp-pre-0-1.0 Request processed in 106us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131050.584871:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1789131050.584979:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd1daf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1876039508869120:0@lo:13:osp-pre-0-1.0 00000020:01000000:0.0:1789131050.770951:0:15782:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff91ddff3b0f60 - data ffff91ddcf28aca8/ffff91dcc7b2a800 00000020:01000000:0.0:1789131050.771123:0:15782:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff91ddc3fd5360 - data ffff91ddcf15dd80/ffff91ddfcdf6800 00000001:00000004:1.0:1789131050.795497:0:15782:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000100:00080000:0.0:1789131050.898845:0:15782:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1789131050.898857:0:15782:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 4 00000100:00100000:0.0:1789131050.898877:0:15782:0:(client.c:3163:ptlrpc_free_committed()) @@@ free request with old gen req@ffff91de01ad2940 x1876039508866816/t4294967301(4294967301) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1789131054 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789131050.898919:0:15782:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1789131050.905736:0:15782:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1789131050.905746:0:15782:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 4 00000004:00080000:0.0:1789131050.905762:0:15782:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789131050.905765:0:15782:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1789131050.906683:0:8861:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1789131050.906691:0:8861:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:3.0:1789131050.906711:0:8861:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:0.0:1789131050.907634:0:15782:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1789131050.907640:0:15782:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 4 00000004:00080000:0.0:1789131050.907658:0:15782:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789131050.907660:0:15782:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1789131050.908615:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1789131050.908788:0:9825:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1789131050.908794:0:9825:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:2.0:1789131050.908868:0:9825:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:0.0:1789131050.912274:0:15782:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf3fe2838e1fc1cf5 00000020:00000080:0.0:1789131050.912290:0:15782:0:(genops.c:885:class_export_put()) final put ffff91ddd136b000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1789131050.912574:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff91ddd136b000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789131050.918797:0:15782:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf3fe2838e1fc1d0a 00000020:00000080:0.0:1789131050.918827:0:15782:0:(genops.c:885:class_export_put()) final put ffff91ddc574d000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1789131050.918843:0:15782:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1789131050.918849:0:15782:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789131050.918860:0:15782:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789131050.918865:0:15782:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff91ddc5720000) has no exports 00000004:01000000:0.0:1789131050.919078:0:15782:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1789131050.919089:0:15782:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf3fe2838e1fc2140 00000020:00000080:0.0:1789131050.919094:0:15782:0:(genops.c:885:class_export_put()) final put ffff91dcc7ee2800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1789131050.919099:0:15782:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1789131050.919103:0:15782:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789131050.919114:0:15782:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1789131050.919116:0:15782:0:(genops.c:1558:class_disconnect_exports()) OBD device 28 (ffff91dcc6f5b490) has no exports 00000020:00000080:0.0:1789131050.919124:0:15782:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf3fe2838e1fc2139 00000020:00000080:0.0:1789131050.919128:0:15782:0:(genops.c:885:class_export_put()) final put ffff91dcc7872800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1789131050.920002:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff91ddc574d000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:2.0:1789131050.920031:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff91dcc7ee2800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1789131050.920037:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff91dcc7872800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1789131050.924125:0:15782:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1789131050.924136:0:15782:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1789131050.924141:0:15782:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 5 00000004:00080000:0.0:1789131050.924152:0:15782:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789131050.924155:0:15782:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789131050.924275:0:15782:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789131050.924294:0:15782:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789131050.924305:0:15782:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf3fe2838e1fc1ffe 00000020:00000080:0.0:1789131050.924317:0:15782:0:(genops.c:885:class_export_put()) final put ffff91dcc6839800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789131050.930689:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff91dcc7876000 for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1789131050.930721:0:38:0:(genops.c:885:class_export_put()) final put ffff91ddff78a800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789131050.930725:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff91ddff78a800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:2.0:1789131050.930736:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1789131050.939380:0:15782:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1789131050.939627:0:15782:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789131050.939814:0:15782:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1789131050.939822:0:15782:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff91de01a04ed8) has no exports 00000020:00000080:2.0:1789131050.939824:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff91dcc6839800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1789131050.939836:0:15782:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf3fe2838e1fc1ff7 00000020:00000080:0.0:1789131050.939849:0:15782:0:(genops.c:885:class_export_put()) final put ffff91de01a0b800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1789131050.939867:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff91de01a0b800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1789131050.940979:0:15782:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1789131050.940987:0:15782:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1789131050.941006:0:15782:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 5 00000004:00080000:0.0:1789131050.941014:0:15782:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789131050.941017:0:15782:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789131050.941169:0:15782:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789131050.941181:0:15782:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:0.0:1789131050.941201:0:15782:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:0.0:1789131050.941209:0:15782:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf3fe2838e1fc1eae 00000020:00000080:0.0:1789131050.941217:0:15782:0:(genops.c:885:class_export_put()) final put ffff91ddff61a800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1789131050.941222:0:15782:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:0.0:1789131050.941227:0:15782:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789131050.941231:0:15782:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1789131050.941239:0:15782:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff91ddff718000) has no exports 00000020:00000080:0.0:1789131050.941245:0:15782:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf3fe2838e1fc1ea7 00000020:00000080:0.0:1789131050.941249:0:15782:0:(genops.c:885:class_export_put()) final put ffff91ddff663000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1789131050.941283:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff91de01a0f800 for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1789131050.941294:0:38:0:(genops.c:885:class_export_put()) final put ffff91de01a0d000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789131050.941298:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff91de01a0d000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1789131050.941309:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789131050.941999:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff91ddff61a800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:2.0:1789131050.942011:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff91ddff663000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1789131050.953588:0:15782:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:0.0:1789131050.953610:0:15782:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1789131050.953616:0:15782:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 5 00000100:00100000:0.0:1789131050.953628:0:15782:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789131050.953725:0:15782:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789131050.953747:0:15782:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789131050.953785:0:15782:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789131050.953789:0:15782:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789131050.953796:0:15782:0:(genops.c:885:class_export_put()) final put ffff91dded1e6800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789131050.953802:0:15782:0:(genops.c:844:class_export_destroy()) destroying export ffff91dded1e6800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:2.0:1789131050.953814:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff91ddff662800 for lustre-MDT0001-osp-MDT0000 00000020:01000000:0.0:1789131050.953820:0:15782:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789131050.953826:0:38:0:(genops.c:885:class_export_put()) final put ffff91ddff663800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789131050.953830:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff91ddff663800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:2.0:1789131050.953837:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789131050.954006:0:15782:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf3fe2838e1fc1d11 00000020:00000080:0.0:1789131050.954015:0:15782:0:(genops.c:885:class_export_put()) final put ffff91ddc574a800/lustre-MDD0000_UUID 00000020:01000000:0.0:1789131050.954022:0:15782:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1789131050.954027:0:15782:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789131050.954032:0:15782:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789131050.954036:0:15782:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff91ddc5721a48) has no exports 00000020:00000080:0.0:1789131050.954060:0:15782:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789131050.954073:0:15782:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1789131050.954078:0:15782:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf3fe2838e1fc1d18 00000020:00000080:0.0:1789131050.954083:0:15782:0:(genops.c:885:class_export_put()) final put ffff91ddc574b000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1789131050.954091:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff91ddc574a800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000004:0.0:1789131050.954095:0:15782:0:(tgt_mount.c:187:server_put_mount()) put mount ffff91dded7b6800 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1789131050.954098:0:38:0:(genops.c:885:class_export_put()) final put ffff91dded1e5800/lustre-MDD0000_UUID 00000020:01000004:0.0:1789131050.954100:0:15782:0:(obd_mount.c:710:lustre_put_lsi()) put ffff91dded7b6800 3 00000020:00000080:2.0:1789131050.954103:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff91dded1e5800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000004:0.0:1789131050.954106:0:15782:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff91dded7b6800 from lustre-MDT0000 00000020:01000000:2.0:1789131050.954113:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:0.0:1789131050.954136:0:15782:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789131050.954143:0:15782:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1789131050.954146:0:15782:0:(genops.c:885:class_export_put()) final put ffff91ddd136f000/lustre-MDT0000_UUID 00000020:00000080:0.0:1789131050.954149:0:15782:0:(genops.c:844:class_export_destroy()) destroying export ffff91ddd136f000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1789131050.954163:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff91ddc574b000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1789131050.954164:0:15782:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1789131050.954216:0:15782:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:0.0:1789131050.954220:0:15782:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1789131050.954224:0:15782:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1789131050.954228:0:15782:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789131050.954231:0:15782:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789131050.954239:0:15782:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff91ddcf584800 3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789131050.954246:0:15782:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff91ddd10eb490) has exports, disconnecting them 00000020:00080000:0.0:1789131050.954252:0:15782:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff91ddcf584800), last request at 1789130775 00000020:00000080:0.0:1789131050.954276:0:15782:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf3fe2838e1fc1cb6 00000020:00010000:0.0:1789131050.954281:0:15782:0:(genops.c:1921:obd_stale_export_put()) Put export ffff91ddcf584800: total 0 00000100:00080000:0.0:1789131050.954285:0:15782:0:(import.c:65:import_set_state_nolock()) ffff91ddcf585800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1789131050.954300:0:15782:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff91ddcf584800): rc 0 00000020:00080000:0.0:1789131050.954304:0:15782:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff91ddd10eb490) has no exports 00000020:00010000:2.0:1789131050.954664:0:7442:0:(genops.c:1907:obd_stale_export_get()) Get export ffff91ddcf584800: total 0 00000100:00100000:3.0:1789131050.954901:0:6493:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff91ddc3af8e00:6493] 1 exiting: rc = 0 00000100:00100000:3.0:1789131050.955017:0:6492:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff91ddc4dfa400:6492] 0 exiting: rc = 1 00000100:00100000:3.0:1789131050.955078:0:6494:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff91ddd38eb400:6494] 2 exiting: rc = 0 00000100:00100000:0.0:1789131050.955203:0:15782:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131050.955212:0:15782:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131050.955219:0:15782:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131050.955227:0:15782:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131050.955234:0:15782:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131050.955241:0:15782:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131050.955247:0:15782:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131050.955254:0:15782:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:2.0:1789131050.955264:0:7442:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff91ddcf584800, canceled 0 locks, left on hash table 13. 00000100:00100000:0.0:1789131050.955271:0:15782:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131050.955279:0:15782:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131050.955285:0:15782:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131050.955292:0:15782:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131050.955300:0:15782:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131050.955308:0:15782:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131050.955316:0:15782:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131050.955322:0:15782:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131050.955328:0:15782:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131050.955335:0:15782:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131050.955341:0:15782:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131050.955347:0:15782:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131050.955353:0:15782:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131050.955359:0:15782:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131050.955365:0:15782:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131050.955372:0:15782:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131050.955378:0:15782:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131050.955384:0:15782:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131050.955390:0:15782:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131050.955396:0:15782:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131050.955403:0:15782:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131050.955409:0:15782:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131050.955418:0:15782:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131050.955424:0:15782:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131050.955431:0:15782:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131050.955438:0:15782:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131050.955444:0:15782:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131050.955450:0:15782:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131050.955476:0:15782:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131050.955483:0:15782:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131050.955489:0:15782:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131050.955495:0:15782:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131050.955501:0:15782:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131050.955508:0:15782:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131050.955514:0:15782:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131050.955527:0:15782:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131050.955533:0:15782:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131050.955539:0:15782:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131050.955546:0:15782:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131050.955551:0:15782:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131050.955559:0:15782:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131050.955566:0:15782:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131050.955572:0:15782:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131050.955578:0:15782:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131050.955585:0:15782:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131050.955603:0:15782:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131050.955610:0:15782:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131050.955616:0:15782:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131050.955621:0:15782:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131050.955627:0:15782:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131050.955633:0:15782:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131050.955642:0:15782:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131050.955648:0:15782:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131050.955655:0:15782:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131050.955664:0:15782:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131050.955670:0:15782:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:3.0:1789131050.955733:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91ddfd0b4e00/0xf3fe2838e1fc21c5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf3fe2838e1fc21be expref: 14 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131050.955756:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91ddfd0b4000/0xf3fe2838e1fc20d7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf3fe2838e1fc20d0 expref: 13 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131050.955776:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91dcc85cbc00/0xf3fe2838e1fc24f1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf3fe2838e1fc24ea expref: 12 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131050.955817:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91ddfd0b5600/0xf3fe2838e1fc21b7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf3fe2838e1fc21b0 expref: 11 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131050.955834:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91ddc0030e00/0xf3fe2838e1fc21d3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf3fe2838e1fc21cc expref: 10 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131050.955847:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91dcc7f7f000/0xf3fe2838e1fc24ff lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf3fe2838e1fc24f8 expref: 9 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131050.955860:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91ddc0030000/0xf3fe2838e1fc21e1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf3fe2838e1fc21da expref: 8 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131050.955874:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91dcc85cb400/0xf3fe2838e1fc250d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf3fe2838e1fc2506 expref: 7 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131050.955895:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91dde19aaa00/0xf3fe2838e1fc21ef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf3fe2838e1fc21e8 expref: 6 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131050.955910:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91dcc7e36000/0xf3fe2838e1fc21fd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf3fe2838e1fc21f6 expref: 5 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131050.955923:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91ddc27e7a00/0xf3fe2838e1fc1db2 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf3fe2838e1fc1dab expref: 4 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131050.955940:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91dde19ab600/0xf3fe2838e1fc2227 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf3fe2838e1fc2220 expref: 3 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131050.955959:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91ddc27e7000/0xf3fe2838e1fc1dc0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf3fe2838e1fc1db9 expref: 2 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131050.955991:0:7442:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff91ddcf584800, canceled 13 locks, left on hash table 0. 00000020:00000080:3.0:1789131050.956023:0:7442:0:(genops.c:885:class_export_put()) final put ffff91ddcf584800/3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b 00010000:00010000:3.0:1789131050.956041:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789131050.956045:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789131050.956049:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789131050.956479:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff91ddcf584800/3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b for MGS 00000020:00000080:2.0:1789131050.956963:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff91ddcf585800 for MGS 00000020:01000000:0.0:1789131050.959943:0:15782:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff91dcc6decd20 - data ffff91ddcf35a870/ffff91dcc780ec00 00000020:01000000:0.0:1789131050.960850:0:15782:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff91ddd1e70780 - data ffff91ddd32cce58/ffff91dded1ee400 00000020:00000080:0.0:1789131050.964692:0:15782:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf3fe2838e1fc1c9a 00000020:00000080:0.0:1789131050.965955:0:15782:0:(genops.c:885:class_export_put()) final put ffff91dded00f000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1789131050.965987:0:15782:0:(tgt_mount.c:187:server_put_mount()) put mount ffff91dded7b6800 from MGS, refs=2 00000020:01000004:0.0:1789131050.965992:0:15782:0:(obd_mount.c:710:lustre_put_lsi()) put ffff91dded7b6800 2 00000020:01000004:0.0:1789131050.965995:0:15782:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff91dded7b6800 from MGS 00000020:00000080:0.0:1789131050.966032:0:15782:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789131050.966042:0:15782:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1789131050.966046:0:15782:0:(genops.c:885:class_export_put()) final put ffff91dded00b000/MGS 00000020:00000080:0.0:1789131050.966049:0:15782:0:(genops.c:844:class_export_destroy()) destroying export ffff91dded00b000/MGS for MGS 00000020:01000000:0.0:1789131050.966060:0:15782:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:00000080:2.0:1789131050.966573:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff91dded00f000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1789131050.966969:0:15782:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1789131050.966988:0:15782:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789131050.966997:0:15782:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789131050.967008:0:15782:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff91ddfce36000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789131050.967015:0:15782:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff91ddd10eced8) has exports, disconnecting them 00000020:00080000:0.0:1789131050.967021:0:15782:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff91ddfce36000), last request at 1789130776 00000020:00000080:0.0:1789131050.967028:0:15782:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf3fe2838e1fc1d65 00000020:00080000:0.0:1789131050.967043:0:15782:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff91ddfce36000): rc 0 00000020:00000080:0.0:1789131050.967049:0:15782:0:(genops.c:885:class_export_put()) final put ffff91ddfce36000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1789131050.967787:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff91ddfce36000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1789131051.001545:0:15782:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1789131051.001558:0:15782:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789131051.001564:0:15782:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1789131051.001574:0:15782:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789131051.001942:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff91ddfce32000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1789131051.002086:0:15782:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789131051.002096:0:15782:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:2.0:1789131051.002102:0:15782:0:(genops.c:885:class_export_put()) final put ffff91ddfce32800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1789131051.002107:0:15782:0:(genops.c:844:class_export_destroy()) destroying export ffff91ddfce32800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1789131051.002113:0:15782:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1789131051.002278:0:15782:0:(obd_mount.c:710:lustre_put_lsi()) put ffff91dded7b6800 1 00000020:00000080:2.0:1789131051.002286:0:15782:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf3fe2838e1fc1c8c 00000020:00000080:2.0:1789131051.002294:0:15782:0:(genops.c:885:class_export_put()) final put ffff91dded009800/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1789131051.002309:0:15782:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1789131051.002314:0:15782:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789131051.002319:0:15782:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1789131051.002324:0:15782:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff91ddd10e9a48) has no exports 00000020:00000080:3.0:1789131051.002553:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff91dded009800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1789131051.078074:0:15782:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789131051.078086:0:15782:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1789131051.078092:0:15782:0:(genops.c:885:class_export_put()) final put ffff91dded7b1800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1789131051.078097:0:15782:0:(genops.c:844:class_export_destroy()) destroying export ffff91dded7b1800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1789131051.078103:0:15782:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1789131051.078225:0:15782:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff91dded7b4800 00000020:02000400:2.0:1789131051.078289:0:15782:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:0.0:1789131051.921838:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789131052.567022:0:14478:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789131052.945900:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789131053.971912:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789131054.675721:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789131054.675741:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc6d65680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1876039508869248:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789131054.676323:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131054.676391:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508869248 00000100:00100000:0.0:1789131054.676398:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508869248 00000100:00100000:0.0:1789131054.676452:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1789131054.676477:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc6d64780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1876039508869248:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789131054.676507:0:8419:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1789131054.676549:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc6d64780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1876039508869248:12345-0@lo:13:osp-pre-1-1.0 Request processed in 89us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131054.676862:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1789131054.676919:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc6d65680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1876039508869248:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1789131054.679743:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789131054.682719:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789131054.682726:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1789131054.682745:0:8:0:(import.c:65:import_set_state_nolock()) ffff91ddff30d800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789131054.682753:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 405 00000100:00080000:2.0:1789131054.682758:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1789131054.682765:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff91ddff30d800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:2.0:1789131054.682809:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91dcc7ffde00 x1876039508869504/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789131054.682824:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789131054.682827:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1789131054.682829:0:8:0:(import.c:65:import_set_state_nolock()) ffff91ddff54a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789131054.682832:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 405 00000100:00080000:2.0:1789131054.682834:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789131054.682837:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff91ddff54a000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:2.0:1789131054.682847:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91dcc7ffd680 x1876039508869632/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789131054.682854:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789131054.682857:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1789131054.682858:0:8:0:(import.c:65:import_set_state_nolock()) ffff91ddfce36800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789131054.682861:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 405 00000100:00080000:2.0:1789131054.682863:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789131054.682866:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff91ddfce36800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:2.0:1789131054.682875:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91dcc7ffe940 x1876039508869760/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789131054.682903:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789131054.682906:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1789131054.682914:0:8:0:(import.c:65:import_set_state_nolock()) ffff91dcc7b4d800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789131054.682918:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 405 00000100:00080000:2.0:1789131054.682920:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789131054.682924:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff91dcc7b4d800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:2.0:1789131054.682936:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91dcc7ffe1c0 x1876039508870144/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789131054.682981:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7ffd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3627:1876039508870272:0@lo:400:kworker.0 00000100:00100000:2.0:1789131054.683045:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131054.683091:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789131054.683097:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7fff840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3627:1876039508869376:0@lo:400:kworker.0 00000400:00000100:2.0:1789131054.683115:0:3627:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876039508869376 offset 0 length 224: 4 00000100:00100000:1.0:1789131054.683824:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7ffde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3624:1876039508869504:0@lo:38:kworker.0 00000100:00100000:1.0:1789131054.683868:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131054.683895:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7ffd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3624:1876039508869632:0@lo:38:kworker.0 00000100:00100000:1.0:1789131054.683915:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131054.683935:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7ffe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3624:1876039508869760:0@lo:38:kworker.0 00000100:00100000:1.0:1789131054.683955:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131054.683982:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7ffe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3624:1876039508870144:0@lo:38:kworker.0 00000100:00100000:1.0:1789131054.684003:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131054.684031:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7ffcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3625:1876039508869888:0@lo:400:kworker.0 00000100:00100000:1.0:1789131054.684052:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131054.684068:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789131054.684074:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7ffc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508870016:0@lo:400:kworker.0 00000100:00100000:1.0:1789131054.684098:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131054.684138:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508870272 00000100:00100000:1.0:1789131054.684145:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508870272 00000100:00100000:2.0:1789131054.684419:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508869504 00000100:00100000:2.0:1789131054.684520:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508869504 00000100:00100000:2.0:1789131054.684551:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1789131054.684653:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff7c0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3624:x1876039508869504:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1789131054.684674:0:6505:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1789131054.684724:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff7c0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3624:x1876039508869504:12345-0@lo:38:kworker.0 Request processed in 72us (856us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789131054.684732:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1789131054.685191:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508869632 00000100:00100000:1.0:1789131054.685197:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508869632 00000100:00100000:2.0:1789131054.685366:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508869760 00000100:00100000:2.0:1789131054.685371:0:14273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508869760 00000100:00100000:2.0:1789131054.685386:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508870144 00000100:00100000:2.0:1789131054.685389:0:14273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508870144 00000100:00100000:2.0:1789131054.685397:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508869888 00000100:00100000:2.0:1789131054.685400:0:14273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508869888 00000100:00100000:2.0:1789131054.685424:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 400 00000100:00100000:2.0:1789131054.685444:0:14273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd286f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3627:x1876039508870272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131054.685530:0:14273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd286f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3627:x1876039508870272:12345-0@lo:400:kworker.0 Request processed in 88us (2484us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131054.685539:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 400 00000100:00100000:2.0:1789131054.685743:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 401 00000100:00100000:2.0:1789131054.685752:0:14273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff7c03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1876039508869888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131054.685865:0:14273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff7c03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1876039508869888:12345-0@lo:400:kworker.0 Request processed in 114us (1810us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131054.685872:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 401 00000100:00100000:2.0:1789131054.685886:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1789131054.685890:0:14273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff7c12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3624:x1876039508869632:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1789131054.685904:0:14273:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1789131054.685930:0:14273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff7c12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3624:x1876039508869632:12345-0@lo:38:kworker.0 Request processed in 38us (2013us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789131054.685935:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1789131054.685947:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1789131054.685951:0:14273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff7c21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3624:x1876039508869760:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1789131054.685960:0:14273:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1789131054.685984:0:14273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff7c21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3624:x1876039508869760:12345-0@lo:38:kworker.0 Request processed in 30us (2026us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789131054.685990:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1789131054.686001:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1789131054.686004:0:14273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff7c1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3624:x1876039508870144:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1789131054.686013:0:14273:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1789131054.686035:0:14273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff7c1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3624:x1876039508870144:12345-0@lo:38:kworker.0 Request processed in 28us (2031us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789131054.686046:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00010000:00080000:2.0:1789131054.686100:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff91dcc7ffd2c0 x1876039508870272/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789131070 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789131054.686113:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7ffd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3627:1876039508870272:0@lo:400:kworker.0 00000100:00080000:2.0:1789131054.686135:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789131054.686217:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508870016 00000100:00100000:1.0:1789131054.686231:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508870016 00000100:00100000:1.0:1789131054.686270:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1789131054.686277:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8497480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508870016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789131054.686310:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8497480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508870016:12345-0@lo:400:kworker.0 Request processed in 34us (2211us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131054.686315:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1789131054.686342:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7ffc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508870016:0@lo:400:kworker.0 00010000:00080000:1.0:1789131054.686353:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff91dcc7ffcf00 x1876039508869888/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789131070 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789131054.686361:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7ffcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3625:1876039508869888:0@lo:400:kworker.0 00000100:00080000:1.0:1789131054.686387:0:3624:0:(import.c:65:import_set_state_nolock()) ffff91ddff30d800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789131054.686392:0:3624:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789131054.686395:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7ffde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3624:1876039508869504:0@lo:38:kworker.0 00000100:00080000:1.0:1789131054.686403:0:3624:0:(import.c:65:import_set_state_nolock()) ffff91ddff54a000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789131054.686412:0:3624:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789131054.686415:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7ffd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3624:1876039508869632:0@lo:38:kworker.0 00000100:00080000:1.0:1789131054.686436:0:3624:0:(import.c:65:import_set_state_nolock()) ffff91ddfce36800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789131054.686439:0:3624:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789131054.686442:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7ffe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3624:1876039508869760:0@lo:38:kworker.0 00000100:00080000:1.0:1789131054.686450:0:3624:0:(import.c:65:import_set_state_nolock()) ffff91dcc7b4d800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789131054.686454:0:3624:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789131054.686472:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7ffe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3624:1876039508870144:0@lo:38:kworker.0 00000100:00080000:2.0:1789131054.687184:0:6495:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789131054.994394:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789131055.702915:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789131055.702929:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd286da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508870400:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789131055.702989:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131055.703041:0:14495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508870400 00000100:00100000:2.0:1789131055.703047:0:14495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508870400 00000100:00100000:2.0:1789131055.703099:0:14495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1789131055.703106:0:14495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd286f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508870400:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789131055.703133:0:14495:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789131055.703657:0:14495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd286f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508870400:12345-0@lo:13:osp-pre-0-1.0 Request processed in 547us (664us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131055.703665:0:14495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1789131055.703715:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd286da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508870400:0@lo:13:osp-pre-0-1.0 00000020:01000004:0.0:1789131055.785223:0:15984:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1789131055.818137:0:15984:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:0.0:1789131055.818190:0:15984:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff91dcc7e37a00/0xf3fe2838e1fc21e8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc21ef expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131055.818204:0:15984:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff91dcc7e37a00/0xf3fe2838e1fc21e8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3fe2838e1fc21ef expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131055.818224:0:15984:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff91dcc7e37a00/0xf3fe2838e1fc21e8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xf3fe2838e1fc21ef expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131055.818232:0:15984:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.111@tcp lock: ffff91dcc7e37a00/0xf3fe2838e1fc21e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xf3fe2838e1fc21ef expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131055.818255:0:15984:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789131055.818261:0:15984:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1789131055.818285:0:15984:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789131055.818290:0:15984:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1789131055.818295:0:15984:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1789131055.818300:0:15984:0:(import.c:65:import_set_state_nolock()) ffff91ddff54a000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:0.0:1789131055.818305:0:15984:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789131055.818306:0:15984:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1789131055.818309:0:15984:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1789131055.819240:0:15984:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff91ddc0031600/0xf3fe2838e1fc21f6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc21fd expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131055.819252:0:15984:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff91ddc0031600/0xf3fe2838e1fc21f6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3fe2838e1fc21fd expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131055.819258:0:15984:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff91ddc0031600/0xf3fe2838e1fc21f6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xf3fe2838e1fc21fd expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131055.819264:0:15984:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.111@tcp lock: ffff91ddc0031600/0xf3fe2838e1fc21f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xf3fe2838e1fc21fd expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131055.819286:0:15984:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789131055.819301:0:15984:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff91ddc27e7200/0xf3fe2838e1fc20d0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc20d7 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131055.819307:0:15984:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff91ddc27e7200/0xf3fe2838e1fc20d0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3fe2838e1fc20d7 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131055.819313:0:15984:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff91ddc27e7200/0xf3fe2838e1fc20d0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf3fe2838e1fc20d7 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131055.819319:0:15984:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.111@tcp lock: ffff91ddc27e7200/0xf3fe2838e1fc20d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf3fe2838e1fc20d7 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131055.819334:0:15984:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1789131055.819347:0:6489:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789131055.819353:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff91dcc7e37a00/0xf3fe2838e1fc21e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xf3fe2838e1fc21ef expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131055.819360:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc7e37a00 already unused, calling callback (ffffffffc124bc20) 10000000:00010000:0.0:1789131055.819363:0:6489:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff91dcc7e37a00/0xf3fe2838e1fc21e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xf3fe2838e1fc21ef expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131055.819370:0:6489:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff91dcc7e37a00/0xf3fe2838e1fc21e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xf3fe2838e1fc21ef expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789131055.819376:0:6489:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff91dcc7e37a00/0xf3fe2838e1fc21e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xf3fe2838e1fc21ef expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789131055.819381:0:6489:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789131055.819383:0:6489:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1789131055.819386:0:6489:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1789131055.819420:0:6489:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff91dcc7e37a00/0xf3fe2838e1fc21e8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xf3fe2838e1fc21ef expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131055.819432:0:6489:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789131055.819456:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff91dcc7e37a00/0xf3fe2838e1fc21e8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xf3fe2838e1fc21ef expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131055.819483:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff91dcc7e37a00/0xf3fe2838e1fc21e8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xf3fe2838e1fc21ef expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131055.819498:0:6489:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789131055.819502:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff91ddc0031600/0xf3fe2838e1fc21f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xf3fe2838e1fc21fd expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131055.819506:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddc0031600 already unused, calling callback (ffffffffc124bc20) 10000000:00010000:0.0:1789131055.819525:0:6489:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff91ddc0031600/0xf3fe2838e1fc21f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xf3fe2838e1fc21fd expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131055.819532:0:6489:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff91ddc0031600/0xf3fe2838e1fc21f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xf3fe2838e1fc21fd expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789131055.819538:0:6489:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff91ddc0031600/0xf3fe2838e1fc21f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xf3fe2838e1fc21fd expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789131055.819542:0:6489:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789131055.819544:0:6489:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 00010000:00010000:0.0:1789131055.819568:0:6489:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff91ddc0031600/0xf3fe2838e1fc21f6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xf3fe2838e1fc21fd expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131055.819574:0:6489:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789131055.819579:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff91ddc0031600/0xf3fe2838e1fc21f6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xf3fe2838e1fc21fd expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131055.819595:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff91ddc0031600/0xf3fe2838e1fc21f6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xf3fe2838e1fc21fd expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131055.819606:0:6489:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789131055.819609:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff91ddc27e7200/0xf3fe2838e1fc20d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf3fe2838e1fc20d7 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131055.819614:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddc27e7200 already unused, calling callback (ffffffffc124bc20) 10000000:00010000:0.0:1789131055.819618:0:6489:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff91ddc27e7200/0xf3fe2838e1fc20d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf3fe2838e1fc20d7 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131055.819623:0:6489:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff91ddc27e7200/0xf3fe2838e1fc20d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xf3fe2838e1fc20d7 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789131055.819629:0:6489:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff91ddc27e7200/0xf3fe2838e1fc20d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xf3fe2838e1fc20d7 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789131055.819633:0:6489:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1789131055.819635:0:6489:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1789131055.819636:0:6489:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1789131055.819650:0:6489:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff91ddc27e7200/0xf3fe2838e1fc20d0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf3fe2838e1fc20d7 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131055.819655:0:6489:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789131055.819671:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff91ddc27e7200/0xf3fe2838e1fc20d0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf3fe2838e1fc20d7 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131055.819678:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff91ddc27e7200/0xf3fe2838e1fc20d0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf3fe2838e1fc20d7 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131055.819702:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789131055.819703:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789131055.819705:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789131055.819726:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddc12aa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3626:1876039508870656:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789131055.819787:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131055.819839:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789131055.819844:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc6d67c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3626:1876039508870528:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789131055.819864:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131055.819890:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01ad12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3627:1876039508870784:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789131055.819909:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131055.819948:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508870656 00000100:00100000:0.0:1789131055.819954:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508870656 00000100:00100000:0.0:1789131055.819982:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508870528 00000100:00100000:0.0:1789131055.819984:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508870528 00000100:00100000:0.0:1789131055.819992:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508870784 00000100:00100000:0.0:1789131055.819994:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508870784 00000100:00100000:0.0:1789131055.820004:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789131055.820010:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01ad2940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3626:x1876039508870656:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1789131055.820016:0:6487:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789131055 with bad export cookie 17581534220075670710 00010000:00010000:2.0:1789131055.820889:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789131055.821547:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789131055.821555:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd1dfb840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3626:x1876039508870528:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1789131055.821571:0:8431:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789131055 with bad export cookie 17581534220075670710 00000100:00100000:2.0:1789131055.821648:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd1dfb840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3626:x1876039508870528:12345-0@lo:103:ldlm_bl.0 Request processed in 93us (1782us total) trans 0 rc -107/-107 00000100:00100000:2.0:1789131055.821656:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789131055.821689:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789131055.821694:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd1dfbc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3627:x1876039508870784:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1789131055.821699:0:8431:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789131055 with bad export cookie 17581534220075670710 00000100:00100000:2.0:1789131055.821731:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd1dfbc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3627:x1876039508870784:12345-0@lo:103:ldlm_bl.0 Request processed in 35us (1820us total) trans 0 rc -107/-107 00000100:00100000:2.0:1789131055.821736:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00010000:1.0:1789131055.822199:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789131055.822529:0:15984:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff91de01ad7200/0xf3fe2838e1fc2506 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc250d expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131055.822541:0:15984:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff91de01ad7200/0xf3fe2838e1fc2506 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3fe2838e1fc250d expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131055.822547:0:15984:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff91de01ad7200/0xf3fe2838e1fc2506 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xf3fe2838e1fc250d expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131055.822555:0:15984:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.111@tcp lock: ffff91de01ad7200/0xf3fe2838e1fc2506 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xf3fe2838e1fc250d expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131055.822585:0:15984:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789131055.822592:0:15984:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff91ddc0030c00/0xf3fe2838e1fc1db9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc1dc0 expref: -99 pid: 7430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131055.822598:0:15984:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff91ddc0030c00/0xf3fe2838e1fc1db9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3fe2838e1fc1dc0 expref: -99 pid: 7430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131055.822615:0:15984:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff91ddc0030c00/0xf3fe2838e1fc1db9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf3fe2838e1fc1dc0 expref: -99 pid: 7430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131055.822621:0:15984:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.111@tcp lock: ffff91ddc0030c00/0xf3fe2838e1fc1db9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf3fe2838e1fc1dc0 expref: -99 pid: 7430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131055.822635:0:15984:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1789131055.822639:0:15984:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 10000000:01000000:1.0:1789131055.822643:0:15984:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00010000:00010000:1.0:1789131055.822677:0:6488:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789131055.822683:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff91de01ad7200/0xf3fe2838e1fc2506 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xf3fe2838e1fc250d expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131055.822690:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91de01ad7200 already unused, calling callback (ffffffffc124bc20) 10000000:00010000:1.0:1789131055.822693:0:6488:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff91de01ad7200/0xf3fe2838e1fc2506 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xf3fe2838e1fc250d expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131055.822701:0:6488:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff91de01ad7200/0xf3fe2838e1fc2506 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xf3fe2838e1fc250d expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789131055.822708:0:6488:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff91de01ad7200/0xf3fe2838e1fc2506 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xf3fe2838e1fc250d expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789131055.822714:0:6488:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1789131055.822716:0:6488:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1789131055.822718:0:6488:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1789131055.822745:0:6488:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff91de01ad7200/0xf3fe2838e1fc2506 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xf3fe2838e1fc250d expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131055.822752:0:6488:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789131055.822775:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff91de01ad7200/0xf3fe2838e1fc2506 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xf3fe2838e1fc250d expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131055.822782:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff91de01ad7200/0xf3fe2838e1fc2506 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xf3fe2838e1fc250d expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131055.822796:0:6488:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789131055.822799:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff91ddc0030c00/0xf3fe2838e1fc1db9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf3fe2838e1fc1dc0 expref: -99 pid: 7430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131055.822805:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddc0030c00 already unused, calling callback (ffffffffc124bc20) 10000000:00010000:1.0:1789131055.822808:0:6488:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff91ddc0030c00/0xf3fe2838e1fc1db9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf3fe2838e1fc1dc0 expref: -99 pid: 7430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131055.822814:0:6488:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff91ddc0030c00/0xf3fe2838e1fc1db9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xf3fe2838e1fc1dc0 expref: -99 pid: 7430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789131055.822820:0:6488:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff91ddc0030c00/0xf3fe2838e1fc1db9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xf3fe2838e1fc1dc0 expref: -99 pid: 7430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789131055.822826:0:6488:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1789131055.822828:0:6488:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1789131055.822829:0:6488:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1789131055.822841:0:6488:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff91ddc0030c00/0xf3fe2838e1fc1db9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf3fe2838e1fc1dc0 expref: -99 pid: 7430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131055.822847:0:6488:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789131055.822856:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff91ddc0030c00/0xf3fe2838e1fc1db9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf3fe2838e1fc1dc0 expref: -99 pid: 7430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131055.822863:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff91ddc0030c00/0xf3fe2838e1fc1db9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf3fe2838e1fc1dc0 expref: -99 pid: 7430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131055.822884:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789131055.822886:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789131055.822888:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789131055.822902:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc84943c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3625:1876039508871040:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789131055.822945:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131055.822993:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508871040 00000100:00100000:1.0:1789131055.822999:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508871040 00000100:00100000:1.0:1789131055.823028:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789131055.823033:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8495680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3625:x1876039508871040:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1789131055.823038:0:8431:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789131055 with bad export cookie 17581534220075670710 00000100:00100000:1.0:1789131055.823072:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8495680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3625:x1876039508871040:12345-0@lo:103:ldlm_bl.0 Request processed in 38us (127us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789131055.823078:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:1.0:1789131055.823105:0:3625:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.111@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1789131055.823109:0:3625:0:(import.c:65:import_set_state_nolock()) ffff91ddcf581000 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1789131055.823125:0:3625:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.111@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00010000:00010000:2.0:1789131055.823181:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789131055.827920:0:3627:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.111@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00100000:0.0:1789131055.834796:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01ad2940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3626:x1876039508870656:12345-0@lo:103:ldlm_bl.0 Request processed in 14779us (15003us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789131055.834809:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000020:01000004:0.0:1789131055.834865:0:15984:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0001 00000020:01000000:0.0:1789131055.834869:0:15984:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:0.0:1789131055.834874:0:15984:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789131055.834880:0:15984:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:0.0:1789131055.834885:0:15984:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff91dcc7b4b000 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789131055.834904:0:15984:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff91dcc1ee5000 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789131055.834908:0:15984:0:(genops.c:1553:class_disconnect_exports()) OBD device 11 (ffff91ddfcdf8000) has exports, disconnecting them 00000020:00080000:0.0:1789131055.834912:0:15984:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff91dcc7b4b000), last request at 1789131054 00000020:00000080:0.0:1789131055.834918:0:15984:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf3fe2838e1fc2098 00000100:00080000:0.0:1789131055.834931:0:15984:0:(import.c:65:import_set_state_nolock()) ffff91dcc7b49800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1789131055.834972:0:15984:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff91dcc7b4b000): rc 0 00000020:00000080:0.0:1789131055.834975:0:15984:0:(genops.c:885:class_export_put()) final put ffff91dcc7b4b000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:0.0:1789131055.834986:0:15984:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff91dcc1ee5000), last request at 1789131054 00000020:00000080:0.0:1789131055.834989:0:15984:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf3fe2838e1fc1f72 00000100:00080000:0.0:1789131055.834995:0:15984:0:(import.c:65:import_set_state_nolock()) ffff91dcc1ee4000 : changing import state from FULL to CLOSED 00000020:00000080:0.0:1789131055.835008:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff91dcc7b4b000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:0.0:1789131055.835046:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff91dcc7b49800 for lustre-MDT0001 00000020:00080000:0.0:1789131055.835057:0:15984:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff91dcc1ee5000): rc 0 00000020:00000080:0.0:1789131055.835060:0:15984:0:(genops.c:885:class_export_put()) final put ffff91dcc1ee5000/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:0.0:1789131055.835070:0:15984:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffb3f441547ae0 00000020:00000080:0.0:1789131055.835080:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff91dcc1ee5000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:0.0:1789131055.835101:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff91dcc1ee4000 for lustre-MDT0001 00000100:00080000:0.0:1789131055.835119:0:15984:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789131055.835128:0:15984:0:(client.c:3601:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff91de01ad1e00 x1876039508867328/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1789131063 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789131055.835138:0:15984:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 3 00000100:00080000:0.0:1789131055.835971:0:15984:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1789131055.835978:0:15984:0:(import.c:65:import_set_state_nolock()) ffff91ddff30d800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00010000:00010000:0.0:1789131055.836246:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789131055.836252:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789131055.836374:0:15984:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1789131055.836379:0:15984:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967299 gen 3 00000004:00080000:0.0:1789131055.836402:0:15984:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1789131055.836488:0:15984:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1789131055.836509:0:15984:0:(import.c:65:import_set_state_nolock()) ffff91ddff6eb000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1789131055.836523:0:15984:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1789131055.836526:0:15984:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000004:00080000:0.0:1789131055.836534:0:15984:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1789131055.841096:0:15984:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1789131055.841141:0:15984:0:(import.c:65:import_set_state_nolock()) ffff91dcc7e71000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1789131055.841175:0:15984:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff91ddfcdf8000) has no exports 00000100:00100000:0.0:1789131055.841383:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc84152c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3624:1876039508871168:0@lo:9:umount.0 00000100:00100000:0.0:1789131055.841448:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131055.841505:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8608780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3624:1876039508871296:0@lo:9:umount.0 00000100:00100000:0.0:1789131055.841528:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131055.841593:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508871168 00000100:00100000:0.0:1789131055.841600:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508871168 00000100:00100000:0.0:1789131055.841640:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508871296 00000100:00100000:0.0:1789131055.841643:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508871296 00000100:00100000:0.0:1789131055.841665:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789131055.841673:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8609a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1876039508871168:12345-0@lo:9:umount.0 00000020:00000080:0.0:1789131055.841695:0:8416:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf3fe2838e1fc1fbf 00000100:00080000:0.0:1789131055.841703:0:8416:0:(import.c:65:import_set_state_nolock()) ffff91ddff6ed800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789131055.841744:0:8416:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:0.0:1789131055.842198:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8609a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+2:3624:x1876039508871168:12345-0@lo:9:umount.0 Request processed in 525us (749us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131055.842207:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789131055.842224:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789131055.842231:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8608000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1876039508871296:12345-0@lo:9:umount.0 00000020:00000080:0.0:1789131055.842243:0:8416:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf3fe2838e1fc2101 00000100:00080000:0.0:1789131055.842262:0:8416:0:(import.c:65:import_set_state_nolock()) ffff91dcc7e77000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789131055.842283:0:8416:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:0.0:1789131055.842355:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8608000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+2:3624:x1876039508871296:12345-0@lo:9:umount.0 Request processed in 125us (826us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131055.842362:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00010000:00010000:0.0:1789131055.842385:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789131055.842423:0:3624:0:(import.c:65:import_set_state_nolock()) ffff91ddff6eb000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1789131055.842433:0:3624:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1789131055.842435:0:3624:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789131055.842439:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc84152c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3624:1876039508871168:0@lo:9:umount.0 00000100:00080000:0.0:1789131055.842450:0:3624:0:(import.c:65:import_set_state_nolock()) ffff91dcc7e71000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1789131055.842468:0:3624:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1789131055.842470:0:3624:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789131055.842473:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8608780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3624:1876039508871296:0@lo:9:umount.0 00010000:00010000:0.0:1789131055.842543:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789131055.849130:0:3625:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.111@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1789131055.849135:0:3625:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1789131055.849145:0:3625:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff91dcc7fff840 x1876039508869376/t0(0) o400->MGC192.168.203.111@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1789131070 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789131055.849160:0:3625:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff91ddc12aa580 x1876039508870656/t0(0) o103->MGC192.168.203.111@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789131071 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789131055.849169:0:3625:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff91dcc6d67c00 x1876039508870528/t0(0) o103->MGC192.168.203.111@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789131071 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789131055.849178:0:3625:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff91de01ad12c0 x1876039508870784/t0(0) o103->MGC192.168.203.111@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789131071 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789131055.849205:0:3625:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff91dcc84943c0 x1876039508871040/t0(0) o103->MGC192.168.203.111@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789131071 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1789131055.849214:0:3625:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1789131055.849217:0:3625:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1789131055.849218:0:3625:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1789131055.850288:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc84952c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:0:1876039508870912:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789131055.850433:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc6d67c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3626:1876039508870528:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789131055.850442:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddc12aa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3626:1876039508870656:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789131055.850448:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01ad1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1876039508867328:0@lo:41:osp-pre-0-1.0 00000100:00080000:2.0:1789131055.850904:0:3627:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff91ddcf581000 already not connected (conn 1, was 1): DISCONN 00000100:00100000:2.0:1789131055.850920:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7fff840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3627:1876039508869376:0@lo:400:kworker.0 00000100:00100000:2.0:1789131055.850935:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01ad12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3627:1876039508870784:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1789131055.851094:0:3625:0:(import.c:65:import_set_state_nolock()) ffff91ddcf581000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789131055.851100:0:3625:0:(import.c:510:import_select_connection()) MGC192.168.203.111@tcp: connect to NID 0@lo last attempt 131 00000100:00080000:1.0:1789131055.851176:0:3625:0:(import.c:624:import_select_connection()) MGC192.168.203.111@tcp: import ffff91ddcf581000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:1.0:1789131055.851207:0:3625:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91dcc84970c0 x1876039508871424/t0(0) o250->MGC192.168.203.111@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789131055.851236:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc84943c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3625:1876039508871040:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789131055.851431:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc84970c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3624:1876039508871424:0@lo:250:ptlrpcd_00_00.0 00000400:00000100:0.0:1789131055.851495:0:3624:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876039508871424 offset 0 length 520: 4 00000020:00080000:2.0:1789131055.857542:0:15984:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff91ddfcdf8000) has no exports 00000020:01000000:0.0:1789131055.959005:0:15984:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff91ddff3b02a0 - data ffff91ddcf2b20d8/ffff91dcc7b2a000 00000020:01000000:0.0:1789131055.959154:0:15984:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff91ddfcf32f00 - data ffff91ddcf1be948/ffff91ddfeaff000 00000001:00000004:3.0:1789131055.977643:0:15984:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967301 00010000:00010000:0.0:1789131056.020891:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789131056.057319:0:15984:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789131056.057328:0:15984:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 4 00000100:00100000:2.0:1789131056.057336:0:15984:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1789131056.076585:0:15984:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1789131056.076592:0:15984:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967299 gen 4 00000004:00080000:2.0:1789131056.076603:0:15984:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789131056.076605:0:15984:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1789131056.082728:0:8857:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1789131056.082736:0:8857:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 1 count 1 00000040:00080000:1.0:1789131056.082755:0:8857:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1789131056.083428:0:15984:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1789131056.083433:0:15984:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:2.0:1789131056.083443:0:15984:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789131056.083445:0:15984:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1789131056.084454:0:9821:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1789131056.084483:0:9821:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 1 count 1 00000040:00080000:0.0:1789131056.084494:0:9821:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:2.0:1789131056.090855:0:15984:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf3fe2838e1fc1ddc 00000020:00000080:2.0:1789131056.090870:0:15984:0:(genops.c:885:class_export_put()) final put ffff91ddfce06000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1789131056.091332:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff91ddfce06000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1789131056.098322:0:15984:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf3fe2838e1fc1df1 00000020:00000080:2.0:1789131056.098335:0:15984:0:(genops.c:885:class_export_put()) final put ffff91ddfd285800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1789131056.098394:0:15984:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:2.0:1789131056.098420:0:15984:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789131056.098429:0:15984:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1789131056.098433:0:15984:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff91ddfcdfb490) has no exports 00000004:01000000:2.0:1789131056.098626:0:15984:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1789131056.098634:0:15984:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf3fe2838e1fc20fa 00000020:00000080:2.0:1789131056.098638:0:15984:0:(genops.c:885:class_export_put()) final put ffff91dcc1eb5000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789131056.101837:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff91ddfd285800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:2.0:1789131056.102225:0:15984:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:2.0:1789131056.102235:0:15984:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789131056.102248:0:15984:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1789131056.102253:0:15984:0:(genops.c:1558:class_disconnect_exports()) OBD device 27 (ffff91ddff71b490) has no exports 00000020:00000080:2.0:1789131056.102262:0:15984:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf3fe2838e1fc20f3 00000020:00000080:2.0:1789131056.102271:0:15984:0:(genops.c:885:class_export_put()) final put ffff91dcc7e77800/lustre-MDT0001-osd_UUID 00010000:01000000:2.0:1789131056.102696:0:15984:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:2.0:1789131056.102701:0:15984:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1789131056.102705:0:15984:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:2.0:1789131056.102710:0:15984:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789131056.102713:0:15984:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789131056.102745:0:15984:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789131056.102752:0:15984:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1789131056.102760:0:15984:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf3fe2838e1fc1fb8 00000020:00000080:2.0:1789131056.102764:0:15984:0:(genops.c:885:class_export_put()) final put ffff91dcc683f800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1789131056.103603:0:15984:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:2.0:1789131056.103613:0:15984:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789131056.103620:0:15984:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1789131056.103624:0:15984:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff91ddcf4c3490) has no exports 00000020:00000080:2.0:1789131056.103630:0:15984:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf3fe2838e1fc1fb1 00000020:00000080:2.0:1789131056.103635:0:15984:0:(genops.c:885:class_export_put()) final put ffff91ddff6e9800/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1789131056.113375:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff91dcc1eb5000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:0.0:1789131056.113411:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff91dcc7e77800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1789131056.113419:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff91dcc7e71000 for lustre-OST0001-osc-MDT0001 00000020:00000080:0.0:1789131056.113447:0:36:0:(genops.c:885:class_export_put()) final put ffff91dcc1eb1800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789131056.113450:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff91dcc1eb1800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:0.0:1789131056.113477:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789131056.113568:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff91dcc683f800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00010000:01000000:2.0:1789131056.114195:0:15984:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:2.0:1789131056.114200:0:15984:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1789131056.114204:0:15984:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967299 gen 5 00000004:00080000:2.0:1789131056.114211:0:15984:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789131056.114213:0:15984:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789131056.114255:0:15984:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789131056.114265:0:15984:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:2.0:1789131056.114278:0:15984:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:2.0:1789131056.114284:0:15984:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf3fe2838e1fc1e14 00000020:00000080:2.0:1789131056.114291:0:15984:0:(genops.c:885:class_export_put()) final put ffff91ddfce00800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1789131056.114296:0:15984:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:2.0:1789131056.114300:0:15984:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789131056.114304:0:15984:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1789131056.114307:0:15984:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff91ddcf699a48) has no exports 00000020:00000080:2.0:1789131056.114314:0:15984:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf3fe2838e1fc1e0d 00000020:00000080:2.0:1789131056.114317:0:15984:0:(genops.c:885:class_export_put()) final put ffff91ddff30c800/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1789131056.115898:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff91ddff6e9800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1789131056.115914:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff91ddff6eb000 for lustre-OST0000-osc-MDT0001 00000020:00000080:0.0:1789131056.115923:0:36:0:(genops.c:885:class_export_put()) final put ffff91ddff6ee000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789131056.115925:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff91ddff6ee000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:0.0:1789131056.115930:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789131056.116012:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff91ddfce00800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:0.0:1789131056.116019:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff91ddff30c800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:0.0:1789131056.117073:0:15984:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:0.0:1789131056.117088:0:15984:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789131056.117092:0:15984:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 5 00000100:00100000:0.0:1789131056.117099:0:15984:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789131056.117192:0:15984:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789131056.117203:0:15984:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789131056.117233:0:15984:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789131056.117237:0:15984:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789131056.117241:0:15984:0:(genops.c:885:class_export_put()) final put ffff91ddc5748000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789131056.117244:0:15984:0:(genops.c:844:class_export_destroy()) destroying export ffff91ddc5748000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:0.0:1789131056.117250:0:15984:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789131056.117386:0:15984:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf3fe2838e1fc1df8 00000020:00000080:0.0:1789131056.117392:0:15984:0:(genops.c:885:class_export_put()) final put ffff91ddfd284800/lustre-MDD0001_UUID 00000020:00000080:1.0:1789131056.118042:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff91ddff30d800 for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1789131056.118050:0:36:0:(genops.c:885:class_export_put()) final put ffff91ddcf580000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1789131056.118053:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff91ddcf580000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:1.0:1789131056.118063:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:0.0:1789131056.125238:0:15984:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:1.0:1789131056.125393:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff91ddfd284800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:1.0:1789131056.125428:0:15984:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789131056.125438:0:15984:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789131056.125442:0:15984:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff91ddfcdfced8) has no exports 00000020:00000080:1.0:1789131056.125496:0:15984:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789131056.125503:0:15984:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:1.0:1789131056.125508:0:15984:0:(genops.c:885:class_export_put()) final put ffff91ddfd282000/lustre-MDD0001_UUID 00000020:00000080:1.0:1789131056.125511:0:15984:0:(genops.c:844:class_export_destroy()) destroying export ffff91ddfd282000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:1.0:1789131056.125515:0:15984:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:1.0:1789131056.125958:0:15984:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf3fe2838e1fc1dff 00000020:00000080:1.0:1789131056.125977:0:15984:0:(genops.c:885:class_export_put()) final put ffff91ddfd281000/lustre-MDT0001-osd_UUID 00000020:01000004:1.0:1789131056.125993:0:15984:0:(tgt_mount.c:187:server_put_mount()) put mount ffff91ddfce33000 from lustre-MDT0001, refs=2 00000020:01000004:1.0:1789131056.125996:0:15984:0:(obd_mount.c:710:lustre_put_lsi()) put ffff91ddfce33000 2 00000020:01000004:1.0:1789131056.126000:0:15984:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff91ddfce33000 from lustre-MDT0001 00000020:00000080:1.0:1789131056.126020:0:15984:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789131056.126025:0:15984:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:1.0:1789131056.126028:0:15984:0:(genops.c:885:class_export_put()) final put ffff91ddfce02000/lustre-MDT0001_UUID 00000020:00000080:1.0:1789131056.126030:0:15984:0:(genops.c:844:class_export_destroy()) destroying export ffff91ddfce02000/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:1.0:1789131056.126037:0:15984:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:1.0:1789131056.126075:0:15984:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:1.0:1789131056.126152:0:15984:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:1.0:1789131056.126156:0:15984:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789131056.126160:0:15984:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789131056.126167:0:15984:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff91ddff54e000 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789131056.126172:0:15984:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffff91ddc5723490) has exports, disconnecting them 00000020:00080000:1.0:1789131056.126176:0:15984:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff91ddff54e000), last request at 1789130796 00000020:00000080:1.0:1789131056.126179:0:15984:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf3fe2838e1fc1e53 00000020:00080000:1.0:1789131056.126192:0:15984:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff91ddff54e000): rc 0 00000020:00000080:1.0:1789131056.126195:0:15984:0:(genops.c:885:class_export_put()) final put ffff91ddff54e000/lustre-MDT0000-lwp-MDT0001 00000020:00000080:0.0:1789131056.127217:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff91ddfd281000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1789131056.127229:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff91ddff54e000/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:0.0:1789131056.129757:0:15984:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:0.0:1789131056.129775:0:15984:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789131056.129779:0:15984:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789131056.129786:0:15984:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789131056.129811:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff91ddff54a000 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:0.0:1789131056.129990:0:15984:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789131056.129999:0:15984:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:0.0:1789131056.130004:0:15984:0:(genops.c:885:class_export_put()) final put ffff91ddff54a800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:0.0:1789131056.130008:0:15984:0:(genops.c:844:class_export_destroy()) destroying export ffff91ddff54a800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:0.0:1789131056.130017:0:15984:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:0.0:1789131056.130093:0:15984:0:(obd_mount.c:710:lustre_put_lsi()) put ffff91ddfce33000 1 00000020:00000080:0.0:1789131056.130099:0:15984:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf3fe2838e1fc1d8f 00000020:00000080:0.0:1789131056.130106:0:15984:0:(genops.c:885:class_export_put()) final put ffff91ddd2f39800/lustre-MDT0001-osd_UUID 00000020:01000000:0.0:1789131056.130113:0:15984:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:0.0:1789131056.130121:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff91ddd2f39800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1789131056.130130:0:15984:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789131056.130134:0:15984:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789131056.130138:0:15984:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff91ddcf69ced8) has no exports 00000020:00000080:1.0:1789131056.322495:0:15984:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789131056.322509:0:15984:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:1.0:1789131056.322515:0:15984:0:(genops.c:885:class_export_put()) final put ffff91ddfce35800/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1789131056.322519:0:15984:0:(genops.c:844:class_export_destroy()) destroying export ffff91ddfce35800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:1.0:1789131056.322531:0:15984:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:1.0:1789131056.322649:0:15984:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff91ddfce31800 00000020:01000000:1.0:1789131056.322671:0:15984:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:1.0:1789131056.322675:0:15984:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789131056.322679:0:15984:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789131056.322682:0:15984:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff91ddcf4c0000) has no exports 00000100:00100000:3.0:1789131056.322904:0:9769:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff91dcc7b3ee00:9769] 3 exiting: rc = 0 00000100:00100000:1.0:1789131056.323581:0:6502:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff91ddc338e400:6502] 2 exiting: rc = 0 00000100:00100000:1.0:1789131056.323660:0:14851:0:(service.c:3183:ptlrpc_main()) mdt00_005: service thread [ffff91dcc7f7ce00:14851] 5 exiting: rc = 0 00000100:00100000:1.0:1789131056.323735:0:6501:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff91ddc338f200:6501] 1 exiting: rc = 0 00000100:00100000:1.0:1789131056.323863:0:14273:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff91de01a6a000:14273] 4 exiting: rc = 0 00000100:00100000:2.0:1789131056.324053:0:6500:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff91ddc338e200:6500] 0 exiting: rc = 1 00000100:00100000:0.0:1789131056.324317:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.324326:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.324331:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.324337:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.324343:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.324348:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.324355:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.324368:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.324375:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.324381:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.324386:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.324391:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.324642:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.324653:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.324658:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.324673:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.324678:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.324683:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.324689:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.324694:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.324698:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.324704:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.324708:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.324713:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.324719:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.324725:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.324730:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.324736:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.324741:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.324746:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.324752:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.324757:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.324762:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.324767:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.324772:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.324777:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.324782:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.324788:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.324793:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.324798:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.324803:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.324808:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.324814:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.324820:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.324825:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.324830:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.324835:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.324841:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.324846:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.324851:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.324864:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.324870:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.324875:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.324880:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.324885:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.324892:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.324897:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.324903:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.324908:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.324914:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.324920:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.324927:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.324932:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.324937:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789131056.329296:0:6503:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff91ddc338fe00:6503] 0 exiting: rc = 1 00000100:00100000:2.0:1789131056.329766:0:6504:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff91ddd06ae400:6504] 1 exiting: rc = 0 00000100:00100000:0.0:1789131056.330000:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.330009:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.330015:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.330021:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.330027:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.330033:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.330038:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.330045:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.330050:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.330056:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.330062:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.330068:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.330083:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.330089:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.330095:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.330100:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.330104:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.330110:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.330116:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.330122:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.330127:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.330144:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.330149:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.330155:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.330160:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.330165:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.330170:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.330175:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.330180:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.330184:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.330190:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.330195:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.330200:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.330205:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.330210:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.330215:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.330221:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.330227:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.330233:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.330238:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.330244:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.330249:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.330255:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.330260:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.330265:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.330270:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.330276:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.330281:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.330287:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.330292:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.330297:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.330302:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.330308:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.330313:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.330319:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.330324:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.330335:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.330340:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.330345:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.330351:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.330356:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.330361:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.330366:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.330372:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789131056.331626:0:6506:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff91ddd02f6c00:6506] 1 exiting: rc = 0 00000100:00100000:2.0:1789131056.331710:0:6505:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff91ddc6381400:6505] 0 exiting: rc = 1 00000100:00100000:2.0:1789131056.331777:0:11069:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff91dcc787c000:11069] 2 exiting: rc = 0 00000100:00100000:0.0:1789131056.331898:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.331908:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.331914:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.331930:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.331936:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.331941:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.331945:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.331951:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.331957:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.331962:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.331966:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.331972:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.331977:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.331983:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.331988:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.332009:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.332016:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.332021:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.332028:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.332035:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.332041:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.332046:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.332051:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.332058:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.332064:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.332070:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.332085:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.332116:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.332123:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.332129:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.332135:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.332141:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.332146:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.332151:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.332159:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.332166:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.332172:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.332178:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.332185:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.332206:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.332215:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.332220:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.332226:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.332232:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.332238:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.332243:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.332249:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.332254:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.332259:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.332264:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.332269:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.332288:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.332295:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.332300:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.332305:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.332310:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.332316:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.332321:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.332327:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.332332:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.332337:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.332342:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.332354:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.332368:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789131056.358049:0:6508:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff91ddd02f6000:6508] 1 exiting: rc = 0 00000100:00100000:0.0:1789131056.359620:0:6507:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff91ddd02f6400:6507] 0 exiting: rc = 1 00000100:00100000:2.0:1789131056.359876:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789131056.359884:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789131056.359890:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789131056.359895:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789131056.359901:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789131056.359907:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789131056.359912:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789131056.359918:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789131056.359923:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789131056.359929:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789131056.359934:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789131056.359939:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789131056.359945:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789131056.359951:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789131056.359956:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789131056.359975:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789131056.359980:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789131056.359986:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789131056.359991:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789131056.359997:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789131056.360002:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789131056.360008:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789131056.360013:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789131056.360019:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789131056.360024:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789131056.360029:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789131056.360034:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789131056.360039:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789131056.360045:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789131056.360050:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789131056.360054:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789131056.360064:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789131056.360069:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789131056.360074:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789131056.360290:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789131056.360296:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789131056.360301:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789131056.360306:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789131056.360310:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789131056.360315:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789131056.360320:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789131056.360325:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789131056.360330:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789131056.360335:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789131056.360340:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789131056.360345:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789131056.360350:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789131056.360356:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789131056.360360:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789131056.360365:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789131056.360377:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789131056.360382:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789131056.360387:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789131056.360393:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789131056.360747:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789131056.360756:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789131056.360760:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789131056.360765:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789131056.360769:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789131056.360775:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789131056.360779:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789131056.364679:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789131056.364703:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789131056.364709:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.377193:0:6510:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff91ddc5368000:6510] 1 exiting: rc = 0 00000100:00100000:1.0:1789131056.377193:0:6509:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff91ddca253600:6509] 0 exiting: rc = 1 00000100:00100000:3.0:1789131056.381762:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.381775:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.381780:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.381786:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.381791:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.381796:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.381801:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.381806:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.381811:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.381815:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.381838:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.381842:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.381847:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.381851:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.381856:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.381861:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.381866:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.381870:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.381876:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.381880:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.381885:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.381889:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.381894:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.381899:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.381904:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.381908:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.381913:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.381917:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.381922:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.381926:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.381931:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.381936:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.381941:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.381945:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.381951:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.381956:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.381962:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.381967:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.381972:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.381977:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.381982:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.381987:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.381992:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.381996:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.382001:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.382015:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.382020:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.382025:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.382030:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.382034:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.382039:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.382043:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.382048:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.382053:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.382057:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.382062:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.382068:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.382072:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.382426:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.382436:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.382441:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.382446:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.382452:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.382485:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131056.383136:0:6511:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff91ddc5368e00:6511] 0 exiting: rc = 1 00000100:00100000:1.0:1789131056.383628:0:6512:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff91ddc5368800:6512] 1 exiting: rc = 0 00000100:00100000:3.0:1789131056.383771:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.383778:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.383783:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.383788:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.383792:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.383797:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.383801:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.383805:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.383810:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.383814:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.383820:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.383825:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.383830:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.383835:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.383839:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.383844:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.383859:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.383864:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.383869:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.383874:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.383878:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.383882:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.383887:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.383891:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.383895:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.383900:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.383904:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.383909:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.383913:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.383917:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.383922:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.383926:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.383930:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.383935:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.383940:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.383944:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.383949:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.383953:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.383957:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.383962:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.383966:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.383971:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.383975:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.383979:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.383984:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.383987:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.383992:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.383995:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.384000:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.384005:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.384009:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.384021:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.384025:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.384030:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.384034:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.384038:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.384044:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.384049:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.384053:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.384057:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.384062:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.384066:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.384071:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.384143:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131056.384940:0:6514:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff91ddc3274600:6514] 1 exiting: rc = 0 00000100:00100000:1.0:1789131056.386815:0:6515:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff91ddcf777000:6515] 2 exiting: rc = 0 00000100:00100000:0.0:1789131056.387375:0:6513:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff91ddca3d3600:6513] 0 exiting: rc = 1 00000100:00100000:3.0:1789131056.387774:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.387782:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.387787:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.387793:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.387798:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.387804:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.387819:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.387844:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.387851:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.387856:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.387862:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.387867:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.387872:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.387878:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.387883:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.387889:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.387894:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.387900:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.387905:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.387910:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.387915:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.387920:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.387941:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.387947:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.387952:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.387959:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.387965:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.387971:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.387977:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.387982:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.387988:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.388006:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.388013:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.388018:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.388023:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.388028:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.388034:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.388038:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.388043:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.388048:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.388053:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.388058:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.388063:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.388068:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.388074:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.388079:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.388085:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.388090:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.388095:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.388100:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.388106:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.388113:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.388118:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.388124:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.388130:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.388150:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.388157:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.388168:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.388174:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.388389:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.388400:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.388405:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.388411:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131056.388424:0:15984:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1789131056.394265:0:15984:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789131056.394277:0:15984:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:3.0:1789131056.394283:0:15984:0:(genops.c:885:class_export_put()) final put ffff91dded1e7800/MDS_uuid 00000020:00000080:3.0:1789131056.394287:0:15984:0:(genops.c:844:class_export_destroy()) destroying export ffff91dded1e7800/MDS_uuid for MDS 00000020:01000000:3.0:1789131056.394292:0:15984:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:3.0:1789131056.394411:0:15984:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:1.0:1789131057.042099:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789131058.072431:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789131059.090139:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789131059.805909:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789131059.805918:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789131059.805921:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789131059.805924:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1789131059.805927:0:36:0:(import.c:65:import_set_state_nolock()) ffff91ddfce36800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789131059.805935:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 410 00000100:00080000:3.0:1789131059.805940:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1789131059.805947:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff91ddfce36800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:3.0:1789131059.805980:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91ddd1dac000 x1876039508871552/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789131059.806018:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789131059.806022:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1789131059.806024:0:36:0:(import.c:65:import_set_state_nolock()) ffff91dcc7b4d800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789131059.806028:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 410 00000100:00080000:3.0:1789131059.806030:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1789131059.806043:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff91dcc7b4d800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:3.0:1789131059.806055:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91ddd1daf840 x1876039508871808/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789131059.806165:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd1dafc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3626:1876039508871680:0@lo:400:kworker.0 00000400:00000100:3.0:1789131059.806212:0:3626:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876039508871680 offset 0 length 224: 4 00000100:00100000:3.0:1789131059.806272:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd1dae940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3627:1876039508871936:0@lo:400:kworker.0 00000400:00000100:3.0:1789131059.806290:0:3627:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876039508871936 offset 0 length 224: 4 00000100:00100000:1.0:1789131059.816100:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd1dac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3624:1876039508871552:0@lo:38:kworker.0 00000400:00000100:1.0:1789131059.816173:0:3624:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876039508871552 offset 0 length 520: 4 00000100:00100000:1.0:1789131059.816216:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd1daf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3624:1876039508871808:0@lo:38:kworker.0 00000400:00000100:1.0:1789131059.816234:0:3624:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876039508871808 offset 0 length 520: 4 00010000:00010000:1.0:1789131060.113684:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789131060.817873:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789131060.817881:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789131060.817884:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789131060.817887:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789131060.817942:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789131060.817947:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789131060.817985:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd286fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3625:1876039508872192:0@lo:400:kworker.0 00000400:00000100:2.0:1789131060.818036:0:3625:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876039508872192 offset 0 length 224: 4 00000100:00100000:1.0:1789131060.818131:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789131060.818141:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd286c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3627:1876039508872064:0@lo:400:kworker.0 00000400:00000100:1.0:1789131060.818165:0:3627:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876039508872064 offset 0 length 224: 4 00000020:01000004:0.0:1789131061.104200:0:16184:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1789131061.117444:0:16184:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:1.0:1789131061.117552:0:16184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff91dde19aa400/0xf3fe2838e1fc21cc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc21d3 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131061.117570:0:16184:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff91dde19aa400/0xf3fe2838e1fc21cc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3fe2838e1fc21d3 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131061.117578:0:16184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff91dde19aa400/0xf3fe2838e1fc21cc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xf3fe2838e1fc21d3 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131061.117587:0:16184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.111@tcp lock: ffff91dde19aa400/0xf3fe2838e1fc21cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xf3fe2838e1fc21d3 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131061.117627:0:16184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1789131061.117633:0:16184:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1789131061.117669:0:16184:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789131061.117683:0:16184:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff91ddd1dac000 x1876039508871552/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789131079 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789131061.117699:0:16184:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1789131061.117706:0:16184:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1789131061.117713:0:16184:0:(import.c:65:import_set_state_nolock()) ffff91ddfce36800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1789131061.117719:0:16184:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789131061.117723:0:16184:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff91ddd1dac000 x1876039508871552/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789131079 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789131061.117730:0:16184:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1789131061.117733:0:16184:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 24s for inflight to error out 00010000:00010000:0.0:1789131061.118031:0:6489:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789131061.118041:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff91dde19aa400/0xf3fe2838e1fc21cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xf3fe2838e1fc21d3 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131061.118050:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dde19aa400 already unused, calling callback (ffffffffc124bc20) 10000000:00010000:0.0:1789131061.118055:0:6489:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff91dde19aa400/0xf3fe2838e1fc21cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xf3fe2838e1fc21d3 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131061.118066:0:6489:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff91dde19aa400/0xf3fe2838e1fc21cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xf3fe2838e1fc21d3 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789131061.118087:0:6489:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff91dde19aa400/0xf3fe2838e1fc21cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xf3fe2838e1fc21d3 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789131061.118094:0:6489:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789131061.118096:0:6489:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1789131061.118099:0:6489:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1789131061.118117:0:6489:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff91ddcf581000 00010000:00010000:0.0:1789131061.118122:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff91dde19aa400/0xf3fe2838e1fc21cc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xf3fe2838e1fc21d3 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131061.118129:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff91dde19aa400/0xf3fe2838e1fc21cc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xf3fe2838e1fc21d3 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131061.118156:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789131061.118158:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789131061.118159:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789131061.121378:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd1dac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3624:1876039508871552:0@lo:38:kworker.0 00000100:00080000:0.0:1789131061.122453:0:16184:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1789131061.122495:0:16184:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff91ddd1dafc00 x1876039508871680/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789131075 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789131061.122543:0:16184:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff91ddd286c780 x1876039508872064/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789131076 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789131061.122558:0:16184:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1789131061.122564:0:16184:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1789131061.122594:0:16184:0:(import.c:65:import_set_state_nolock()) ffff91dcc1ee2800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1789131061.123018:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc86092c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3624:1876039508872320:0@lo:39:umount.0 00000100:00100000:1.0:1789131061.123040:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd286c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3627:1876039508872064:0@lo:400:kworker.0 00000400:00000100:2.0:1789131061.123087:0:3624:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876039508872320 offset 0 length 224: 4 00000100:00100000:3.0:1789131061.123193:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd1dafc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3626:1876039508871680:0@lo:400:kworker.0 00010000:00010000:0.0:1789131061.137965:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789131061.847423:0:8410:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1789131061.847437:0:8410:0:(genops.c:885:class_export_put()) final put ffff91ddff6e8800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789131061.847637:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff91ddff6e8800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1789131061.847886:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff91ddff6ed800 for lustre-OST0000 00000001:00100000:2.0:1789131061.847946:0:9493:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1789131061.847961:0:9493:0:(genops.c:885:class_export_put()) final put ffff91dcc7e75000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789131061.848108:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff91dcc7e75000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1789131061.848146:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff91dcc7e77000 for lustre-OST0001 00010000:00010000:1.0:1789131062.162582:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131063.193871:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789131064.209691:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789131064.851096:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789131064.851110:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789131064.851113:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789131064.851116:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789131064.851281:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8494f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3626:1876039508872448:0@lo:400:kworker.0 00000400:00000100:3.0:1789131064.851368:0:3626:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876039508872448 offset 0 length 224: 4 00010000:00010000:1.0:1789131065.233961:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789131065.234159:0:3624:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789131055/real 1789131055] req@ffff91dcc84970c0 x1876039508871424/t0(0) o250->MGC192.168.203.111@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789131065 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789131065.234204:0:3624:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff91dcc84970c0 x1876039508871424/t0(0) o250->MGC192.168.203.111@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789131065 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789131065.234230:0:3624:0:(import.c:65:import_set_state_nolock()) ffff91ddcf581000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789131065.234254:0:3624:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1789131065.234259:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc84970c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3624:1876039508871424:0@lo:250:ptlrpcd_00_00.0 00000100:00080000:1.0:1789131065.234332:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789131065.234347:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1789131065.234350:0:36:0:(import.c:65:import_set_state_nolock()) ffff91ddcf581000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789131065.234357:0:36:0:(import.c:510:import_select_connection()) MGC192.168.203.111@tcp: connect to NID 0@lo last attempt 411 00000100:00080000:1.0:1789131065.234386:0:36:0:(import.c:589:import_select_connection()) MGC192.168.203.111@tcp: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1789131065.234394:0:36:0:(import.c:624:import_select_connection()) MGC192.168.203.111@tcp: import ffff91ddcf581000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:1.0:1789131065.234430:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91dcc8496580 x1876039508872576/t0(0) o250->MGC192.168.203.111@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789131065.234516:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789131065.234521:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789131065.234800:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8497c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3627:1876039508872704:0@lo:400:kworker.0 00000400:00000100:3.0:1789131065.234865:0:3627:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876039508872704 offset 0 length 224: 4 00000100:00100000:2.0:1789131065.234981:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8496580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3624:1876039508872576:0@lo:250:kworker.0 00000400:00000100:2.0:1789131065.235012:0:3624:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876039508872576 offset 0 length 520: 4 00010000:00010000:1.0:1789131066.257862:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789131067.284773:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789131068.305949:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789131069.329965:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789131070.355417:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789131070.552393:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789131070.552408:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789131070.552412:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789131070.552416:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789131070.552616:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789131070.552647:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8609680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3627:1876039508872832:0@lo:400:kworker.0 00000400:00000100:2.0:1789131070.552732:0:3627:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876039508872832 offset 0 length 224: 4 00000100:00100000:2.0:1789131071.378238:0:3624:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789131061/real 1789131061] req@ffff91dcc86092c0 x1876039508872320/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789131071 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789131071.378282:0:3624:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff91dcc86092c0 x1876039508872320/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789131071 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789131071.378490:0:3624:0:(import.c:65:import_set_state_nolock()) ffff91dcc1ee2800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1789131071.378508:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc86092c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3624:1876039508872320:0@lo:39:umount.0 00000100:00080000:1.0:1789131071.378620:0:16184:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1789131071.378626:0:16184:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1789131071.378632:0:16184:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1789131071.381777:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789131071.382306:0:16184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff91dde19aa000/0xf3fe2838e1fc21da lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc21e1 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131071.383282:0:16184:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff91dde19aa000/0xf3fe2838e1fc21da lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3fe2838e1fc21e1 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131071.383291:0:16184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff91dde19aa000/0xf3fe2838e1fc21da lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xf3fe2838e1fc21e1 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131071.383298:0:16184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.111@tcp lock: ffff91dde19aa000/0xf3fe2838e1fc21da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xf3fe2838e1fc21e1 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131071.383346:0:16184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789131071.383356:0:16184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff91de01ad7000/0xf3fe2838e1fc24f8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc24ff expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131071.383733:0:6489:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789131071.383743:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff91dde19aa000/0xf3fe2838e1fc21da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xf3fe2838e1fc21e1 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131071.383751:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dde19aa000 already unused, calling callback (ffffffffc124bc20) 10000000:00010000:2.0:1789131071.383775:0:6489:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff91dde19aa000/0xf3fe2838e1fc21da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xf3fe2838e1fc21e1 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131071.383785:0:6489:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff91dde19aa000/0xf3fe2838e1fc21da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xf3fe2838e1fc21e1 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789131071.383794:0:6489:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff91dde19aa000/0xf3fe2838e1fc21da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xf3fe2838e1fc21e1 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789131071.383800:0:6489:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789131071.383803:0:6489:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:2.0:1789131071.383819:0:6489:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff91ddcf581000 00010000:00010000:2.0:1789131071.383824:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff91dde19aa000/0xf3fe2838e1fc21da lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xf3fe2838e1fc21e1 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131071.383830:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff91dde19aa000/0xf3fe2838e1fc21da lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xf3fe2838e1fc21e1 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131071.383850:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131071.383852:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131071.383853:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789131071.383910:0:16184:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff91de01ad7000/0xf3fe2838e1fc24f8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3fe2838e1fc24ff expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131071.383994:0:16184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff91de01ad7000/0xf3fe2838e1fc24f8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf3fe2838e1fc24ff expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131071.384003:0:16184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.111@tcp lock: ffff91de01ad7000/0xf3fe2838e1fc24f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf3fe2838e1fc24ff expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131071.384073:0:16184:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1789131071.384091:0:16184:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:1.0:1789131071.384098:0:16184:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:1.0:1789131071.384140:0:16184:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:1.0:1789131071.384146:0:16184:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:1.0:1789131071.384153:0:16184:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789131071.384160:0:16184:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789131071.384165:0:16184:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff91ddcf4c4ed8) has no exports 00000020:00080000:1.0:1789131071.384635:0:16184:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff91ddcf4c4ed8) has no exports 00010000:00010000:0.0:1789131071.391753:0:7442:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789131071.391795:0:7442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff91de01ad7000/0xf3fe2838e1fc24f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf3fe2838e1fc24ff expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131071.391810:0:7442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91de01ad7000 already unused, calling callback (ffffffffc124bc20) 10000000:00010000:0.0:1789131071.391815:0:7442:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff91de01ad7000/0xf3fe2838e1fc24f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf3fe2838e1fc24ff expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131071.391828:0:7442:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff91de01ad7000/0xf3fe2838e1fc24f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xf3fe2838e1fc24ff expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789131071.391835:0:7442:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff91de01ad7000/0xf3fe2838e1fc24f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xf3fe2838e1fc24ff expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789131071.391841:0:7442:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1789131071.391845:0:7442:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1789131071.391850:0:7442:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1789131071.391876:0:7442:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff91ddcf581000 00010000:00010000:0.0:1789131071.391881:0:7442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff91de01ad7000/0xf3fe2838e1fc24f8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xf3fe2838e1fc24ff expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131071.391889:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff91de01ad7000/0xf3fe2838e1fc24f8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xf3fe2838e1fc24ff expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131071.391908:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789131071.391910:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789131071.391912:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1789131071.394050:0:16184:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff91dcc7ab7300 - data ffff91ddcf359a20/ffff91dcc7dae400 00000020:01000000:1.0:1789131071.394284:0:16184:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff91dcc6a488a0 - data ffff91ddcf288798/ffff91ddffcb3800 00100000:10000000:0.0:1789131071.405834:0:16184:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1789131071.431727:0:16184:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf3fe2838e1fc1f2c 00000020:00000080:3.0:1789131071.431745:0:16184:0:(genops.c:885:class_export_put()) final put ffff91dcc683a800/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1789131071.432045:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff91dcc683a800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000004:3.0:1789131071.432065:0:16184:0:(tgt_mount.c:187:server_put_mount()) put mount ffff91ddff4f9000 from lustre-OST0000, refs=2 00000020:01000004:3.0:1789131071.432070:0:16184:0:(obd_mount.c:710:lustre_put_lsi()) put ffff91ddff4f9000 2 00000020:01000004:3.0:1789131071.432073:0:16184:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff91ddff4f9000 from lustre-OST0000 00000020:00000080:3.0:1789131071.432103:0:16184:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789131071.432172:0:16184:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:3.0:1789131071.432176:0:16184:0:(genops.c:885:class_export_put()) final put ffff91dcc683e800/lustre-OST0000_UUID 00000020:00000080:3.0:1789131071.432179:0:16184:0:(genops.c:844:class_export_destroy()) destroying export ffff91dcc683e800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:3.0:1789131071.432186:0:16184:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:3.0:1789131071.432283:0:16184:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:3.0:1789131071.432288:0:16184:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1789131071.432292:0:16184:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789131071.432298:0:16184:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1789131071.432306:0:16184:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff91ddfcffa800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789131071.432313:0:16184:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffff91ddcf4c1a48) has exports, disconnecting them 00000020:00080000:3.0:1789131071.432320:0:16184:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff91ddfcffa800), last request at 1789130817 00000020:00000080:3.0:1789131071.432324:0:16184:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf3fe2838e1fc1f56 00000020:00080000:3.0:1789131071.432336:0:16184:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff91ddfcffa800): rc 0 00000020:00000080:3.0:1789131071.432342:0:16184:0:(genops.c:885:class_export_put()) final put ffff91ddfcffa800/lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1789131071.432370:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff91ddfcffa800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1789131071.440545:0:16184:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1789131071.440556:0:16184:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789131071.440561:0:16184:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1789131071.440572:0:16184:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789131071.441009:0:16184:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789131071.441021:0:16184:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:2.0:1789131071.441029:0:16184:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1789131071.441035:0:16184:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789131071.441041:0:16184:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1789131071.441052:0:16184:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff91dcc1ee7000 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789131071.441073:0:16184:0:(genops.c:1553:class_disconnect_exports()) OBD device 20 (ffff91ddcf698000) has exports, disconnecting them 00000020:00080000:2.0:1789131071.441148:0:16184:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff91dcc1ee7000), last request at 1789130817 00000020:00000080:2.0:1789131071.441155:0:16184:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf3fe2838e1fc1f6b 00000020:00080000:2.0:1789131071.441173:0:16184:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff91dcc1ee7000): rc 0 00000020:00000080:2.0:1789131071.441184:0:16184:0:(genops.c:885:class_export_put()) final put ffff91dcc1ee7000/lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1789131071.442775:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff91ddfce36800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1789131071.442793:0:36:0:(genops.c:885:class_export_put()) final put ffff91dcc6839000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1789131071.442798:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff91dcc6839000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1789131071.442809:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1789131071.442984:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff91dcc1ee7000/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:1.0:1789131071.557554:0:16184:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:1.0:1789131071.557567:0:16184:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1789131071.557572:0:16184:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1789131071.557960:0:16184:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789131071.559296:0:16184:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789131071.560528:0:16184:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:1.0:1789131071.560794:0:16184:0:(obd_mount.c:710:lustre_put_lsi()) put ffff91ddff4f9000 1 00000020:00000080:1.0:1789131071.560806:0:16184:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf3fe2838e1fc1ef4 00000020:00000080:1.0:1789131071.560818:0:16184:0:(genops.c:885:class_export_put()) final put ffff91ddff789800/lustre-OST0000-osd_UUID 00000020:01000000:1.0:1789131071.560828:0:16184:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:1.0:1789131071.560839:0:16184:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789131071.560846:0:16184:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789131071.560868:0:16184:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff91ddcf69b490) has no exports 00000020:00000080:3.0:1789131071.564499:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff91dcc1ee2800 for lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1789131071.564529:0:36:0:(genops.c:885:class_export_put()) final put ffff91dcc1ee1000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:3.0:1789131071.564534:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff91dcc1ee1000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:3.0:1789131071.564545:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:3.0:1789131071.565029:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff91ddff789800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1789131071.616026:0:16184:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789131071.616046:0:16184:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1789131071.616054:0:16184:0:(genops.c:885:class_export_put()) final put ffff91ddff4ff800/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1789131071.616061:0:16184:0:(genops.c:844:class_export_destroy()) destroying export ffff91ddff4ff800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1789131071.616077:0:16184:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1789131071.616343:0:16184:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff91ddff4fb800 00000020:02000400:1.0:1789131071.616413:0:16184:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:0.0:1789131072.401661:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789131073.431661:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789131074.449836:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789131075.474918:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:3.0:1789131075.665564:0:3627:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789131059/real 1789131059] req@ffff91ddd1dae940 x1876039508871936/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789131075 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789131075.665605:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789131075.665613:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789131075.665617:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789131075.665621:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789131075.665711:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd286f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3625:1876039508872960:0@lo:400:kworker.0 00000400:00000100:2.0:1789131075.665781:0:3625:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876039508872960 offset 0 length 224: 4 00000100:00100000:3.0:1789131075.680830:0:3627:0:(client.c:2547:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff91ddd1dae940 x1876039508871936/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789131075 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789131075.680848:0:3627:0:(import.c:65:import_set_state_nolock()) ffff91dcc7b4c000 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1789131075.680875:0:3627:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000020:01000004:1.0:1789131075.688121:0:16386:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000100:00080000:3.0:1789131075.699626:0:3627:0:(import.c:418:ptlrpc_pinger_force()) lustre-MDT0001_UUID: waking up pinger s:DISCONN 00000100:00080000:3.0:1789131075.699730:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789131075.699737:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789131075.699739:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789131075.699742:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789131075.699745:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789131075.699748:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1789131075.699752:0:8:0:(import.c:65:import_set_state_nolock()) ffff91dcc7b4c000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789131075.699762:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 194 00000100:00080000:3.0:1789131075.699773:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff91dcc7b4c000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:3.0:1789131075.699819:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91ddd1dae580 x1876039508873088/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789131075.699871:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd1dae580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3624:1876039508873088:0@lo:38:kworker.0 00000400:00000100:3.0:1789131075.699951:0:3624:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876039508873088 offset 0 length 520: 4 00000100:00100000:3.0:1789131075.700049:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd1dae940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3627:1876039508871936:0@lo:400:kworker.0 00000020:01000004:1.0:1789131075.712382:0:16386:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:1.0:1789131075.712524:0:16386:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff91dcc7e36e00/0xf3fe2838e1fc21b0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc21b7 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131075.712542:0:16386:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff91dcc7e36e00/0xf3fe2838e1fc21b0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3fe2838e1fc21b7 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131075.712550:0:16386:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff91dcc7e36e00/0xf3fe2838e1fc21b0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xf3fe2838e1fc21b7 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131075.712557:0:16386:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.111@tcp lock: ffff91dcc7e36e00/0xf3fe2838e1fc21b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xf3fe2838e1fc21b7 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131075.712580:0:16386:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1789131075.712586:0:16386:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1789131075.712617:0:16386:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789131075.712631:0:16386:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff91ddd1daf840 x1876039508871808/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789131079 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789131075.712661:0:16386:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1789131075.712668:0:16386:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1789131075.712675:0:16386:0:(import.c:65:import_set_state_nolock()) ffff91dcc7b4d800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1789131075.712698:0:16386:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789131075.712703:0:16386:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff91ddd1daf840 x1876039508871808/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789131079 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789131075.712710:0:16386:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1789131075.712714:0:16386:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 5s for inflight to error out 00000100:00100000:0.0:1789131075.712826:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd1daf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3624:1876039508871808:0@lo:38:kworker.0 00000100:00080000:1.0:1789131075.714007:0:16386:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1789131075.714024:0:16386:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff91ddd286fc00 x1876039508872192/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789131076 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789131075.714047:0:16386:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff91dcc8494f00 x1876039508872448/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789131080 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789131075.714074:0:16386:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff91dcc8497c00 x1876039508872704/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789131081 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789131075.714088:0:16386:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff91dcc8609680 x1876039508872832/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789131086 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789131075.714096:0:16386:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff91ddd286f840 x1876039508872960/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789131091 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789131075.714105:0:16386:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff91ddd1dae580 x1876039508873088/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789131085 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789131075.714116:0:16386:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1789131075.714122:0:16386:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1789131075.714129:0:16386:0:(import.c:65:import_set_state_nolock()) ffff91dcc7b4c000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1789131075.714134:0:16386:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1789131075.714138:0:16386:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff91ddd286fc00 x1876039508872192/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789131076 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789131075.714146:0:16386:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff91dcc8494f00 x1876039508872448/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789131080 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789131075.714155:0:16386:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff91dcc8497c00 x1876039508872704/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789131081 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789131075.714180:0:16386:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff91dcc8609680 x1876039508872832/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789131086 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789131075.714190:0:16386:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff91ddd286f840 x1876039508872960/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789131091 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789131075.714195:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8494f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3626:1876039508872448:0@lo:400:kworker.0 00000100:00100000:1.0:1789131075.714204:0:16386:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff91ddd1dae580 x1876039508873088/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789131085 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789131075.714271:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd286f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3625:1876039508872960:0@lo:400:kworker.0 00010000:00010000:2.0:1789131075.714920:0:6489:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789131075.714931:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff91dcc7e36e00/0xf3fe2838e1fc21b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xf3fe2838e1fc21b7 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131075.714943:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc7e36e00 already unused, calling callback (ffffffffc124bc20) 10000000:00010000:2.0:1789131075.714948:0:6489:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff91dcc7e36e00/0xf3fe2838e1fc21b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xf3fe2838e1fc21b7 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131075.714961:0:6489:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff91dcc7e36e00/0xf3fe2838e1fc21b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xf3fe2838e1fc21b7 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789131075.714969:0:6489:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff91dcc7e36e00/0xf3fe2838e1fc21b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xf3fe2838e1fc21b7 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789131075.714976:0:6489:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789131075.714979:0:6489:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1789131075.714993:0:6489:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1789131075.715014:0:6489:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff91ddcf581000 00010000:00010000:2.0:1789131075.715018:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff91dcc7e36e00/0xf3fe2838e1fc21b0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xf3fe2838e1fc21b7 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131075.715026:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff91dcc7e36e00/0xf3fe2838e1fc21b0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xf3fe2838e1fc21b7 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131075.715042:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131075.715043:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131075.715046:0:6489:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789131075.715124:0:16386:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1789131075.715914:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd1dae580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3624:1876039508873088:0@lo:38:kworker.0 00000100:00100000:2.0:1789131075.716080:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8609680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3627:1876039508872832:0@lo:400:kworker.0 00000100:00100000:2.0:1789131075.716091:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8497c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3627:1876039508872704:0@lo:400:kworker.0 00000100:00100000:3.0:1789131075.716313:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd286fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3625:1876039508872192:0@lo:400:kworker.0 00000100:00100000:1.0:1789131075.716440:0:16386:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1789131075.720764:0:16386:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff91ddc0030600/0xf3fe2838e1fc21be lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc21c5 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131075.720791:0:16386:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff91ddc0030600/0xf3fe2838e1fc21be lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3fe2838e1fc21c5 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131075.720798:0:16386:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff91ddc0030600/0xf3fe2838e1fc21be lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf3fe2838e1fc21c5 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131075.720805:0:16386:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.111@tcp lock: ffff91ddc0030600/0xf3fe2838e1fc21be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf3fe2838e1fc21c5 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131075.720869:0:16386:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789131075.720878:0:16386:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7ec00/0xf3fe2838e1fc24ea lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc24f1 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131075.720908:0:16386:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7ec00/0xf3fe2838e1fc24ea lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3fe2838e1fc24f1 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131075.720914:0:16386:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7ec00/0xf3fe2838e1fc24ea lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf3fe2838e1fc24f1 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131075.720920:0:16386:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7ec00/0xf3fe2838e1fc24ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf3fe2838e1fc24f1 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131075.720949:0:7442:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789131075.720958:0:7442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff91ddc0030600/0xf3fe2838e1fc21be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf3fe2838e1fc21c5 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131075.720966:0:7442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddc0030600 already unused, calling callback (ffffffffc124bc20) 10000000:00010000:0.0:1789131075.720971:0:7442:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff91ddc0030600/0xf3fe2838e1fc21be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf3fe2838e1fc21c5 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131075.720981:0:7442:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff91ddc0030600/0xf3fe2838e1fc21be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xf3fe2838e1fc21c5 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789131075.720989:0:7442:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff91ddc0030600/0xf3fe2838e1fc21be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xf3fe2838e1fc21c5 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789131075.720994:0:7442:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789131075.720997:0:7442:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:0.0:1789131075.721012:0:7442:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff91ddcf581000 00010000:00010000:0.0:1789131075.721017:0:7442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff91ddc0030600/0xf3fe2838e1fc21be lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xf3fe2838e1fc21c5 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131075.721024:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff91ddc0030600/0xf3fe2838e1fc21be lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xf3fe2838e1fc21c5 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131075.721042:0:7442:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789131075.721046:0:7442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7ec00/0xf3fe2838e1fc24ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf3fe2838e1fc24f1 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131075.721063:0:7442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc7f7ec00 already unused, calling callback (ffffffffc124bc20) 10000000:00010000:0.0:1789131075.721067:0:7442:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7ec00/0xf3fe2838e1fc24ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf3fe2838e1fc24f1 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131075.721074:0:7442:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7ec00/0xf3fe2838e1fc24ea lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xf3fe2838e1fc24f1 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789131075.721081:0:7442:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7ec00/0xf3fe2838e1fc24ea lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xf3fe2838e1fc24f1 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789131075.721086:0:7442:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1789131075.721089:0:7442:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:0.0:1789131075.721094:0:7442:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff91ddcf581000 00010000:00010000:0.0:1789131075.721097:0:7442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7ec00/0xf3fe2838e1fc24ea lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xf3fe2838e1fc24f1 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131075.721105:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789131075.721106:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789131075.721108:0:7442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131075.721140:0:16386:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789131075.721145:0:16386:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7ec00/0xf3fe2838e1fc24ea lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xf3fe2838e1fc24f1 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789131075.721161:0:16386:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:2.0:1789131075.721169:0:16386:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:2.0:1789131075.721172:0:16386:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:2.0:1789131075.721211:0:16386:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:2.0:1789131075.721216:0:16386:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:2.0:1789131075.721222:0:16386:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789131075.721230:0:16386:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789131075.721235:0:16386:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff91ddff719a48) has no exports 00010000:00010000:0.0:1789131075.721373:0:6488:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1789131075.721776:0:16386:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff91ddff719a48) has no exports 00000020:01000000:2.0:1789131075.724165:0:16386:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff91dcc6ca0420 - data ffff91ddcf3571b0/ffff91de01a70c00 00000020:01000000:2.0:1789131075.724591:0:16386:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff91dcc7ab7e40 - data ffff91ddcf228000/ffff91dcc7c67c00 00100000:10000000:1.0:1789131075.737119:0:16386:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1789131075.751280:0:16386:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf3fe2838e1fc2052 00000020:00000080:2.0:1789131075.751295:0:16386:0:(genops.c:885:class_export_put()) final put ffff91dcc1eb6000/lustre-OST0001-osd_UUID 00000020:01000004:2.0:1789131075.751321:0:16386:0:(tgt_mount.c:187:server_put_mount()) put mount ffff91ddff549800 from lustre-OST0001, refs=2 00000020:01000004:2.0:1789131075.751326:0:16386:0:(obd_mount.c:710:lustre_put_lsi()) put ffff91ddff549800 2 00000020:01000004:2.0:1789131075.751330:0:16386:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff91ddff549800 from lustre-OST0001 00000020:00000080:2.0:1789131075.751375:0:16386:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789131075.751389:0:16386:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:2.0:1789131075.751393:0:16386:0:(genops.c:885:class_export_put()) final put ffff91dcc1eb7000/lustre-OST0001_UUID 00000020:00000080:2.0:1789131075.751396:0:16386:0:(genops.c:844:class_export_destroy()) destroying export ffff91dcc1eb7000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:2.0:1789131075.751404:0:16386:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:2.0:1789131075.751613:0:16386:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b->MGS 00010000:00010000:2.0:1789131075.751645:0:16386:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff91ddc0031e00/0xf3fe2838e1fc1dab lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xf3fe2838e1fc1db2 expref: -99 pid: 7430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789131075.751660:0:16386:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff91ddc0031e00/0xf3fe2838e1fc1dab lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xf3fe2838e1fc1db2 expref: -99 pid: 7430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789131075.751667:0:16386:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:2.0:1789131075.751670:0:16386:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:2.0:1789131075.751674:0:16386:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:2.0:1789131075.751695:0:16386:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff91ddcf581000 00010000:00010000:2.0:1789131075.751699:0:16386:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff91ddc0031e00/0xf3fe2838e1fc1dab lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xf3fe2838e1fc1db2 expref: -99 pid: 7430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131075.751718:0:16386:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff91dcc7e36a00/0xf3fe2838e1fc2220 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xf3fe2838e1fc2227 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789131075.751726:0:16386:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff91dcc7e36a00/0xf3fe2838e1fc2220 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xf3fe2838e1fc2227 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789131075.751732:0:16386:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789131075.751734:0:16386:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:2.0:1789131075.751736:0:16386:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1789131075.751745:0:16386:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff91ddcf581000 00010000:00010000:2.0:1789131075.751748:0:16386:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff91dcc7e36a00/0xf3fe2838e1fc2220 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xf3fe2838e1fc2227 expref: -99 pid: 6497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789131075.751779:0:16386:0:(import.c:65:import_set_state_nolock()) ffff91ddcf581000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1789131075.751783:0:16386:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1789131075.751786:0:16386:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1789131075.751788:0:16386:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1789131075.751792:0:16386:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1789131075.751806:0:16386:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff91dcc8496580 x1876039508872576/t0(0) o250->MGC192.168.203.111@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1789131080 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1789131075.751830:0:16386:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1789131075.751834:0:16386:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 6s for inflight to error out 00000020:00000080:1.0:1789131075.752011:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff91dcc1eb6000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00100000:0.0:1789131075.752131:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8496580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b:3624:1876039508872576:0@lo:250:kworker.0 10000000:01000000:2.0:1789131075.752299:0:16386:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1789131075.752307:0:16386:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf3fe2838e1fc1ca8 00000020:00000080:2.0:1789131075.752312:0:16386:0:(genops.c:885:class_export_put()) final put ffff91dded1e3800/3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b 00000020:01000000:2.0:1789131075.752329:0:16386:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.203.111@tcp (flags='') 00000020:00000080:2.0:1789131075.752335:0:16386:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789131075.752341:0:16386:0:(obd_config.c:956:class_cleanup()) MGC192.168.203.111@tcp: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1789131075.752346:0:16386:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff91ddd10e8000) has no exports 00000020:00000080:1.0:1789131075.752393:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff91dded1e3800/3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b for MGC192.168.203.111@tcp 10000000:01000000:2.0:1789131075.756020:0:6497:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:1.0:1789131075.756202:0:16386:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.203.111@tcp: client import never connected 00000100:00080000:1.0:1789131075.756209:0:16386:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:1.0:1789131075.756215:0:16386:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1789131075.756219:0:16386:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:1.0:1789131075.756222:0:16386:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1789131075.756303:0:16386:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789131075.756316:0:16386:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.111@tcp (uuid 3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b) 00000020:01000000:1.0:1789131075.756328:0:16386:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1789131075.756338:0:16386:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789131075.756346:0:16386:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789131075.756356:0:16386:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff91dcc7b4d000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789131075.756364:0:16386:0:(genops.c:1553:class_disconnect_exports()) OBD device 25 (ffff91de01a01a48) has exports, disconnecting them 00000020:00080000:1.0:1789131075.756370:0:16386:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff91dcc7b4d000), last request at 1789130838 00000020:00000080:1.0:1789131075.756376:0:16386:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf3fe2838e1fc207c 00000020:00080000:1.0:1789131075.756396:0:16386:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff91dcc7b4d000): rc 0 00000020:00000080:1.0:1789131075.756402:0:16386:0:(genops.c:885:class_export_put()) final put ffff91dcc7b4d000/lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1789131075.758095:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff91ddcf581000 for MGC192.168.203.111@tcp 00000020:00000080:3.0:1789131075.758118:0:8:0:(genops.c:885:class_export_put()) final put ffff91ddcf583800/3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b 00000020:00000080:3.0:1789131075.758122:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff91ddcf583800/3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b for MGC192.168.203.111@tcp 00000020:01000000:3.0:1789131075.758137:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.111@tcp (3bd0bd00-e158-4dbf-9a9a-5d41c4c9352b) 00000020:00000080:3.0:1789131075.758827:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff91dcc7b4d000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:1.0:1789131075.770360:0:16386:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:1.0:1789131075.770372:0:16386:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789131075.770388:0:16386:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1789131075.770398:0:16386:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789131075.770807:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff91dcc7b4d800 for lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1789131075.771072:0:16386:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789131075.771084:0:16386:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1789131075.771092:0:16386:0:(genops.c:885:class_export_put()) final put ffff91dcc78a7000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1789131075.771097:0:16386:0:(genops.c:844:class_export_destroy()) destroying export ffff91dcc78a7000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1789131075.771110:0:16386:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:1.0:1789131075.771206:0:16386:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1789131075.771211:0:16386:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789131075.771218:0:16386:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789131075.771228:0:16386:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff91dcc7b48800 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789131075.771235:0:16386:0:(genops.c:1553:class_disconnect_exports()) OBD device 26 (ffff91de01a03490) has exports, disconnecting them 00000020:00080000:1.0:1789131075.771241:0:16386:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff91dcc7b48800), last request at 1789130838 00000020:00000080:1.0:1789131075.771247:0:16386:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf3fe2838e1fc2091 00000020:00080000:1.0:1789131075.771263:0:16386:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff91dcc7b48800): rc 0 00000020:00000080:1.0:1789131075.771268:0:16386:0:(genops.c:885:class_export_put()) final put ffff91dcc7b48800/lustre-MDT0001-lwp-OST0001 00000020:00000080:3.0:1789131075.771498:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff91dcc7b48800/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:1.0:1789131075.802381:0:16386:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:1.0:1789131075.802394:0:16386:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1789131075.802399:0:16386:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1789131075.802409:0:16386:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789131075.802976:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff91dcc7b4c000 for lustre-MDT0001-lwp-OST0001 00010000:00010000:2.0:1789131075.803015:0:6489:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:0.0:1789131075.803424:0:7442:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:0.0:1789131075.804281:0:6488:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:3.0:1789131075.804811:0:6483:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff91ddc4dfec00:6483] 0 exiting: rc = 1 00000100:00100000:3.0:1789131075.804911:0:9504:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_003: service thread [ffff91dcc6ed1e00:9504] 3 exiting: rc = 0 00000100:00100000:3.0:1789131075.805079:0:6484:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff91ddc4878400:6484] 1 exiting: rc = 0 00000100:00100000:2.0:1789131075.805198:0:9503:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_002: service thread [ffff91ddff8b3c00:9503] 2 exiting: rc = 0 00000100:00100000:1.0:1789131075.805308:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131075.805319:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131075.806737:0:8431:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff91dcc5fd3800:8431] 3 exiting: rc = 0 00000100:00100000:3.0:1789131075.806874:0:6485:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff91ddc4878c00:6485] 0 exiting: rc = 1 00000100:00100000:2.0:1789131075.807051:0:6486:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff91ddc5eafc00:6486] 1 exiting: rc = 0 00000100:00100000:0.0:1789131075.807149:0:6487:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff91ddc4dfd600:6487] 2 exiting: rc = 0 00000100:00100000:3.0:1789131075.807271:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131075.807281:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131075.807289:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131075.807295:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131075.807302:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131075.807310:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131075.807317:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131075.807324:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131075.807332:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131075.807339:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131075.807347:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131075.807353:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131075.807360:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131075.807366:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131075.807373:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131075.807381:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131075.807388:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131075.807395:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131075.807403:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131075.807411:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131075.807428:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131075.807438:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131075.807444:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131075.807450:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131075.807642:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131075.807648:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131075.807654:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131075.807660:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131075.807665:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131075.807671:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131075.807677:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131075.807683:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131075.807689:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131075.807695:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131075.807702:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131075.807707:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131075.807712:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131075.807718:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131075.807723:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131075.807729:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131075.807736:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131075.807742:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131075.807748:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131075.807754:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131075.807760:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131075.807765:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131075.807771:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131075.807776:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131075.807782:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131075.807787:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131075.807793:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131075.807798:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131075.807804:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131075.807809:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131075.807814:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131075.807818:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131075.807824:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131075.807830:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131075.807836:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131075.807850:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131075.807855:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131075.807860:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131075.807866:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131075.807871:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1789131075.809078:0:16386:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789131075.809093:0:16386:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:3.0:1789131075.809101:0:16386:0:(genops.c:885:class_export_put()) final put ffff91dcc7b4a800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:3.0:1789131075.809107:0:16386:0:(genops.c:844:class_export_destroy()) destroying export ffff91dcc7b4a800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:3.0:1789131075.809114:0:16386:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:3.0:1789131075.809181:0:16386:0:(obd_mount.c:710:lustre_put_lsi()) put ffff91ddff549800 1 00000020:00000080:3.0:1789131075.809189:0:16386:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf3fe2838e1fc2021 00000020:00000080:3.0:1789131075.809196:0:16386:0:(genops.c:885:class_export_put()) final put ffff91ddff54c800/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1789131075.809253:0:16386:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1789131075.809259:0:16386:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789131075.809265:0:16386:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1789131075.809270:0:16386:0:(genops.c:1558:class_disconnect_exports()) OBD device 23 (ffff91dcc6f59a48) has no exports 00000020:00000080:1.0:1789131075.817113:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff91ddff54c800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1789131075.891238:0:16386:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789131075.891256:0:16386:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:2.0:1789131075.891264:0:16386:0:(genops.c:885:class_export_put()) final put ffff91ddff54b000/lustre-OST0001-osd_UUID 00000020:00000080:2.0:1789131075.891269:0:16386:0:(genops.c:844:class_export_destroy()) destroying export ffff91ddff54b000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1789131075.891277:0:16386:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:2.0:1789131075.891775:0:16386:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff91ddff54d800 00000020:01000000:2.0:1789131075.891803:0:16386:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:2.0:1789131075.891808:0:16386:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789131075.891813:0:16386:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789131075.891818:0:16386:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff91ddff71ced8) has no exports 00000020:00000080:2.0:1789131075.891862:0:16386:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789131075.891867:0:16386:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:2.0:1789131075.891870:0:16386:0:(genops.c:885:class_export_put()) final put ffff91ddff78b000/OSS_uuid 00000020:00000080:2.0:1789131075.891873:0:16386:0:(genops.c:844:class_export_destroy()) destroying export ffff91ddff78b000/OSS_uuid for OSS 00000020:01000000:2.0:1789131075.891879:0:16386:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:1.0:1789131075.892162:0:8417:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff91ddfcfe5c00:8417] 2 exiting: rc = 0 00000100:00100000:1.0:1789131075.892271:0:8416:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff91ddfd009c00:8416] 1 exiting: rc = 0 00000100:00080000:0.0:1789131075.893189:0:6495:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:0.0:1789131075.893348:0:8414:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff91ddff3bc800:8414] 0 exiting: rc = 1 00000100:00100000:3.0:1789131075.894295:0:9827:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff91dcc6db0400:9827] 3 exiting: rc = 0 00000100:00100000:0.0:1789131075.895356:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.895367:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.895405:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.895412:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.895429:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.895435:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.895441:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.895447:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.895453:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.895481:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.895488:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.895495:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.895503:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.895509:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.895514:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.895519:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.895525:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.895530:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.895535:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.895541:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.895546:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.895551:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.895556:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.895561:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.895566:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.895572:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.895577:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.895583:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.895590:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.895595:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.895601:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.895607:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.895613:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.895619:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.895624:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.895641:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.895649:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.895663:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.895669:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.895685:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.895693:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.895699:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.895704:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.895712:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.895720:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.895726:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.895732:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.895738:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.895744:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.895749:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.895756:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.895762:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.895769:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.895776:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.895782:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.895788:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.895794:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.895799:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.895804:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.895811:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.895817:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.895822:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.895827:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.895834:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.903635:0:8419:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff91ddff563800:8419] 1 exiting: rc = 0 00000100:00100000:2.0:1789131075.904952:0:14495:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff91dcc7b38000:14495] 2 exiting: rc = 0 00000100:00100000:1.0:1789131075.906557:0:8418:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff91ddfcfe5400:8418] 0 exiting: rc = 1 00000100:00100000:0.0:1789131075.906876:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.906901:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.906910:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.906918:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.906924:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.906931:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.906937:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.906952:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.906959:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.906966:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.906971:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.907023:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.907035:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.907041:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.907047:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.907052:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.907058:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.907064:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.907075:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.907080:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.907087:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.907093:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.907099:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.907105:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.907111:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.907117:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.907127:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.907134:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.907139:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.907145:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.907154:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.907161:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.907167:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.907172:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.907178:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.907184:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.907193:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.907200:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.907205:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.907211:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.907217:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.907223:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.907241:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.907247:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.907253:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.907259:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.907265:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.907271:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.907276:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.907282:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.907294:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.907302:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.907312:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.907318:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.907324:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.907331:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.907336:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.907347:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.907354:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.907359:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.907365:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.907371:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.907377:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.907394:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.909088:0:8422:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff91ddff550600:8422] 2 exiting: rc = 0 00000100:00100000:2.0:1789131075.909348:0:8420:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff91ddff419e00:8420] 0 exiting: rc = 1 00000100:00100000:2.0:1789131075.910398:0:8421:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff91ddff550800:8421] 1 exiting: rc = 0 00000100:00100000:0.0:1789131075.910550:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.910572:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.910581:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.910588:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.910594:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.910600:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.910606:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.910613:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.910619:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.910624:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.910637:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.910651:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.910674:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.910680:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.910686:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.910692:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.910698:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.910704:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.910711:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.910717:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.910723:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.910730:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.910736:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.910743:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.911058:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.911070:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.911077:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.911083:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.911089:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.911095:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.911101:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.911108:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.911118:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.911124:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.911151:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.911159:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.911164:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.911170:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.911175:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.911446:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.911488:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.911496:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.911506:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.911513:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.911520:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.911527:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.911532:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.911552:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.911559:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.911566:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.914704:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.914715:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.914721:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.914728:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.914735:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.914741:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.914748:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.914755:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.914761:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.914792:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.914800:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.914807:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.914813:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131075.914828:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131075.930118:0:8424:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff91ddff551a00:8424] 1 exiting: rc = 0 00000100:00100000:3.0:1789131075.930247:0:8423:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff91ddff551c00:8423] 0 exiting: rc = 1 00000100:00100000:2.0:1789131075.930410:0:8864:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_002: service thread [ffff91dcc5fbca00:8864] 2 exiting: rc = 0 00000100:00100000:1.0:1789131075.933851:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131075.933866:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131075.933872:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131075.933878:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131075.933884:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131075.933889:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131075.933895:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131075.933901:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131075.933906:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131075.933912:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131075.933918:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131075.933925:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131075.933931:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131075.933936:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131075.933942:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131075.933947:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131075.933988:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131075.933996:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131075.934016:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131075.934024:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131075.934030:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131075.934036:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131075.934041:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131075.934047:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131075.934052:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131075.934058:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131075.934064:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131075.934070:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131075.934075:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131075.934080:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131075.934084:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131075.934090:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131075.934095:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131075.934100:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131075.934105:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131075.934127:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131075.934132:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131075.934137:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131075.934142:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131075.934148:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131075.934153:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131075.934159:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131075.934165:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131075.934171:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131075.934177:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131075.934182:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131075.934187:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131075.934194:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131075.934200:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131075.934206:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131075.934212:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131075.934218:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131075.934224:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131075.934230:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131075.934236:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131075.934242:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131075.934248:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131075.934254:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131075.934261:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131075.934267:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131075.934273:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131075.934280:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131075.934287:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131075.934293:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131075.936002:0:8425:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff91dded7c8a00:8425] 0 exiting: rc = 1 00000100:00100000:1.0:1789131075.937143:0:8426:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff91ddc5753200:8426] 1 exiting: rc = 0 00000100:00100000:2.0:1789131075.937227:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789131075.937238:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789131075.937245:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789131075.937252:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789131075.937259:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789131075.937265:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789131075.937272:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789131075.937279:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789131075.937307:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789131075.937316:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789131075.937323:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789131075.937330:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789131075.937338:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789131075.937345:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789131075.937352:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789131075.937360:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789131075.937367:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789131075.937374:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789131075.937381:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789131075.937388:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789131075.937410:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789131075.937431:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789131075.937439:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789131075.937445:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789131075.937452:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789131075.937513:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789131075.937522:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789131075.937530:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789131075.937537:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789131075.937544:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789131075.937552:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789131075.937559:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789131075.937582:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789131075.937590:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789131075.937597:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789131075.937604:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789131075.937611:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789131075.937617:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789131075.937623:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789131075.937630:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789131075.937637:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789131075.937644:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789131075.937650:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789131075.937657:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789131075.937677:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789131075.937684:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789131075.937691:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789131075.937698:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789131075.937704:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789131075.937711:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789131075.937718:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789131075.937725:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789131075.937731:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789131075.937737:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789131075.937744:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789131075.937752:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789131075.937775:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789131075.937784:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789131075.937791:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789131075.937798:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789131075.937813:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789131075.937820:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789131075.937829:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789131075.937836:0:16386:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:3.0:1789131075.949208:0:16386:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:2.0:1789131095.784390:0:17150:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg311-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1789131106.205261:0:17750:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1789131106.205268:0:17750:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:0.0:1789131106.205269:0:17750:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1789131106.205390:0:17750:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff91dcc78a7000 00000020:01000004:0.0:1789131106.205406:0:17750:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:0.0:1789131106.205413:0:17750:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1789131106.205434:0:17750:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff91de01a00000) 00000020:00000080:0.0:1789131106.205447:0:17750:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1789131106.283863:0:17750:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1789131106.284160:0:17750:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1789131106.291747:0:17750:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:2.0:1789131106.293144:0:17750:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1789131106.295433:0:17750:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1789131106.295949:0:17750:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:2.0:1789131106.296410:0:17750:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1789131106.298027:0:17750:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:2.0:1789131106.298497:0:17750:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:2.0:1789131106.298888:0:17750:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1789131106.299222:0:17750:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1789131106.301128:0:17750:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:3.0:1789131106.301624:0:17750:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1789131106.301904:0:17750:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:3.0:1789131106.302212:0:17750:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:3.0:1789131106.302594:0:17750:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1789131106.302885:0:17750:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1789131106.303157:0:17750:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1789131106.303813:0:17750:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1789131106.304162:0:17750:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:3.0:1789131106.305021:0:17750:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1789131106.305599:0:17750:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1789131106.306985:0:17750:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1789131106.307897:0:17750:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:3.0:1789131106.308196:0:17750:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1789131106.308407:0:17750:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:3.0:1789131106.309164:0:17750:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1789131106.309849:0:17750:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:3.0:1789131106.310117:0:17750:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1789131106.310436:0:17750:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1789131106.310772:0:17750:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:3.0:1789131106.311059:0:17750:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1789131106.311409:0:17750:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:3.0:1789131106.311847:0:17750:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1789131106.312048:0:17750:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1789131106.315772:0:17750:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:3.0:1789131106.317115:0:17750:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:3.0:1789131106.318027:0:17750:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1789131106.318658:0:17750:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:3.0:1789131106.319167:0:17750:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:3.0:1789131106.319386:0:17750:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:3.0:1789131106.320667:0:17750:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:3.0:1789131106.320894:0:17750:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1789131106.321562:0:17750:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1789131106.323018:0:17750:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1789131106.323809:0:17750:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1789131106.324197:0:17750:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1789131106.325098:0:17750:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:3.0:1789131106.325621:0:17750:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:3.0:1789131106.326918:0:17750:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:3.0:1789131106.327541:0:17750:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:2.0:1789131106.328213:0:17750:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:2.0:1789131106.329027:0:17750:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:01000000:2.0:1789131106.330005:0:17750:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1789131106.330609:0:17750:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1789131106.330618:0:17750:0:(osd_handler.c:8895:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789131106.330629:0:17750:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf3fe2838e1fc32ff 00000020:01000004:2.0:1789131106.330636:0:17750:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:2.0:1789131106.330640:0:17750:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1789131106.330645:0:17750:0:(tgt_mount.c:101:server_register_mount()) register mount ffff91dcc78a7000 from MGS 00000020:01000004:2.0:1789131106.330649:0:17750:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1789131106.330660:0:17750:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff91dcc6f59a48) 00000020:00000080:2.0:1789131106.330669:0:17750:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1789131106.330992:0:17750:0:(tgt_mount.c:153:server_get_mount()) get mount ffff91dcc78a7000 from MGS, refs=2 00080000:01000000:2.0:1789131106.330998:0:17750:0:(osd_handler.c:8895:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789131106.331013:0:17750:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf3fe2838e1fc330d 00000100:00100000:2.0:1789131106.331271:0:17750:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1789131106.331666:0:17750:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1789131106.331742:0:17750:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1789131106.335045:0:17750:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1789131106.335058:0:17750:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1789131106.335781:0:17750:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789131106.335942:0:17750:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1789131106.335948:0:17750:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1789131106.336993:0:17750:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1789131106.337001:0:17750:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1789131106.337390:0:17750:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1789131106.337397:0:17750:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1789131106.338052:0:17759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131106.338055:0:17759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131106.338057:0:17759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789131106.338519:0:17760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789131106.338522:0:17760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789131106.338523:0:17760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789131106.339071:0:17750:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1789131106.344307:0:17759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1789131106.352675:0:17750:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:2.0:1789131106.353573:0:17762:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1789131106.353617:0:17750:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1789131106.353655:0:17750:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1789131106.358862:0:17750:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1789131106.359149:0:17750:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789131106.359303:0:17750:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1789131106.359308:0:17750:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1789131106.361701:0:17750:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1789131106.361714:0:17750:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1789131106.362589:0:17750:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1789131106.362596:0:17750:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1789131106.363802:0:17750:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1789131106.363823:0:17750:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.111@tcp' 00000020:01000004:3.0:1789131106.363825:0:17750:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1789131106.363856:0:17750:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.111@tcp (typ=mgc) 00000020:00000080:3.0:1789131106.363868:0:17750:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.111@tcp (ffff91ddff71ced8) 00000020:00000080:3.0:1789131106.363883:0:17750:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1789131106.363955:0:17750:0:(ldlm_lib.c:102:import_set_conn()) imp ffff91ddd1dca000@MGC192.168.203.111@tcp: add connection 192.168.203.111@tcp at head 00010000:00010000:3.0:1789131106.364094:0:17750:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.111@tcp-0 is initialized 00000040:01000000:3.0:1789131106.364099:0:17750:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.111@tcp ctxt 1 is initialized 00000100:00080000:2.0:1789131106.364359:0:17767:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:1.0:1789131106.367007:0:17768:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1789131106.367076:0:17750:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.111@tcp (uuid f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20) 00000020:00000080:3.0:1789131106.367097:0:17750:0:(genops.c:1385:class_connect()) connect: client f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20, cookie 0xf3fe2838e1fc331b 00000100:00080000:3.0:1789131106.367108:0:17750:0:(import.c:510:import_select_connection()) MGC192.168.203.111@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789131106.367114:0:17750:0:(import.c:624:import_select_connection()) MGC192.168.203.111@tcp: import ffff91ddd1dca000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:3.0:1789131106.367144:0:17750:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91ddd1dac780 x1876039508873216/t0(0) o250->MGC192.168.203.111@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789131106.367179:0:17750:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20->MGS 00000020:01000004:3.0:1789131106.367208:0:17750:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1789131106.367212:0:17750:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1789131106.367224:0:17750:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff91ddff719a48) 00000020:00000080:3.0:1789131106.367234:0:17750:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1789131106.367547:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd1dac780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:3624:1876039508873216:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1789131106.367615:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131106.368542:0:17764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508873216 00000100:00100000:1.0:1789131106.368551:0:17764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508873216 00000100:00100000:1.0:1789131106.368585:0:17764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789131106.368597:0:17764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc1ed5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3624:x1876039508873216:12345-0@lo:250:mount.lustre.0 00010000:00080000:1.0:1789131106.368622:0:17764:0:(ldlm_lib.c:1482:target_handle_connect()) MGS: connection from f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20@0@lo t0 exp 0000000000000000 cur 462 last 0 00000020:00000080:1.0:1789131106.368643:0:17764:0:(genops.c:1385:class_connect()) connect: client f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20, cookie 0xf3fe2838e1fc3329 00000100:00080000:1.0:1789131106.368756:0:17764:0:(import.c:65:import_set_state_nolock()) ffff91dcc8f28800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789131106.368819:0:17764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc1ed5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+5:3624:x1876039508873216:12345-0@lo:250:mount.lustre.0 Request processed in 221us (1203us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131106.368827:0:17764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789131106.368866:0:3624:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.203.111@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1789131106.368874:0:3624:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.111@tcp: connect to target with instance 0 00000100:00080000:1.0:1789131106.368881:0:3624:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.111@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1789131106.368885:0:3624:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1789131106.368888:0:3624:0:(import.c:65:import_set_state_nolock()) ffff91ddd1dca000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1789131106.368891:0:3624:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1789131106.368898:0:3624:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1789131106.368903:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd1dac780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:3624:1876039508873216:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1789131106.384538:0:17750:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789131106.384742:0:17750:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1789131106.384749:0:17750:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1789131106.393554:0:17750:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1789131106.393573:0:17750:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1789131106.395721:0:17750:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1789131106.395735:0:17750:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1789131106.397874:0:17750:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789131106.398056:0:17750:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1789131106.398062:0:17750:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1789131106.398721:0:17750:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1789131106.398728:0:17750:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1789131106.468824:0:17750:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789131106.469024:0:17750:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1789131106.469030:0:17750:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1789131106.473441:0:17750:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1789131106.473524:0:17750:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1789131106.474242:0:17750:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789131106.474410:0:17750:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789131106.474416:0:17750:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1789131106.476520:0:17750:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1789131106.476530:0:17750:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1789131106.477270:0:17750:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789131106.477432:0:17750:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789131106.477437:0:17750:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1789131106.478086:0:17750:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1789131106.478094:0:17750:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1789131106.478857:0:17750:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789131106.479005:0:17750:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789131106.479010:0:17750:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1789131106.479760:0:17750:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1789131106.479768:0:17750:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1789131106.500036:0:17750:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789131106.500375:0:17750:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1789131106.500382:0:17750:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1789131106.502433:0:17750:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1789131106.502444:0:17750:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1789131106.503896:0:17750:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1789131106.503905:0:17750:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1789131106.505050:0:17750:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1789131106.505081:0:17750:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:1.0:1789131106.505087:0:17750:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.111@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1789131106.505345:0:17750:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.111@tcp ctxt 0 is initialized 00000020:01000004:1.0:1789131106.505377:0:17750:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.111@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1789131106.505382:0:17750:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1789131106.505384:0:17750:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789131106.505389:0:17750:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789131106.505390:0:17750:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789131106.505392:0:17750:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789131106.505393:0:17750:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789131106.505394:0:17750:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789131106.505395:0:17750:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789131106.505397:0:17750:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789131106.505397:0:17750:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789131106.505400:0:17750:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1789131106.505401:0:17750:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789131106.505402:0:17750:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789131106.505403:0:17750:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789131106.505404:0:17750:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789131106.505405:0:17750:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789131106.505405:0:17750:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789131106.505406:0:17750:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789131106.505407:0:17750:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789131106.505408:0:17750:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789131106.505409:0:17750:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789131106.505434:0:17750:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1789131106.505453:0:17750:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8497840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:17750:1876039508873344:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789131106.505637:0:17750:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131106.505719:0:17750:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddc3293480 going to sleep for 11 seconds 00000100:00100000:2.0:1789131106.505776:0:17766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508873344 00000100:00100000:2.0:1789131106.505783:0:17766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508873344 00000100:00100000:2.0:1789131106.505862:0:17766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789131106.505871:0:17766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc1ed4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+5:17750:x1876039508873344:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789131106.505925:0:17766:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1789131106.505928:0:17766:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1789131106.505932:0:17766:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:2.0:1789131106.506313:0:17787:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1789131106.506833:0:17766:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 6 20000000:01000000:3.0:1789131106.508431:0:17788:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1789131106.508439:0:17788:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:3.0:1789131106.508442:0:17788:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1789131106.508452:0:17788:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1789131106.508804:0:17788:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:0.0:1789131106.508990:0:17766:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1789131106.509000:0:17766:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1789131106.512040:0:17766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc1ed4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+5:17750:x1876039508873344:12345-0@lo:253:mount.lustre.0 Request processed in 6161us (6394us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131106.512058:0:17766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789131106.512369:0:17750:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8497840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:17750:1876039508873344:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789131106.512384:0:17750:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1789131106.512387:0:17750:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789131106.512389:0:17750:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789131106.512390:0:17750:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789131106.512391:0:17750:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789131106.512392:0:17750:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789131106.512393:0:17750:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789131106.512394:0:17750:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789131106.512395:0:17750:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789131106.512397:0:17750:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789131106.512398:0:17750:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789131106.512426:0:17750:0:(tgt_mount.c:101:server_register_mount()) register mount ffff91dcc78a7000 from lustre-MDT0000 10000000:01000000:1.0:1789131106.512643:0:17750:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1789131106.512653:0:17750:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1789131106.512657:0:17750:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff91ddff71ced8 10000000:01000000:1.0:1789131106.512660:0:17750:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789131106.512667:0:17750:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff91ddff71ced8 from 1 10000000:01000000:1.0:1789131106.512670:0:17750:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789131106.512707:0:17750:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff91dcc85cb600/0xf3fe2838e1fc3330 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131106.512718:0:17750:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff91dcc85cb600/0xf3fe2838e1fc3330 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131106.512727:0:17750:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff91dcc85cb600/0xf3fe2838e1fc3330 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131106.512746:0:17750:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8497840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:17750:1876039508873472:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789131106.512782:0:17750:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131106.512864:0:17750:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddc3293240 going to sleep for 11 seconds 00000100:00100000:0.0:1789131106.512906:0:17765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508873472 00000100:00100000:0.0:1789131106.512913:0:17765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508873472 00000100:00100000:0.0:1789131106.512983:0:17765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789131106.512993:0:17765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc1ed6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+5:17750:x1876039508873472:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789131106.513006:0:17765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789131106.513021:0:17765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91de01ad6c00/0xf3fe2838e1fc3337 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3fe2838e1fc3330 expref: -99 pid: 17765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131106.513043:0:17765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91de01ad6c00/0xf3fe2838e1fc3337 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3fe2838e1fc3330 expref: 6 pid: 17765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131106.513053:0:17765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91de01ad6c00/0xf3fe2838e1fc3337 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc3330 expref: 6 pid: 17765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131106.513061:0:17765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91de01ad6c00, rc 0) 00000100:00100000:0.0:1789131106.513103:0:17765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc1ed6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+6:17750:x1876039508873472:12345-0@lo:101:mount.lustre.0 Request processed in 112us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131106.513110:0:17765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789131106.513245:0:17750:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8497840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:17750:1876039508873472:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789131106.513259:0:17750:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff91dcc85cb600/0xf3fe2838e1fc3330 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc3337 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131106.513266:0:17750:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff91dcc85cb600/0xf3fe2838e1fc3330 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3fe2838e1fc3337 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131106.513404:0:17750:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd286d2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:17750:1876039508873600:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789131106.513445:0:17750:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131106.513741:0:17750:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddfce48780 going to sleep for 11 seconds 00000100:00100000:1.0:1789131106.513790:0:17764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508873600 00000100:00100000:1.0:1789131106.513795:0:17764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508873600 00000100:00100000:3.0:1789131106.513836:0:17766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789131106.513846:0:17766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc1ed5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+6:17750:x1876039508873600:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789131106.513925:0:17766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc1ed5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+6:17750:x1876039508873600:12345-0@lo:501:mount.lustre.0 Request processed in 81us (479us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789131106.513932:0:17766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789131106.514003:0:17750:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd286d2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:17750:1876039508873600:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1789131106.514034:0:17750:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1789131106.514046:0:17750:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff91dcc85cb600/0xf3fe2838e1fc3330 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc3337 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131106.514055:0:17750:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff91dcc85cb600/0xf3fe2838e1fc3330 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc3337 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789131106.514063:0:17750:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff91dcc78a7000 10000000:01000000:2.0:1789131106.514068:0:17750:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789131106.514072:0:17750:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff91dcc78a7000 10000000:01000000:2.0:1789131106.514075:0:17750:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1789131106.514078:0:17750:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff91dcc78a7000 from 1 10000000:01000000:2.0:1789131106.514080:0:17750:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1789131106.514109:0:17750:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7f000/0xf3fe2838e1fc333e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131106.514116:0:17750:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7f000/0xf3fe2838e1fc333e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131106.514123:0:17750:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7f000/0xf3fe2838e1fc333e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131106.514137:0:17750:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd286d2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:17750:1876039508873728:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789131106.514177:0:17750:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131106.514196:0:17750:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddfce48780 going to sleep for 11 seconds 00000100:00100000:3.0:1789131106.514261:0:17766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508873728 00000100:00100000:3.0:1789131106.514265:0:17766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508873728 00000100:00100000:3.0:1789131106.514294:0:17766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789131106.514300:0:17766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc1ed7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+6:17750:x1876039508873728:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789131106.514308:0:17766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789131106.514318:0:17766:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91ddfd0b4000/0xf3fe2838e1fc3345 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3fe2838e1fc333e expref: -99 pid: 17766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131106.514332:0:17766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91ddfd0b4000/0xf3fe2838e1fc3345 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3fe2838e1fc333e expref: 7 pid: 17766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131106.514340:0:17766:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91ddfd0b4000/0xf3fe2838e1fc3345 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc333e expref: 7 pid: 17766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131106.514348:0:17766:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ddfd0b4000, rc 0) 00000100:00100000:3.0:1789131106.514382:0:17766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc1ed7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+7:17750:x1876039508873728:12345-0@lo:101:mount.lustre.0 Request processed in 82us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131106.514388:0:17766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789131106.514728:0:17750:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd286d2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:17750:1876039508873728:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789131106.514740:0:17750:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7f000/0xf3fe2838e1fc333e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc3345 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131106.514748:0:17750:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7f000/0xf3fe2838e1fc333e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3fe2838e1fc3345 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789131106.514758:0:17750:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1789131106.514762:0:17750:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7f000/0xf3fe2838e1fc333e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc3345 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131106.514769:0:17750:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7f000/0xf3fe2838e1fc333e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc3345 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789131106.514775:0:17750:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1789131106.514778:0:17750:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789131106.514782:0:17750:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff91dcc78a7000 10000000:01000000:2.0:1789131106.514791:0:17750:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1789131106.514794:0:17750:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1789131106.514796:0:17750:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1789131106.514812:0:17750:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7f400/0xf3fe2838e1fc334c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131106.514819:0:17750:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7f400/0xf3fe2838e1fc334c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131106.514826:0:17750:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7f400/0xf3fe2838e1fc334c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131106.514839:0:17750:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd286d2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:17750:1876039508873856:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789131106.514866:0:17750:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131106.514895:0:17750:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddfce48780 going to sleep for 11 seconds 00000100:00100000:3.0:1789131106.514943:0:17766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508873856 00000100:00100000:3.0:1789131106.514947:0:17766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508873856 00000100:00100000:3.0:1789131106.514968:0:17766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789131106.514974:0:17766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc1ed6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+7:17750:x1876039508873856:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789131106.514988:0:17766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789131106.514997:0:17766:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91ddfd0b4e00/0xf3fe2838e1fc3353 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3fe2838e1fc334c expref: -99 pid: 17766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131106.515011:0:17766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91ddfd0b4e00/0xf3fe2838e1fc3353 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3fe2838e1fc334c expref: 8 pid: 17766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131106.515018:0:17766:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91ddfd0b4e00/0xf3fe2838e1fc3353 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc334c expref: 8 pid: 17766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131106.515025:0:17766:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ddfd0b4e00, rc 0) 00000100:00100000:3.0:1789131106.515061:0:17766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc1ed6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+8:17750:x1876039508873856:12345-0@lo:101:mount.lustre.0 Request processed in 87us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131106.515068:0:17766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789131106.515393:0:17750:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd286d2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:17750:1876039508873856:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789131106.515404:0:17750:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7f400/0xf3fe2838e1fc334c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc3353 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131106.515549:0:17750:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7f400/0xf3fe2838e1fc334c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3fe2838e1fc3353 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131106.515597:0:17750:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd286d2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:17750:1876039508873984:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789131106.515622:0:17750:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131106.515646:0:17750:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddfce48780 going to sleep for 11 seconds 00000100:00100000:3.0:1789131106.515688:0:17766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508873984 00000100:00100000:3.0:1789131106.515693:0:17766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508873984 00000100:00100000:3.0:1789131106.515712:0:17766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789131106.515718:0:17766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc1ed6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+8:17750:x1876039508873984:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789131106.515824:0:17766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc1ed6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+9:17750:x1876039508873984:12345-0@lo:501:mount.lustre.0 Request processed in 106us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131106.515831:0:17766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789131106.516058:0:17750:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd286d2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:17750:1876039508873984:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789131106.516083:0:17750:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd286d2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:17750:1876039508874112:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789131106.516119:0:17750:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131106.516143:0:17750:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddfce48780 going to sleep for 11 seconds 00000100:00100000:3.0:1789131106.516247:0:17766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508874112 00000100:00100000:3.0:1789131106.516252:0:17766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508874112 00000100:00100000:3.0:1789131106.516268:0:17766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789131106.516273:0:17766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc1ed4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+9:17750:x1876039508874112:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789131106.516807:0:17766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc1ed4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+9:17750:x1876039508874112:12345-0@lo:503:mount.lustre.0 Request processed in 532us (686us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131106.516822:0:17766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789131106.516899:0:17750:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd286d2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:17750:1876039508874112:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789131106.517294:0:17789:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd286d2c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:17789:1876039508874240:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789131106.517328:0:17789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131106.517388:0:17789:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddfce48240 going to sleep for 11 seconds 00000100:00100000:1.0:1789131106.517552:0:17764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508874240 00000100:00100000:1.0:1789131106.517557:0:17764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508874240 00000100:00100000:1.0:1789131106.517578:0:17764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789131106.517584:0:17764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc1ed4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+9:17789:x1876039508874240:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789131106.518111:0:17764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc1ed4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+9:17789:x1876039508874240:12345-0@lo:502:llog_process_th.0 Request processed in 525us (781us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131106.518118:0:17764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789131106.518197:0:17789:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd286d2c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:17789:1876039508874240:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789131106.518231:0:17789:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789131106.518242:0:17789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789131106.518245:0:17789:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1789131106.518250:0:17789:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1789131106.518253:0:17789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789131106.518267:0:17789:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff91dcc6f5b490) 00000020:00000080:2.0:1789131106.518282:0:17789:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1789131106.518287:0:17789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1789131106.518365:0:17789:0:(osd_handler.c:8895:osd_obd_connect()) connect #2 00000020:00000080:2.0:1789131106.518372:0:17789:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf3fe2838e1fc3361 00000020:00000080:2.0:1789131106.518605:0:17789:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1789131106.518610:0:17789:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789131106.518614:0:17789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789131106.518616:0:17789:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1789131106.518618:0:17789:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789131106.518622:0:17789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789131106.518623:0:17789:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1789131106.518626:0:17789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789131106.518634:0:17789:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff91dcc6f58000) 00000020:00000080:2.0:1789131106.518644:0:17789:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1789131106.518648:0:17789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1789131106.518650:0:17789:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1789131106.518652:0:17789:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1789131106.518658:0:17789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789131106.518711:0:17789:0:(tgt_mount.c:153:server_get_mount()) get mount ffff91dcc78a7000 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1789131106.518724:0:17789:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff91dcc6f5ced8) 00000020:00000080:2.0:1789131106.518732:0:17789:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1789131106.518776:0:17789:0:(lod_dev.c:2292:lod_obd_connect()) connect #0 00000020:00000080:2.0:1789131106.518782:0:17789:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf3fe2838e1fc3376 00000020:00000080:2.0:1789131106.518864:0:17789:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1789131106.518870:0:17789:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1789131106.518875:0:17789:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xf3fe2838e1fc337d 00080000:01000000:2.0:1789131106.518880:0:17789:0:(osd_handler.c:8895:osd_obd_connect()) connect #3 00000020:00000080:2.0:1789131106.518884:0:17789:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf3fe2838e1fc3384 00010000:00010000:1.0:1789131106.599857:0:17789:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:1.0:1789131106.600599:0:17789:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967528 00000001:00080000:1.0:1789131106.600977:0:17789:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1789131106.601535:0:17789:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff91ddcf69b490) 00000020:00000080:1.0:1789131106.601566:0:17789:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1789131106.601646:0:17789:0:(osd_handler.c:8895:osd_obd_connect()) connect #4 00000020:00000080:1.0:1789131106.601654:0:17789:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf3fe2838e1fc3392 00000020:00000080:3.0:1789131106.602447:0:17789:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1789131106.607066:0:17789:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xf3fe2838e1fc3399 00000020:00000080:2.0:1789131106.609406:0:17789:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1789131106.609622:0:17789:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789131106.609629:0:17789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789131106.609695:0:17789:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1789131106.609700:0:17789:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1789131106.609703:0:17789:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:2.0:1789131106.609704:0:17789:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789131106.609706:0:17789:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789131106.609707:0:17789:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1789131106.609711:0:17789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789131106.609712:0:17789:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:2.0:1789131106.609714:0:17789:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789131106.609718:0:17789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789131106.609720:0:17789:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1789131106.609724:0:17789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1789131106.609773:0:17789:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1789131106.609791:0:17789:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789131106.609794:0:17789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789131106.609795:0:17789:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1789131106.609798:0:17789:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789131106.609801:0:17789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789131106.609802:0:17789:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:2.0:1789131106.609804:0:17789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789131106.609809:0:17789:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.111@tcp to nid 0x20000c0a8cb6f (192.168.203.111@tcp) 00000020:00000080:2.0:1789131106.609842:0:17789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789131106.609859:0:17789:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff91ddd10e8000) 00000020:00000080:2.0:1789131106.609875:0:17789:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1789131106.609880:0:17789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789131106.609933:0:17789:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:2.0:1789131106.609939:0:17789:0:(osd_handler.c:8895:osd_obd_connect()) connect #5 00000020:00000080:2.0:1789131106.609945:0:17789:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf3fe2838e1fc33a7 00010000:00080000:2.0:1789131106.609978:0:17789:0:(ldlm_lib.c:102:import_set_conn()) imp ffff91ddcf4da000@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.111@tcp at head 00010000:00010000:2.0:1789131106.613755:0:17789:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:2.0:1789131106.616830:0:17789:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789131106.616846:0:17789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1789131106.616887:0:17789:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:2.0:1789131106.616911:0:17789:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf3fe2838e1fc33ae 00000100:00080000:2.0:1789131106.616923:0:17789:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789131106.616929:0:17789:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff91ddcf4da000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:2.0:1789131106.616963:0:17789:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91ddd286d2c0 x1876039508874368/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789131106.616992:0:17789:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:2.0:1789131106.617091:0:17789:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789131106.617095:0:17789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789131106.617097:0:17789:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:2.0:1789131106.617099:0:17789:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1789131106.617102:0:17789:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:2.0:1789131106.617104:0:17789:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789131106.617106:0:17789:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789131106.617107:0:17789:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1789131106.617110:0:17789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789131106.617111:0:17789:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:2.0:1789131106.617114:0:17789:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789131106.617119:0:17789:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1789131106.617122:0:17789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789131106.617131:0:17789:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1789131106.617134:0:17789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789131106.617138:0:17789:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.111@tcp to nid 0x20000c0a8cb6f (192.168.203.111@tcp) 00000020:01000000:2.0:1789131106.617161:0:17789:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1789131106.617164:0:17789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789131106.617176:0:17789:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff91ddd10e9a48) 00000020:00000080:2.0:1789131106.617188:0:17789:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:2.0:1789131106.617193:0:17789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789131106.617257:0:17789:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1789131106.617273:0:17789:0:(osd_handler.c:8895:osd_obd_connect()) connect #6 00000020:00000080:2.0:1789131106.617279:0:17789:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf3fe2838e1fc33bc 00010000:00080000:2.0:1789131106.617318:0:17789:0:(ldlm_lib.c:102:import_set_conn()) imp ffff91dcc85e4800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.111@tcp at head 00000100:00100000:1.0:1789131106.617582:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd286d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3624:1876039508874368:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789131106.617655:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131106.617784:0:17776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508874368 00000100:00100000:0.0:1789131106.617791:0:17776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508874368 00000100:00100000:0.0:1789131106.617827:0:17776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789131106.617835:0:17776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8494000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3624:x1876039508874368:12345-0@lo:38:llog_process_th.0 00010000:00020000:0.0:1789131106.617850:0:17776:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00010000:2.0:1789131106.618328:0:17789:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000040:01000000:2.0:1789131106.619446:0:17789:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1789131106.619860:0:17789:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1789131106.624120:0:17789:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789131106.625624:0:17789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:2.0:1789131106.635886:0:17789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:2.0:1789131106.641666:0:17795:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789131106.641678:0:17795:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1789131106.643566:0:17789:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789131106.643586:0:17789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1789131106.643642:0:17789:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1789131106.643669:0:17789:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf3fe2838e1fc33c3 00000100:00080000:2.0:1789131106.643683:0:17789:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789131106.643690:0:17789:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff91dcc85e4800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:2.0:1789131106.643737:0:17789:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91ddd286ed00 x1876039508874496/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789131106.643768:0:17789:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:1.0:1789131106.643827:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd286ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3624:1876039508874496:0@lo:8:llog_process_th.0 00000020:01000000:2.0:1789131106.643840:0:17789:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789131106.643855:0:17789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789131106.643858:0:17789:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1789131106.643862:0:17789:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1789131106.643865:0:17789:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:2.0:1789131106.643867:0:17789:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789131106.643870:0:17789:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789131106.643872:0:17789:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1789131106.643876:0:17789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789131106.643878:0:17789:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:2.0:1789131106.643882:0:17789:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789131106.643887:0:17789:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1789131106.643892:0:17789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789131106.643896:0:17789:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000400:00000100:1.0:1789131106.643898:0:3624:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876039508874496 offset 0 length 520: 4 00000020:00000080:2.0:1789131106.643905:0:17789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789131106.643913:0:17789:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.111@tcp to nid 0x20000c0a8cb6f (192.168.203.111@tcp) 00000020:01000000:2.0:1789131106.643951:0:17789:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1789131106.643954:0:17789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789131106.643972:0:17789:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff91ddd10eced8) 00000020:00000080:2.0:1789131106.643986:0:17789:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:2.0:1789131106.643991:0:17789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789131106.644078:0:17789:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1789131106.644087:0:17789:0:(osd_handler.c:8895:osd_obd_connect()) connect #7 00000020:00000080:2.0:1789131106.644094:0:17789:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf3fe2838e1fc33d1 00010000:00080000:2.0:1789131106.644132:0:17789:0:(ldlm_lib.c:102:import_set_conn()) imp ffff91dcc85e2000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.111@tcp at head 00010000:00010000:2.0:1789131106.644380:0:17789:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:2.0:1789131106.644495:0:17789:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1789131106.644515:0:17789:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:0.0:1789131106.650362:0:17776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8494000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3624:x1876039508874368:12345-0@lo:38:llog_process_th.0 Request processed in 32515us (32696us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789131106.650377:0:17776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1789131106.650438:0:3624:0:(import.c:65:import_set_state_nolock()) ffff91ddcf4da000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789131106.650443:0:3624:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000040:00080000:2.0:1789131106.652133:0:17789:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789131106.652624:0:17789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:2.0:1789131106.652774:0:17789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000100:00100000:0.0:1789131106.653104:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd286d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3624:1876039508874368:0@lo:38:llog_process_th.0 00000040:00080000:2.0:1789131106.655140:0:17797:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789131106.655151:0:17797:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1789131106.656078:0:17789:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789131106.656093:0:17789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789131106.656140:0:17789:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1789131106.656160:0:17789:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf3fe2838e1fc33d8 00000100:00080000:1.0:1789131106.656172:0:17789:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789131106.656177:0:17789:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff91dcc85e2000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:1.0:1789131106.656223:0:17789:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91dcc8497480 x1876039508874624/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789131106.656289:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3624:1876039508874624:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1789131106.656343:0:3624:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876039508874624 offset 0 length 520: 4 00000100:00080000:1.0:1789131106.656402:0:17789:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1789131106.656491:0:17789:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789131106.656497:0:17789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789131106.656499:0:17789:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1789131106.656503:0:17789:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789131106.656507:0:17789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789131106.656508:0:17789:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789131106.656511:0:17789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789131106.656513:0:17789:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789131106.656515:0:17789:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789131106.656517:0:17789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789131106.656518:0:17789:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:1.0:1789131106.656520:0:17789:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789131106.656532:0:17789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789131106.656533:0:17789:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789131106.656537:0:17789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1789131106.656578:0:17789:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8495680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:17789:1876039508874752:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789131106.656627:0:17789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131106.656663:0:17789:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddcf7a5600 going to sleep for 11 seconds 00000100:00100000:1.0:1789131106.656684:0:17765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508874752 00000100:00100000:1.0:1789131106.656689:0:17765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508874752 00000100:00100000:1.0:1789131106.656724:0:17765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789131106.656732:0:17765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc1ed5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+9:17789:x1876039508874752:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789131106.657073:0:17765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc1ed5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+9:17789:x1876039508874752:12345-0@lo:502:llog_process_th.0 Request processed in 340us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131106.657081:0:17765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789131106.657139:0:17789:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8495680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:17789:1876039508874752:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789131106.657162:0:17789:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789131106.657167:0:17789:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789131106.657169:0:17789:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789131106.657172:0:17789:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:1.0:1789131106.657445:0:17750:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:1.0:1789131106.657746:0:17750:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1789131106.657836:0:17750:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7f400/0xf3fe2838e1fc334c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc3353 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131106.657848:0:17750:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7f400/0xf3fe2838e1fc334c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc3353 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789131106.657857:0:17750:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff91dcc78a7000 from 1 10000000:01000000:1.0:1789131106.657860:0:17750:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789131106.657888:0:17750:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff91dcc85cac00/0xf3fe2838e1fc33df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131106.657903:0:17750:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff91dcc85cac00/0xf3fe2838e1fc33df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131106.657913:0:17750:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff91dcc85cac00/0xf3fe2838e1fc33df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131106.657930:0:17750:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8495680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:17750:1876039508874880:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789131106.657972:0:17750:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131106.658000:0:17750:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddcf7a5600 going to sleep for 11 seconds 00000100:00100000:1.0:1789131106.659392:0:17766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508874880 00000100:00100000:1.0:1789131106.659403:0:17766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508874880 00000100:00100000:1.0:1789131106.659481:0:17766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789131106.659490:0:17766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc1ed7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+9:17750:x1876039508874880:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789131106.659504:0:17766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789131106.659522:0:17766:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91dcc85ca200/0xf3fe2838e1fc33e6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3fe2838e1fc33df expref: -99 pid: 17766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131106.659846:0:17766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91dcc85ca200/0xf3fe2838e1fc33e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3fe2838e1fc33df expref: 10 pid: 17766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131106.659859:0:17766:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91dcc85ca200/0xf3fe2838e1fc33e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc33df expref: 10 pid: 17766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131106.659868:0:17766:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dcc85ca200, rc 0) 00000100:00100000:1.0:1789131106.659937:0:17766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc1ed7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+10:17750:x1876039508874880:12345-0@lo:101:mount.lustre.0 Request processed in 448us (1964us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131106.659945:0:17766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789131106.660046:0:17750:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8495680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:17750:1876039508874880:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789131106.660071:0:17750:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff91dcc85cac00/0xf3fe2838e1fc33df lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc33e6 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131106.660080:0:17750:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff91dcc85cac00/0xf3fe2838e1fc33df lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3fe2838e1fc33e6 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131106.660952:0:17750:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd286de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:17750:1876039508875008:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1789131106.661003:0:17750:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131106.661031:0:17750:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddd12036c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789131106.661483:0:17764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508875008 00000100:00100000:1.0:1789131106.661489:0:17764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508875008 00000100:00100000:1.0:1789131106.661522:0:17764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789131106.661530:0:17764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc1ed4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+10:17750:x1876039508875008:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1789131106.661619:0:17764:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1789131106.661628:0:17764:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1789131106.661748:0:17764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc1ed4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+10:17750:x1876039508875008:12345-0@lo:256:mount.lustre.0 Request processed in 219us (746us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131106.661846:0:17764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789131106.661923:0:17750:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd286de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:17750:1876039508875008:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1789131106.662753:0:17750:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789131106.662778:0:17750:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff91dcc85cac00/0xf3fe2838e1fc33df lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc33e6 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131106.662788:0:17750:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff91dcc85cac00/0xf3fe2838e1fc33df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc33e6 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789131106.662797:0:17750:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91dcc78a7000 from 1 10000000:01000000:2.0:1789131106.662800:0:17750:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789131106.662831:0:17750:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7f200/0xf3fe2838e1fc33ed lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131106.662840:0:17750:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7f200/0xf3fe2838e1fc33ed lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131106.662850:0:17750:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7f200/0xf3fe2838e1fc33ed lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131106.662867:0:17750:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd286de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:17750:1876039508875136:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789131106.662909:0:17750:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131106.662942:0:17766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508875136 00000100:00100000:1.0:1789131106.662947:0:17766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508875136 00000100:00100000:1.0:1789131106.662990:0:17766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789131106.662997:0:17766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddfbfe3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+10:17750:x1876039508875136:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789131106.663008:0:17766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789131106.663022:0:17766:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91dcc85caa00/0xf3fe2838e1fc33f4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3fe2838e1fc33ed expref: -99 pid: 17766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131106.663042:0:17766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91dcc85caa00/0xf3fe2838e1fc33f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3fe2838e1fc33ed expref: 11 pid: 17766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131106.663052:0:17766:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91dcc85caa00/0xf3fe2838e1fc33f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc33ed expref: 11 pid: 17766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131106.663059:0:17766:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dcc85caa00, rc 0) 00000100:00100000:1.0:1789131106.663088:0:17766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddfbfe3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+11:17750:x1876039508875136:12345-0@lo:101:mount.lustre.0 Request processed in 92us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131106.663095:0:17766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789131106.663120:0:17750:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddd12036c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789131106.663136:0:17750:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd286de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:17750:1876039508875136:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789131106.663148:0:17750:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7f200/0xf3fe2838e1fc33ed lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc33f4 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131106.663158:0:17750:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7f200/0xf3fe2838e1fc33ed lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3fe2838e1fc33f4 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131106.663276:0:17750:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd286de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:17750:1876039508875264:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789131106.663302:0:17750:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131106.663324:0:17750:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddd12036c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789131106.663338:0:17764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508875264 00000100:00100000:1.0:1789131106.663342:0:17764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508875264 00000100:00100000:0.0:1789131106.663623:0:17766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789131106.663777:0:17766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddfbfe2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+11:17750:x1876039508875264:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789131106.664010:0:17766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddfbfe2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+11:17750:x1876039508875264:12345-0@lo:501:mount.lustre.0 Request processed in 379us (706us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131106.664018:0:17766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789131106.664127:0:17750:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd286de00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:17750:1876039508875264:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789131106.664160:0:17750:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8608000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:17750:1876039508875392:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789131106.664213:0:17750:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131106.664283:0:17750:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddd8364240 going to sleep for 11 seconds 00000100:00100000:3.0:1789131106.664375:0:17765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508875392 00000100:00100000:3.0:1789131106.664380:0:17765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508875392 00000100:00100000:1.0:1789131106.664737:0:17764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789131106.664745:0:17764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddfbfe0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+11:17750:x1876039508875392:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789131106.664958:0:17764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddfbfe0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+11:17750:x1876039508875392:12345-0@lo:503:mount.lustre.0 Request processed in 210us (742us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131106.664966:0:17764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789131106.665080:0:17750:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8608000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:17750:1876039508875392:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789131106.665436:0:17799:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd1dacf00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:17799:1876039508875520:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789131106.665515:0:17799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131106.665602:0:17799:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddc4ca40c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789131106.665955:0:17766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508875520 00000100:00100000:2.0:1789131106.665960:0:17766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508875520 00000100:00100000:2.0:1789131106.666035:0:17766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789131106.666043:0:17766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddfbfe3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+11:17799:x1876039508875520:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789131106.666766:0:17766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddfbfe3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+11:17799:x1876039508875520:12345-0@lo:502:llog_process_th.0 Request processed in 722us (1249us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131106.666776:0:17766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789131106.667065:0:17799:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd1dacf00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:17799:1876039508875520:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789131106.667099:0:17799:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789131106.667109:0:17799:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789131106.667112:0:17799:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789131106.667119:0:17799:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff91dcc78a7000 00000020:00000080:3.0:1789131106.667122:0:17799:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789131106.667129:0:17799:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789131106.667132:0:17799:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789131106.667133:0:17799:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1789131106.667136:0:17799:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789131106.667138:0:17799:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789131106.667140:0:17799:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789131106.667143:0:17799:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff91dcc78a7000 00000020:00000080:3.0:1789131106.667145:0:17799:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789131106.667250:0:17799:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789131106.667255:0:17799:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789131106.667256:0:17799:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1789131106.667268:0:17799:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789131106.667271:0:17799:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789131106.667272:0:17799:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:3.0:1789131106.667276:0:17799:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff91dcc78a7000 00000020:00000080:3.0:1789131106.667278:0:17799:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789131106.669481:0:17799:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789131106.669495:0:17799:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789131106.669498:0:17799:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:3.0:1789131106.669502:0:17799:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789131106.669507:0:17799:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789131106.669508:0:17799:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre lod.lustre-MDT0001-mdtlov.enable_compr_rotational 00000020:01000000:3.0:1789131106.669513:0:17799:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff91dcc78a7000 00000020:00000080:3.0:1789131106.669515:0:17799:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789131106.669562:0:17799:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789131106.669565:0:17799:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789131106.669567:0:17799:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre lod.lustre-MDT0001-mdtlov.enable_compr_rotational 00000020:01000000:3.0:1789131106.669570:0:17799:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789131106.669572:0:17799:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789131106.669574:0:17799:0:(obd_config.c:1563:class_process_config()) marker 6 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789131106.669577:0:17799:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff91dcc78a7000 00000020:00000080:3.0:1789131106.669580:0:17799:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789131106.669596:0:17799:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789131106.669599:0:17799:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789131106.669601:0:17799:0:(obd_config.c:1563:class_process_config()) marker 6 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789131106.669603:0:17799:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789131106.669606:0:17799:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789131106.669607:0:17799:0:(obd_config.c:1563:class_process_config()) marker 7 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1789131106.669610:0:17799:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff91dcc78a7000 00000020:00000080:3.0:1789131106.669612:0:17799:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789131106.670167:0:17799:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd1dacf00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:17799:1876039508875648:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789131106.670271:0:17799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131106.670319:0:17799:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddc4ca40c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789131106.671389:0:17764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508875648 00000100:00100000:1.0:1789131106.671400:0:17764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508875648 00000100:00100000:1.0:1789131106.671451:0:17764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789131106.671502:0:17764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddfbfe3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+11:17799:x1876039508875648:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789131106.671728:0:17764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddfbfe3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+11:17799:x1876039508875648:12345-0@lo:502:llog_process_th.0 Request processed in 267us (1467us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131106.671736:0:17764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789131106.671874:0:17799:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd1dacf00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:17799:1876039508875648:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789131106.671905:0:17799:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789131106.671913:0:17799:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789131106.671915:0:17799:0:(obd_config.c:1563:class_process_config()) marker 7 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1789131106.671919:0:17799:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 19 count 19 00000020:01000000:1.0:1789131106.676531:0:17750:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-18 (rc=0) 10000000:01000000:1.0:1789131106.676578:0:17750:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789131106.676599:0:17750:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7f200/0xf3fe2838e1fc33ed lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc33f4 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131106.676613:0:17750:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7f200/0xf3fe2838e1fc33ed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc33f4 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789131106.676854:0:17750:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789131106.676857:0:17750:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff91dcc78a7000 10000000:01000000:1.0:1789131106.676860:0:17750:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff91dcc78a7000 10000000:01000000:1.0:1789131106.676870:0:17750:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789131106.676876:0:17750:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff91dcc78a7000 from 1 10000000:01000000:1.0:1789131106.676879:0:17750:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789131106.676913:0:17750:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff91dcc85ca000/0xf3fe2838e1fc33fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131106.676921:0:17750:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff91dcc85ca000/0xf3fe2838e1fc33fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131106.676932:0:17750:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff91dcc85ca000/0xf3fe2838e1fc33fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131106.676956:0:17750:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8496580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:17750:1876039508875776:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789131106.677022:0:17750:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131106.677057:0:17750:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddcf7a5240 going to sleep for 11 seconds 00000100:00100000:2.0:1789131106.677149:0:17766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508875776 00000100:00100000:2.0:1789131106.677156:0:17766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508875776 00000100:00100000:2.0:1789131106.677193:0:17766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789131106.677213:0:17766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddfbfe1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+11:17750:x1876039508875776:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789131106.677226:0:17766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789131106.677246:0:17766:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91dcc7f7fa00/0xf3fe2838e1fc3402 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3fe2838e1fc33fb expref: -99 pid: 17766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131106.677342:0:17766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91dcc7f7fa00/0xf3fe2838e1fc3402 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3fe2838e1fc33fb expref: 12 pid: 17766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131106.677354:0:17766:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91dcc7f7fa00/0xf3fe2838e1fc3402 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc33fb expref: 12 pid: 17766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131106.677364:0:17766:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dcc7f7fa00, rc 0) 00000100:00100000:2.0:1789131106.677402:0:17766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddfbfe1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+12:17750:x1876039508875776:12345-0@lo:101:mount.lustre.0 Request processed in 191us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131106.677409:0:17766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789131106.677740:0:17750:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8496580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:17750:1876039508875776:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789131106.677823:0:17750:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff91dcc85ca000/0xf3fe2838e1fc33fb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc3402 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131106.677834:0:17750:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff91dcc85ca000/0xf3fe2838e1fc33fb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3fe2838e1fc3402 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131106.677890:0:17750:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8496580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:17750:1876039508875904:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789131106.677916:0:17750:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131106.677946:0:17750:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddcf7a5240 going to sleep for 11 seconds 00000100:00100000:1.0:1789131106.677972:0:17764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508875904 00000100:00100000:1.0:1789131106.677976:0:17764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508875904 00000100:00100000:1.0:1789131106.678001:0:17764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789131106.678008:0:17764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddfbfe2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+12:17750:x1876039508875904:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789131106.678121:0:17764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddfbfe2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+12:17750:x1876039508875904:12345-0@lo:501:mount.lustre.0 Request processed in 112us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131106.678128:0:17764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789131106.678157:0:17750:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8496580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:17750:1876039508875904:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789131106.678183:0:17750:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8496580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:17750:1876039508876032:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789131106.678749:0:17750:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131106.679166:0:17750:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddcf7a5240 going to sleep for 11 seconds 00000100:00100000:0.0:1789131106.679282:0:17764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508876032 00000100:00100000:0.0:1789131106.679287:0:17764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508876032 00000100:00100000:0.0:1789131106.679327:0:17764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789131106.679334:0:17764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddfbfe1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+12:17750:x1876039508876032:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789131106.679421:0:17764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddfbfe1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+12:17750:x1876039508876032:12345-0@lo:503:mount.lustre.0 Request processed in 86us (672us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131106.679428:0:17764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789131106.680388:0:17750:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8496580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:17750:1876039508876032:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789131106.686575:0:17802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8496580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:17802:1876039508876160:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789131106.686659:0:17802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131106.686748:0:17802:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddcf7a5240 going to sleep for 11 seconds 00000100:00100000:0.0:1789131106.689347:0:17764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508876160 00000100:00100000:0.0:1789131106.689361:0:17764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508876160 00000100:00100000:0.0:1789131106.689453:0:17764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789131106.689480:0:17764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddfbfe0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+12:17802:x1876039508876160:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789131106.689635:0:17764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddfbfe0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+12:17802:x1876039508876160:12345-0@lo:502:llog_process_th.0 Request processed in 157us (2977us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131106.689643:0:17764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789131106.691385:0:17802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8496580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:17802:1876039508876160:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1789131106.691454:0:17802:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1789131106.691494:0:17802:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff91ddcf69ced8) 00000020:00000080:1.0:1789131106.691515:0:17802:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:1.0:1789131106.691621:0:17802:0:(tgt_mount.c:153:server_get_mount()) get mount ffff91dcc78a7000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1789131106.691625:0:17802:0:(tgt_mount.c:187:server_put_mount()) put mount ffff91dcc78a7000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1789131106.691628:0:17802:0:(obd_mount.c:710:lustre_put_lsi()) put ffff91dcc78a7000 4 00010000:00080000:1.0:1789131106.691660:0:17802:0:(ldlm_lib.c:102:import_set_conn()) imp ffff91dded00f800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.111@tcp at head 00010000:00010000:1.0:1789131106.697284:0:17802:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:2.0:1789131106.698722:0:17802:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1789131106.698956:0:17802:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789131106.698969:0:17802:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xf3fe2838e1fc3410 00000100:00080000:2.0:1789131106.698980:0:17802:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789131106.698985:0:17802:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff91dded00f800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:2.0:1789131106.699020:0:17802:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91ddd286e940 x1876039508876288/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789131106.699051:0:17802:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1789131106.699830:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd286e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3624:1876039508876288:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789131106.699899:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131106.700916:0:17771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508876288 00000100:00100000:1.0:1789131106.700928:0:17771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508876288 00000100:00100000:1.0:1789131106.701105:0:17771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789131106.701113:0:17771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8608000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3624:x1876039508876288:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789131106.701190:0:17771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8608000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3624:x1876039508876288:12345-0@lo:38:llog_process_th.0 Request processed in 76us (1290us total) trans 0 rc -11/-11 00000100:00100000:1.0:1789131106.701216:0:17771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789131106.701261:0:3624:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789131106.701269:0:3624:0:(import.c:65:import_set_state_nolock()) ffff91dded00f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789131106.701273:0:3624:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1789131106.701276:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd286e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3624:1876039508876288:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789131106.707008:0:17802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8496580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:17802:1876039508876416:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789131106.707219:0:17802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131106.707258:0:17766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508876416 00000100:00100000:1.0:1789131106.707265:0:17766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508876416 00000100:00100000:1.0:1789131106.707307:0:17766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789131106.707316:0:17766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddfbfe2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+12:17802:x1876039508876416:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789131106.707427:0:17766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddfbfe2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+12:17802:x1876039508876416:12345-0@lo:502:llog_process_th.0 Request processed in 111us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131106.707435:0:17766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789131106.707506:0:17802:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddcf7a5900 going to sleep for 11 seconds 00000100:00100000:1.0:1789131106.707526:0:17802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8496580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:17802:1876039508876416:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789131106.707567:0:17802:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8496580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:17802:1876039508876544:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789131106.707599:0:17802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131106.707622:0:17802:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddcf7a5900 going to sleep for 11 seconds 00000100:00100000:0.0:1789131106.707829:0:17764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508876544 00000100:00100000:0.0:1789131106.707834:0:17764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508876544 00000100:00100000:0.0:1789131106.707867:0:17764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789131106.707873:0:17764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddfbfe0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+12:17802:x1876039508876544:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789131106.708195:0:17764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddfbfe0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+12:17802:x1876039508876544:12345-0@lo:502:llog_process_th.0 Request processed in 321us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131106.708211:0:17764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789131106.708264:0:17802:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8496580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:17802:1876039508876544:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1789131106.708376:0:17802:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1789131106.708435:0:17750:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1789131106.708480:0:17750:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789131106.708496:0:17750:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff91dcc85ca000/0xf3fe2838e1fc33fb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc3402 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131106.708512:0:17750:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff91dcc85ca000/0xf3fe2838e1fc33fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc3402 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789131106.708560:0:17750:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789131106.708562:0:17750:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789131106.708563:0:17750:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789131106.708565:0:17750:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789131106.708566:0:17750:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789131106.708567:0:17750:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789131106.708569:0:17750:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789131106.708570:0:17750:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789131106.708572:0:17750:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789131106.708573:0:17750:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789131106.708577:0:17750:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:1.0:1789131106.708580:0:17750:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789131106.708581:0:17750:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789131106.708582:0:17750:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789131106.708583:0:17750:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789131106.708584:0:17750:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789131106.708585:0:17750:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789131106.708586:0:17750:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789131106.708587:0:17750:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789131106.708588:0:17750:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789131106.708589:0:17750:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789131106.708604:0:17750:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1789131106.708614:0:17750:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8496580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:17750:1876039508876672:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789131106.708648:0:17750:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131106.708669:0:17750:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddcf7a5cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789131106.708689:0:17765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508876672 00000100:00100000:1.0:1789131106.708693:0:17765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508876672 00000100:00100000:1.0:1789131106.708717:0:17765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789131106.708723:0:17765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddfbfe3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+12:17750:x1876039508876672:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789131106.708744:0:17765:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1789131106.708761:0:17765:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1789131106.711717:0:17765:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789131106.711769:0:17765:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1789131106.712063:0:17765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddfbfe3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+12:17750:x1876039508876672:12345-0@lo:253:mount.lustre.0 Request processed in 3335us (3410us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131106.712073:0:17765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789131106.712133:0:17750:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8496580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:17750:1876039508876672:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789131106.712146:0:17750:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1789131106.712149:0:17750:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789131106.712151:0:17750:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789131106.712152:0:17750:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789131106.712153:0:17750:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789131106.712154:0:17750:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789131106.712155:0:17750:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789131106.712157:0:17750:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789131106.712158:0:17750:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789131106.712160:0:17750:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789131106.712161:0:17750:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1789131106.712188:0:17750:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:3.0:1789131106.715602:0:17787:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789131106.715612:0:17787:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789131106.715635:0:17787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91ddfd0b4c00/0xf3fe2838e1fc3417 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131106.715665:0:17787:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91dcc85ca200/0xf3fe2838e1fc33e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc33df expref: 11 pid: 17766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131106.715673:0:17787:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91ddfd0b4c00/0xf3fe2838e1fc3417 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131106.715714:0:17787:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91dcc85ca200/0xf3fe2838e1fc33e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf3fe2838e1fc33df expref: 11 pid: 17766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131106.715729:0:17787:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91dcc85ca200/0xf3fe2838e1fc33e6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf3fe2838e1fc33df expref: 11 pid: 17766 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131106.715744:0:17787:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd1dacb40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17787:1876039508876800:0@lo:104: 00000100:00100000:3.0:1789131106.715801:0:17787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131106.715847:0:17787:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddc4ca49c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789131106.717169:0:17754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508876800 00000100:00100000:1.0:1789131106.721154:0:17754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508876800 00000100:00100000:1.0:1789131106.721247:0:17754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789131106.721257:0:17754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd1dada40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+3:17787:x1876039508876800:12345-0@lo:104: 00010000:00010000:1.0:1789131106.721275:0:17754:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff91dcc85cac00/0xf3fe2838e1fc33df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3fe2838e1fc33e6 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131106.721372:0:17754:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789131106.721378:0:17754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd1dada40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+3:17787:x1876039508876800:12345-0@lo:104: Request processed in 124us (5577us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131106.721386:0:17754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789131106.721563:0:17787:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd1dacb40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17787:1876039508876800:0@lo:104: 00010000:00010000:1.0:1789131106.721596:0:17787:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91ddfd0b4c00/0xf3fe2838e1fc3417 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131106.722051:0:17760:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789131106.722058:0:17760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff91dcc85cac00/0xf3fe2838e1fc33df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3fe2838e1fc33e6 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131106.722066:0:17760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc85cac00 already unused, calling callback (ffffffffc124bc20) 10000000:00010000:0.0:1789131106.722071:0:17760:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff91dcc85cac00/0xf3fe2838e1fc33df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf3fe2838e1fc33e6 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131106.722079:0:17760:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff91dcc85cac00/0xf3fe2838e1fc33df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf3fe2838e1fc33e6 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789131106.722086:0:17760:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff91dcc85cac00/0xf3fe2838e1fc33df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf3fe2838e1fc33e6 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789131106.722092:0:17760:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789131106.722143:0:17760:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff91dcc85cac00/0xf3fe2838e1fc33df lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc33e6 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131106.722151:0:17760:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789131106.722170:0:17760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff91dcc85cac00/0xf3fe2838e1fc33df lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc33e6 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131106.722185:0:17760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff91dcc85cac00/0xf3fe2838e1fc33df lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc33e6 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131106.722216:0:17760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789131106.722218:0:17760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789131106.722220:0:17760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789131106.723341:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc860ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:3626:1876039508876928:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789131106.723400:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131106.723538:0:17756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508876928 00000100:00100000:1.0:1789131106.723545:0:17756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508876928 00010000:00010000:1.0:1789131106.723572:0:17756:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91dcc85ca200/0xf3fe2838e1fc33e6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3fe2838e1fc33df expref: 12 pid: 17766 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131106.723600:0:17756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789131106.723608:0:17756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc860bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+12:3626:x1876039508876928:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789131106.723620:0:17756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789131106.723626:0:17756:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91dcc85ca200/0xf3fe2838e1fc33e6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3fe2838e1fc33df expref: 12 pid: 17766 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131106.723638:0:17756:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91dcc85ca200/0xf3fe2838e1fc33e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf3fe2838e1fc33df expref: 12 pid: 17766 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131106.723653:0:17756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91dcc85ca200/0xf3fe2838e1fc33e6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf3fe2838e1fc33df expref: 12 pid: 17766 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131106.723667:0:17756:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91ddfd0b4c00/0xf3fe2838e1fc3417 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131106.723676:0:17756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91ddfd0b4c00/0xf3fe2838e1fc3417 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789131106.723690:0:17756:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.008079136s 00010000:00010000:1.0:1789131106.723696:0:17756:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91ddfd0b4c00/0xf3fe2838e1fc3417 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131106.723702:0:17756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91ddfd0b4c00/0xf3fe2838e1fc3417 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131106.723718:0:17756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91ddfd0b4c00/0xf3fe2838e1fc3417 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131106.723725:0:17756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91ddfd0b4c00/0xf3fe2838e1fc3417 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131106.723731:0:17756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddfd0b4c00 already unused, calling callback (ffffffffc0c4e550) 00010000:00010000:1.0:1789131106.723735:0:17756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91ddfd0b4c00/0xf3fe2838e1fc3417 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131106.723743:0:17756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91ddfd0b4c00/0xf3fe2838e1fc3417 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131106.723755:0:17756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91ddfd0b4c00/0xf3fe2838e1fc3417 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131106.723766:0:17756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789131106.723803:0:17756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc860bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+11:3626:x1876039508876928:12345-0@lo:103:ldlm_bl.0 Request processed in 195us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131106.723810:0:17756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789131106.723846:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc860ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:3626:1876039508876928:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789131106.723865:0:17787:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91ddfd0b4c00/0xf3fe2838e1fc3417 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131106.723872:0:17787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91ddfd0b4c00/0xf3fe2838e1fc3417 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131106.723878:0:17787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91ddfd0b4c00/0xf3fe2838e1fc3417 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1789131106.737667:0:17750:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:3.0:1789131106.740446:0:17750:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1789131106.740509:0:17813:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:2.0:1789131106.740518:0:17813:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:3.0:1789131106.741358:0:17814:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1789131106.741397:0:17750:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:3.0:1789131106.742032:0:17814:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00080000:0.0:1789131106.743219:0:17815:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff91dcc860b480 x1876039508877056/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789131106.743234:0:17815:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddd8364f00 going to sleep for 0 seconds 00000040:01000000:2.0:1789131106.743660:0:17750:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1789131106.743702:0:17750:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1789131106.745498:0:17750:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1789131106.745512:0:17750:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1789131106.745577:0:17750:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789131106.747627:0:17814:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1789131106.747752:0:17814:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:00080000:0.0:1789131106.758375:0:17750:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1789131106.758990:0:17750:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1789131106.759057:0:17750:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:0.0:1789131106.760700:0:17750:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x35:0x0] (8/32) registered 00000001:00000004:0.0:1789131106.765838:0:17750:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:0.0:1789131106.769180:0:17750:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1789131106.769229:0:17750:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb3f441c63988 00100000:10000000:0.0:1789131106.769236:0:17750:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1789131106.771187:0:17750:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789131106.771214:0:17750:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.111@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789131106.771242:0:17750:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=45 00000080:00000004:3.0:1789131106.771264:0:17750:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:3.0:1789131106.772229:0:17750:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789131106.772441:0:17750:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789131107.349825:0:17759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789131107.537805:0:17768:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789131107.537813:0:17768:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff91dcc78a7000 from 7 10000000:01000000:1.0:1789131107.537818:0:17768:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789131107.537859:0:17768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff91dcc85cb200/0xf3fe2838e1fc341e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131107.537872:0:17768:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff91dcc85cb200/0xf3fe2838e1fc341e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131107.537884:0:17768:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff91dcc85cb200/0xf3fe2838e1fc341e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131107.537907:0:17768:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc84961c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:17768:1876039508877184:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789131107.537972:0:17768:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131107.538024:0:17768:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddc8681a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789131107.538282:0:17764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508877184 00000100:00100000:0.0:1789131107.538289:0:17764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508877184 00000100:00100000:0.0:1789131107.538334:0:17764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789131107.538343:0:17764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddfbfe1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+11:17768:x1876039508877184:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789131107.538355:0:17764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789131107.538366:0:17764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91de01ad7a00/0xf3fe2838e1fc3425 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3fe2838e1fc341e expref: -99 pid: 17764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131107.538401:0:17764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91de01ad7a00/0xf3fe2838e1fc3425 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3fe2838e1fc341e expref: 12 pid: 17764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131107.538421:0:17764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91de01ad7a00/0xf3fe2838e1fc3425 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc341e expref: 12 pid: 17764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131107.538430:0:17764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91de01ad7a00, rc 0) 00000100:00100000:0.0:1789131107.538644:0:17764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddfbfe1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+12:17768:x1876039508877184:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 301us (670us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131107.538651:0:17764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789131107.538956:0:17768:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc84961c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:17768:1876039508877184:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789131107.539206:0:17768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff91dcc85cb200/0xf3fe2838e1fc341e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc3425 expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131107.539215:0:17768:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff91dcc85cb200/0xf3fe2838e1fc341e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3fe2838e1fc3425 expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131107.539267:0:17768:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd286fc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:17768:1876039508877312:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1789131107.539301:0:17768:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131107.539363:0:17768:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddcf5c4cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789131107.539402:0:17765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508877312 00000100:00100000:1.0:1789131107.539406:0:17765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508877312 00000100:00100000:1.0:1789131107.539638:0:17765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789131107.539647:0:17765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddfbfe2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+12:17768:x1876039508877312:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1789131107.539663:0:17765:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789131107.539678:0:17765:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789131107.539740:0:17765:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:1.0:1789131107.539828:0:17765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddfbfe2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+12:17768:x1876039508877312:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 183us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131107.539836:0:17765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789131107.539909:0:17768:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd286fc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:17768:1876039508877312:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1789131107.539947:0:17768:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789131107.539955:0:17768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff91dcc85cb200/0xf3fe2838e1fc341e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc3425 expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131107.539963:0:17768:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff91dcc85cb200/0xf3fe2838e1fc341e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc3425 expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789131107.732517:0:17805:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789131107.798622:0:17815:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddd8364f00 going to sleep for 0 seconds 00010000:00010000:0.0:1789131108.370365:0:17760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789131108.755032:0:17805:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789131108.817629:0:17815:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddd8364f00 going to sleep for 0 seconds 00010000:00010000:2.0:1789131109.399436:0:17759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789131109.844856:0:17815:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddd8364f00 going to sleep for 0 seconds 00010000:00010000:0.0:1789131110.417572:0:17760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789131110.868316:0:17815:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddd8364f00 going to sleep for 0 seconds 00000001:02000400:2.0:1789131110.968011:0:18057:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg311-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1789131111.448753:0:17759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789131111.889801:0:17815:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddd8364f00 going to sleep for 0 seconds 00000020:00000004:2.0:1789131111.893932:0:18109:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789131111.894106:0:18109:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00080000:1.0:1789131112.017658:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1789131112.017665:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1789131112.017676:0:36:0:(import.c:65:import_set_state_nolock()) ffff91ddcf4da000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789131112.017684:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 462 00000100:00080000:1.0:1789131112.017688:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1789131112.017694:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff91ddcf4da000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:1.0:1789131112.017719:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91dcc8497c00 x1876039508877568/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789131112.017738:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789131112.017741:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789131112.017744:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789131112.017747:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789131112.017750:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1789131112.017753:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1789131112.017754:0:36:0:(import.c:65:import_set_state_nolock()) ffff91dded00f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789131112.017759:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff91dded00f800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:1.0:1789131112.017771:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91dcc8494f00 x1876039508877696/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789131112.017807:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8497c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3624:1876039508877568:0@lo:38:kworker.0 00000100:00100000:1.0:1789131112.017914:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131112.017961:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8494f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3624:1876039508877696:0@lo:38:kworker.0 00000100:00100000:1.0:1789131112.018015:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131112.018082:0:17777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508877568 00000100:00100000:1.0:1789131112.018089:0:17777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508877568 00000100:00100000:1.0:1789131112.018121:0:17777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789131112.018129:0:17777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc84970c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3624:x1876039508877568:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1789131112.018172:0:17777:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1789131112.019121:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8496580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:3627:1876039508877440:0@lo:400:kworker.0 00000100:00100000:2.0:1789131112.019188:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131112.019235:0:17764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508877440 00000100:00100000:2.0:1789131112.019241:0:17764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508877440 00000100:00100000:2.0:1789131112.019276:0:17764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789131112.019284:0:17764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddfbfe1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+12:3627:x1876039508877440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131112.019329:0:17764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddfbfe1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+12:3627:x1876039508877440:12345-0@lo:400:kworker.0 Request processed in 45us (140us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131112.019336:0:17764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789131112.020152:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8496580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:3627:1876039508877440:0@lo:400:kworker.0 00000100:00100000:3.0:1789131112.020725:0:17773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508877696 00000100:00100000:3.0:1789131112.020732:0:17773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508877696 00000100:00100000:3.0:1789131112.020759:0:17773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789131112.020774:0:17773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc84943c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3624:x1876039508877696:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1789131112.020797:0:17773:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 467 last 0 00000020:00000080:3.0:1789131112.020837:0:17773:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xf3fe2838e1fc342c 00000004:00100000:3.0:1789131112.020852:0:17773:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789131112.020972:0:17773:0:(import.c:65:import_set_state_nolock()) ffff91dcc7ee4000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789131112.021209:0:17773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc84943c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1876039508877696:12345-0@lo:38:kworker.0 Request processed in 433us (3192us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131112.021217:0:17773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789131112.021261:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff91dcc8494f00 x1876039508877696/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789131122 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789131112.021275:0:3624:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1789131112.021283:0:3624:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1789131112.021287:0:3624:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789131112.021290:0:3624:0:(import.c:65:import_set_state_nolock()) ffff91dded00f800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789131112.021295:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8494f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3624:1876039508877696:0@lo:38:kworker.0 00000100:00100000:1.0:1789131112.036594:0:17777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc84970c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3624:x1876039508877568:12345-0@lo:38:kworker.0 Request processed in 18457us (18673us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789131112.036608:0:17777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1789131112.037944:0:3624:0:(import.c:65:import_set_state_nolock()) ffff91ddcf4da000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789131112.037954:0:3624:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789131112.037958:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8497c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3624:1876039508877568:0@lo:38:kworker.0 00010000:00010000:1.0:1789131112.469170:0:17760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789131112.833051:0:18159:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789131112.833433:0:18159:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1789131112.925056:0:17815:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddd8364f00 going to sleep for 0 seconds 00010000:00010000:2.0:1789131113.490031:0:17759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789131113.938135:0:17815:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddd8364f00 going to sleep for 0 seconds 00010000:00010000:1.0:1789131114.514079:0:17760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789131114.961589:0:17815:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddd8364f00 going to sleep for 0 seconds 00010000:00010000:2.0:1789131115.537703:0:17759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789131115.986592:0:17815:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddd8364f00 going to sleep for 0 seconds 00000100:00100000:1.0:1789131116.115361:0:3624:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789131106/real 1789131106] req@ffff91dcc8497480 x1876039508874624/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789131116 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789131116.115404:0:3624:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff91dcc8497480 x1876039508874624/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789131116 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789131116.115414:0:3624:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789131106/real 1789131106] req@ffff91ddd286ed00 x1876039508874496/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789131116 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789131116.115427:0:3624:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff91ddd286ed00 x1876039508874496/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789131116 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789131116.115449:0:3624:0:(import.c:65:import_set_state_nolock()) ffff91dcc85e2000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789131116.115514:0:3624:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789131116.115519:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3624:1876039508874624:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1789131116.115526:0:3624:0:(import.c:65:import_set_state_nolock()) ffff91dcc85e4800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789131116.115531:0:3624:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789131116.115534:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd286ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3624:1876039508874496:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1789131116.115630:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1789131116.115635:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1789131116.115638:0:36:0:(import.c:65:import_set_state_nolock()) ffff91ddcf4da000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789131116.115653:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 467 00000100:00080000:1.0:1789131116.115661:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1789131116.115668:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff91ddcf4da000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:1.0:1789131116.115694:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91dcc84952c0 x1876039508877952/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789131116.115709:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789131116.115712:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1789131116.115714:0:36:0:(import.c:65:import_set_state_nolock()) ffff91dcc85e4800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789131116.115718:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 462 00000100:00080000:1.0:1789131116.115721:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1789131116.115724:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff91dcc85e4800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:1.0:1789131116.115736:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91dcc8497c00 x1876039508878080/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789131116.115744:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789131116.115746:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789131116.115748:0:36:0:(import.c:65:import_set_state_nolock()) ffff91dcc85e2000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789131116.115751:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 462 00000100:00080000:1.0:1789131116.115754:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1789131116.115757:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff91dcc85e2000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:1.0:1789131116.115766:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91dcc8494f00 x1876039508878208/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789131116.117217:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8496580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3625:1876039508878336:0@lo:400:kworker.0 00000100:00100000:1.0:1789131116.117324:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:3628:1876039508877824:0@lo:400:kworker.0 00000100:00100000:1.0:1789131116.117395:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131116.117395:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131116.117513:0:17772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508878336 00000100:00100000:2.0:1789131116.117523:0:17772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508878336 00000100:00100000:1.0:1789131116.117542:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc84952c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3624:1876039508877952:0@lo:38:kworker.0 00000100:00100000:1.0:1789131116.117582:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131116.117585:0:17772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789131116.118330:0:17772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8608780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1876039508878336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789131116.121559:0:17765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508877824 00000100:00100000:3.0:1789131116.121577:0:17765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508877824 00000100:00100000:3.0:1789131116.121722:0:17765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789131116.121735:0:17765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddfbfe0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+12:3628:x1876039508877824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131116.123699:0:17772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8608780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1876039508878336:12345-0@lo:400:kworker.0 Request processed in 6091us (6289us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131116.123717:0:17772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789131116.124948:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8497c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3624:1876039508878080:0@lo:8:kworker.0 00000400:00000100:1.0:1789131116.125006:0:3624:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876039508878080 offset 0 length 520: 4 00000100:00100000:1.0:1789131116.125041:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8494f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3624:1876039508878208:0@lo:8:kworker.0 00000400:00000100:1.0:1789131116.125067:0:3624:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876039508878208 offset 0 length 520: 4 00000100:00100000:1.0:1789131116.125113:0:17776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508877952 00000100:00100000:1.0:1789131116.125122:0:17776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508877952 00000100:00100000:1.0:1789131116.125182:0:17776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789131116.125190:0:17776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc84961c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3624:x1876039508877952:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1789131116.125225:0:17776:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:0.0:1789131116.125750:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff91dcc8496580 x1876039508878336/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789131132 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789131116.125769:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8496580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3625:1876039508878336:0@lo:400:kworker.0 00000100:00100000:3.0:1789131116.128486:0:17765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddfbfe0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+12:3628:x1876039508877824:12345-0@lo:400:kworker.0 Request processed in 6723us (11061us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131116.128527:0:17765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789131116.129746:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:3628:1876039508877824:0@lo:400:kworker.0 00000100:00100000:1.0:1789131116.151039:0:17776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc84961c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3624:x1876039508877952:12345-0@lo:38:kworker.0 Request processed in 25836us (33443us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789131116.151056:0:17776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1789131116.151063:0:3624:0:(import.c:65:import_set_state_nolock()) ffff91ddcf4da000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789131116.151069:0:3624:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789131116.151074:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc84952c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3624:1876039508877952:0@lo:38:kworker.0 00010000:00010000:3.0:1789131116.562753:0:17760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789131117.009563:0:17815:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddd8364f00 going to sleep for 0 seconds 00010000:00010000:2.0:1789131117.587819:0:17759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789131118.034736:0:17815:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddd8364f00 going to sleep for 0 seconds 00010000:00010000:3.0:1789131118.610655:0:17760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789131118.995297:0:17805:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789131119.057656:0:17815:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddd8364f00 going to sleep for 0 seconds 00000020:01000004:0.0:1789131119.243674:0:18505:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1789131119.243679:0:18505:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:0.0:1789131119.243681:0:18505:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1789131119.243820:0:18505:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff91ddf34a7800 00000020:01000004:0.0:1789131119.243839:0:18505:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:0.0:1789131119.243853:0:18505:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1789131119.243869:0:18505:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff91de01a03490) 00000020:00000080:0.0:1789131119.243886:0:18505:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1789131119.304788:0:18505:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1789131119.306710:0:18505:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:0.0:1789131119.312195:0:18505:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:0.0:1789131119.312776:0:18505:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:0.0:1789131119.312984:0:18505:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:0.0:1789131119.313237:0:18505:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1789131119.314236:0:18505:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:0.0:1789131119.314797:0:18505:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:0.0:1789131119.315352:0:18505:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:0.0:1789131119.316169:0:18505:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:0.0:1789131119.317448:0:18505:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1789131119.318394:0:18505:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:0.0:1789131119.319375:0:18505:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1789131119.319861:0:18505:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:0.0:1789131119.321101:0:18505:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:0.0:1789131119.321685:0:18505:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:0.0:1789131119.321876:0:18505:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:0.0:1789131119.322778:0:18505:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:0.0:1789131119.322980:0:18505:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:0.0:1789131119.325590:0:18505:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:0.0:1789131119.326070:0:18505:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:0.0:1789131119.326272:0:18505:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:2.0:1789131119.326744:0:18505:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:2.0:1789131119.329556:0:18505:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1789131119.329990:0:18505:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1789131119.330403:0:18505:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1789131119.330869:0:18505:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1789131119.331121:0:18505:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:2.0:1789131119.331305:0:18505:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:2.0:1789131119.331736:0:18505:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1789131119.331930:0:18505:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1789131119.333682:0:18505:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1789131119.334844:0:18505:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1789131119.335162:0:18505:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1789131119.335364:0:18505:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1789131119.335662:0:18505:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1789131119.335911:0:18505:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:2.0:1789131119.336179:0:18505:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1789131119.336539:0:18505:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1789131119.336775:0:18505:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:2.0:1789131119.336951:0:18505:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:2.0:1789131119.337220:0:18505:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1789131119.337438:0:18505:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1789131119.337733:0:18505:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1789131119.337949:0:18505:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1789131119.338225:0:18505:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00080000:01000000:2.0:1789131119.339104:0:18505:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1789131119.339441:0:18505:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:2.0:1789131119.339638:0:18505:0:(osd_handler.c:8895:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789131119.339656:0:18505:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xf3fe2838e1fc343a 00000020:01000004:2.0:1789131119.339666:0:18505:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:2.0:1789131119.339695:0:18505:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.111@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789131119.339699:0:18505:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.111@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789131119.339707:0:18505:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:2.0:1789131119.339744:0:18505:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:2.0:1789131119.339749:0:18505:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.111@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:2.0:1789131119.346972:0:18505:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.111@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789131119.347141:0:18505:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.111@tcp, index=0001, flags=0x20001 00000020:01000004:2.0:1789131119.347146:0:18505:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789131119.347148:0:18505:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789131119.347150:0:18505:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789131119.347151:0:18505:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789131119.347160:0:18505:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789131119.347161:0:18505:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789131119.347163:0:18505:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789131119.347165:0:18505:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789131119.347166:0:18505:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789131119.347170:0:18505:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:2.0:1789131119.347173:0:18505:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789131119.347174:0:18505:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789131119.347175:0:18505:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789131119.347175:0:18505:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789131119.347176:0:18505:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789131119.347177:0:18505:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789131119.347178:0:18505:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789131119.347179:0:18505:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789131119.347180:0:18505:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789131119.347214:0:18505:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1789131119.347241:0:18505:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd286da40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:18505:1876039508878464:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789131119.347448:0:18505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131119.347696:0:17766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508878464 00000100:00100000:0.0:1789131119.347705:0:17766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508878464 00000100:00100000:2.0:1789131119.347721:0:18505:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddc4cfb300 going to sleep for 11 seconds 00000100:00100000:0.0:1789131119.347778:0:17766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789131119.347790:0:17766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddfff14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+12:18505:x1876039508878464:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789131119.347842:0:17766:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1789131119.347845:0:17766:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:0.0:1789131119.347853:0:17766:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:0.0:1789131119.348238:0:17766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddfff14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+12:18505:x1876039508878464:12345-0@lo:253:mount.lustre.0 Request processed in 449us (789us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131119.348247:0:17766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789131119.348547:0:18505:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd286da40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:18505:1876039508878464:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789131119.348561:0:18505:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1789131119.348565:0:18505:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789131119.348566:0:18505:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789131119.348567:0:18505:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789131119.348568:0:18505:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789131119.348569:0:18505:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789131119.348570:0:18505:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789131119.348571:0:18505:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789131119.348573:0:18505:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789131119.348574:0:18505:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789131119.348599:0:18505:0:(tgt_mount.c:101:server_register_mount()) register mount ffff91ddf34a7800 from lustre-MDT0001 10000000:01000000:2.0:1789131119.348636:0:18505:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:2.0:1789131119.348639:0:18505:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1789131119.348647:0:18505:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff91ddff71ced8 local copy 00010000:00010000:2.0:1789131119.348659:0:18505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff91dcc85cb600/0xf3fe2838e1fc3330 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc3337 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131119.348780:0:18505:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd286da40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:18505:1876039508878592:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789131119.348823:0:18505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131119.348859:0:18505:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddc4cfbcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789131119.348917:0:17764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508878592 00000100:00100000:3.0:1789131119.348923:0:17764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508878592 00000100:00100000:3.0:1789131119.349013:0:17764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789131119.349023:0:17764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddfff17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+12:18505:x1876039508878592:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789131119.349103:0:17764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddfff17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+12:18505:x1876039508878592:12345-0@lo:501:mount.lustre.0 Request processed in 82us (279us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789131119.349119:0:17764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789131119.349177:0:18505:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd286da40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:18505:1876039508878592:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1789131119.349190:0:18505:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.111@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1789131119.349207:0:18505:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.111@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1789131119.349214:0:18505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff91dcc85cb600/0xf3fe2838e1fc3330 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc3337 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131119.349223:0:18505:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff91dcc85cb600/0xf3fe2838e1fc3330 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc3337 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789131119.349249:0:18505:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff91ddf34a7800 10000000:01000000:2.0:1789131119.349254:0:18505:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789131119.349260:0:18505:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff91ddff71ced8 10000000:01000000:2.0:1789131119.349262:0:18505:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1789131119.349266:0:18505:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff91ddff71ced8 from 1 10000000:01000000:2.0:1789131119.349269:0:18505:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789131119.349295:0:18505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7e400/0xf3fe2838e1fc3441 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131119.349303:0:18505:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7e400/0xf3fe2838e1fc3441 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131119.349312:0:18505:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7e400/0xf3fe2838e1fc3441 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131119.349336:0:18505:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd286da40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:18505:1876039508878720:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789131119.349363:0:18505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131119.349802:0:18505:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddc4cfbcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789131119.350187:0:17765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508878720 00000100:00100000:1.0:1789131119.350194:0:17765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508878720 00000100:00100000:1.0:1789131119.350235:0:17765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789131119.350244:0:17765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddfff15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+12:18505:x1876039508878720:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789131119.350257:0:17765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789131119.350276:0:17765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91dcc85cb000/0xf3fe2838e1fc3448 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3fe2838e1fc3441 expref: -99 pid: 17765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131119.350304:0:17765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91dcc85cb000/0xf3fe2838e1fc3448 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3fe2838e1fc3441 expref: 13 pid: 17765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131119.350316:0:17765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91dcc85cb000/0xf3fe2838e1fc3448 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc3441 expref: 13 pid: 17765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131119.350342:0:17765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dcc85cb000, rc 0) 00000100:00100000:1.0:1789131119.350401:0:17765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddfff15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+13:18505:x1876039508878720:12345-0@lo:101:mount.lustre.0 Request processed in 158us (1036us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131119.350409:0:17765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789131119.350717:0:18505:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd286da40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:18505:1876039508878720:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789131119.350732:0:18505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7e400/0xf3fe2838e1fc3441 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc3448 expref: -99 pid: 18505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131119.350741:0:18505:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7e400/0xf3fe2838e1fc3441 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3fe2838e1fc3448 expref: -99 pid: 18505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789131119.350763:0:18505:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1789131119.350787:0:18505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7e400/0xf3fe2838e1fc3441 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc3448 expref: -99 pid: 18505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131119.350795:0:18505:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7e400/0xf3fe2838e1fc3441 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc3448 expref: -99 pid: 18505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789131119.350806:0:18505:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff91ddf34a7800 10000000:01000000:2.0:1789131119.350811:0:18505:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1789131119.350816:0:18505:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff91ddf34a7800 from 1 10000000:01000000:2.0:1789131119.350818:0:18505:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1789131119.350840:0:18505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7e800/0xf3fe2838e1fc344f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131119.350852:0:18505:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7e800/0xf3fe2838e1fc344f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131119.350860:0:18505:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7e800/0xf3fe2838e1fc344f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131119.350884:0:18505:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd286da40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:18505:1876039508878848:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789131119.350923:0:18505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131119.350984:0:17766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508878848 00000100:00100000:1.0:1789131119.350989:0:17766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508878848 00000100:00100000:2.0:1789131119.351075:0:18505:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddc4cfbcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789131119.351138:0:17764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789131119.351149:0:17764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddfff14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+13:18505:x1876039508878848:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789131119.351158:0:17764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789131119.351169:0:17764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91ddfd0b4c00/0xf3fe2838e1fc3456 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3fe2838e1fc344f expref: -99 pid: 17764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131119.351186:0:17764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91ddfd0b4c00/0xf3fe2838e1fc3456 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3fe2838e1fc344f expref: 14 pid: 17764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131119.351196:0:17764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91ddfd0b4c00/0xf3fe2838e1fc3456 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc344f expref: 14 pid: 17764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131119.351202:0:17764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ddfd0b4c00, rc 0) 00000100:00100000:3.0:1789131119.351313:0:17764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddfff14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+14:18505:x1876039508878848:12345-0@lo:101:mount.lustre.0 Request processed in 167us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131119.351394:0:17764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789131119.354504:0:18505:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd286da40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:18505:1876039508878848:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789131119.354543:0:18505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7e800/0xf3fe2838e1fc344f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc3456 expref: -99 pid: 18505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131119.354557:0:18505:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7e800/0xf3fe2838e1fc344f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3fe2838e1fc3456 expref: -99 pid: 18505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789131119.354582:0:18505:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1789131119.354602:0:18505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7e800/0xf3fe2838e1fc344f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc3456 expref: -99 pid: 18505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131119.354610:0:18505:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7e800/0xf3fe2838e1fc344f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc3456 expref: -99 pid: 18505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789131119.354620:0:18505:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1789131119.354629:0:18505:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789131119.354637:0:18505:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff91ddf34a7800 10000000:01000000:2.0:1789131119.354639:0:18505:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1789131119.354644:0:18505:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:2.0:1789131119.354647:0:18505:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1789131119.354685:0:18505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7e600/0xf3fe2838e1fc345d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131119.354693:0:18505:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7e600/0xf3fe2838e1fc345d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131119.354719:0:18505:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7e600/0xf3fe2838e1fc345d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131119.354741:0:18505:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd286da40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:18505:1876039508878976:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789131119.354824:0:18505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131119.354877:0:18505:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddc4cfbcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789131119.357080:0:17765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508878976 00000100:00100000:1.0:1789131119.357097:0:17765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508878976 00000100:00100000:1.0:1789131119.357188:0:17765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789131119.357198:0:17765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddfff14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+14:18505:x1876039508878976:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789131119.357217:0:17765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789131119.357239:0:17765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91dcc85cae00/0xf3fe2838e1fc3464 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3fe2838e1fc345d expref: -99 pid: 17765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131119.357273:0:17765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91dcc85cae00/0xf3fe2838e1fc3464 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3fe2838e1fc345d expref: 15 pid: 17765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131119.357286:0:17765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91dcc85cae00/0xf3fe2838e1fc3464 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc345d expref: 15 pid: 17765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131119.357296:0:17765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dcc85cae00, rc 0) 00000100:00100000:1.0:1789131119.357393:0:17765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddfff14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+15:18505:x1876039508878976:12345-0@lo:101:mount.lustre.0 Request processed in 195us (2569us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131119.357401:0:17765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789131119.357574:0:18505:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd286da40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:18505:1876039508878976:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789131119.357597:0:18505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7e600/0xf3fe2838e1fc345d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc3464 expref: -99 pid: 18505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131119.357607:0:18505:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7e600/0xf3fe2838e1fc345d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3fe2838e1fc3464 expref: -99 pid: 18505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789131119.359258:0:18505:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000040:00080000:0.0:1789131119.360159:0:18505:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789131119.373155:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1789131119.373232:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:0.0:1789131119.373252:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:0.0:1789131119.373268:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:0.0:1789131119.373283:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 00000040:00080000:0.0:1789131119.373299:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 00000040:00080000:0.0:1789131119.373312:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 00000040:00080000:0.0:1789131119.373340:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:0.0:1789131119.373356:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:0.0:1789131119.373370:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 00000040:00080000:0.0:1789131119.373384:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 00000040:00080000:0.0:1789131119.373399:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 00000040:00080000:0.0:1789131119.373414:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 00000040:00080000:0.0:1789131119.373429:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:0.0:1789131119.373445:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:1.0:1789131119.377018:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 00000040:00080000:1.0:1789131119.377096:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:1.0:1789131119.377122:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:1.0:1789131119.377159:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 00000040:00080000:1.0:1789131119.377172:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:1.0:1789131119.377183:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:1.0:1789131119.377195:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:1.0:1789131119.377207:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:1.0:1789131119.377238:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 00000040:00080000:1.0:1789131119.377242:0:18505:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 24 count 25 00000100:00100000:1.0:1789131119.377422:0:18505:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8495680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:18505:1876039508879104:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789131119.377544:0:18505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131119.377605:0:18505:0:(client.c:2715:ptlrpc_set_wait()) set ffff91dcc6ea0c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789131119.377776:0:17764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508879104 00000100:00100000:3.0:1789131119.377785:0:17764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508879104 00000100:00100000:3.0:1789131119.377851:0:17764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789131119.377863:0:17764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddfff16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+15:18505:x1876039508879104:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789131119.378062:0:17764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddfff16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+15:18505:x1876039508879104:12345-0@lo:501:mount.lustre.0 Request processed in 200us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131119.378072:0:17764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789131119.378186:0:18505:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8495680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:18505:1876039508879104:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789131119.378234:0:18505:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd286c3c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:18505:1876039508879232:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789131119.378290:0:18505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131119.378317:0:18505:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddc4cfb840 going to sleep for 11 seconds 00000100:00100000:3.0:1789131119.378428:0:17766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508879232 00000100:00100000:3.0:1789131119.378433:0:17766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508879232 00000100:00100000:3.0:1789131119.378492:0:17766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789131119.378500:0:17766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddfff16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+15:18505:x1876039508879232:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789131119.379592:0:17766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddfff16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+15:18505:x1876039508879232:12345-0@lo:503:mount.lustre.0 Request processed in 1086us (1295us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131119.379605:0:17766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789131119.379726:0:18505:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd286c3c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:18505:1876039508879232:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789131119.380306:0:18505:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789131119.380561:0:18505:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd286c3c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:18505:1876039508879360:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789131119.380631:0:18505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131119.380680:0:18505:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddc4cfb840 going to sleep for 11 seconds 00000100:00100000:0.0:1789131119.380799:0:17764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508879360 00000100:00100000:0.0:1789131119.380806:0:17764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508879360 00000100:00100000:0.0:1789131119.380866:0:17764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789131119.380877:0:17764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddfff17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+15:18505:x1876039508879360:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789131119.382573:0:17764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddfff17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+15:18505:x1876039508879360:12345-0@lo:502:mount.lustre.0 Request processed in 1684us (1928us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131119.382587:0:17764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789131119.383164:0:18505:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd286c3c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:18505:1876039508879360:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789131119.383612:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1789131119.383650:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 136 off8552 00000040:00080000:2.0:1789131119.383665:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 176 off8728 00000040:00080000:2.0:1789131119.383678:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8952 00000040:00080000:2.0:1789131119.383695:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9176 00000040:00080000:2.0:1789131119.383709:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9296 00000040:00080000:2.0:1789131119.383720:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 112 off9408 00000040:00080000:2.0:1789131119.383732:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 160 off9568 00000040:00080000:2.0:1789131119.383745:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9792 00000040:00080000:2.0:1789131119.383772:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off10016 00000040:00080000:2.0:1789131119.383787:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 88 off10104 00000040:00080000:2.0:1789131119.383801:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 144 off10248 00000040:00080000:2.0:1789131119.383813:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 152 off10400 00000040:00080000:2.0:1789131119.383825:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 168 off10568 00000040:00080000:2.0:1789131119.383838:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 224 off10792 00000040:00080000:2.0:1789131119.383851:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 224 off11016 00000040:00080000:2.0:1789131119.383864:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 80 off11096 00000040:00080000:2.0:1789131119.383879:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11320 00000040:00080000:2.0:1789131119.383892:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 224 off11544 00000040:00080000:2.0:1789131119.383905:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 160 off11704 00000040:00080000:2.0:1789131119.383920:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11928 00000040:00080000:2.0:1789131119.383935:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 224 off12152 00000040:00080000:2.0:1789131119.383950:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 80 off12232 00000040:00080000:2.0:1789131119.383965:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 224 off12456 00000040:00080000:2.0:1789131119.383979:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 224 off12680 00000040:00080000:2.0:1789131119.383992:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 88 off12768 00000040:00080000:2.0:1789131119.384005:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 144 off12912 00000040:00080000:2.0:1789131119.384017:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 152 off13064 00000040:00080000:2.0:1789131119.384029:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 136 off13200 00000040:00080000:2.0:1789131119.384040:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13424 00000040:00080000:2.0:1789131119.384052:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 224 off13648 00000040:00080000:2.0:1789131119.384065:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 80 off13728 00000040:00080000:2.0:1789131119.384077:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 224 off13952 00000040:00080000:2.0:1789131119.384090:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 224 off14176 00000040:00080000:2.0:1789131119.384102:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 88 off14264 00000040:00080000:2.0:1789131119.384129:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 144 off14408 00000040:00080000:2.0:1789131119.384145:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 152 off14560 00000040:00080000:2.0:1789131119.384160:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 136 off14696 00000040:00080000:2.0:1789131119.384177:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14920 00000040:00080000:2.0:1789131119.384191:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 224 off15144 00000040:00080000:2.0:1789131119.384204:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 80 off15224 00000040:00080000:2.0:1789131119.384218:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 224 off15448 00000040:00080000:2.0:1789131119.384245:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 224 off15672 00000040:00080000:2.0:1789131119.384258:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 120 off15792 00000100:00100000:2.0:1789131119.384309:0:18505:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd286c3c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:18505:1876039508879488:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789131119.384407:0:18505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131119.384500:0:18505:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddc4cfb840 going to sleep for 11 seconds 00000100:00100000:3.0:1789131119.384870:0:17766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508879488 00000100:00100000:3.0:1789131119.384881:0:17766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508879488 00000100:00100000:3.0:1789131119.384950:0:17766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789131119.384962:0:17766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddfff15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+15:18505:x1876039508879488:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789131119.385143:0:17766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddfff15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+15:18505:x1876039508879488:12345-0@lo:502:mount.lustre.0 Request processed in 183us (736us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131119.385152:0:17766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789131119.385772:0:18505:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd286c3c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:18505:1876039508879488:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789131119.385864:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off16016 00000040:00080000:2.0:1789131119.385880:0:18505:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:1.0:1789131119.387267:0:18509:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789131119.387284:0:18509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789131119.387287:0:18509:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1789131119.387293:0:18509:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:1.0:1789131119.387296:0:18509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789131119.387317:0:18509:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff91ddcf699a48) 00000020:00000080:1.0:1789131119.387416:0:18509:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:1.0:1789131119.387424:0:18509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1789131119.387667:0:18509:0:(osd_handler.c:8895:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789131119.387677:0:18509:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xf3fe2838e1fc3472 00000020:00000080:1.0:1789131119.387951:0:18509:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1789131119.387956:0:18509:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789131119.387961:0:18509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789131119.387963:0:18509:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1789131119.387966:0:18509:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789131119.387970:0:18509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789131119.387972:0:18509:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:1.0:1789131119.387976:0:18509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789131119.387985:0:18509:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff91ddcf698000) 00000020:00000080:1.0:1789131119.388105:0:18509:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:1.0:1789131119.388123:0:18509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1789131119.388126:0:18509:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:1.0:1789131119.388142:0:18509:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:1.0:1789131119.388149:0:18509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789131119.388221:0:18509:0:(tgt_mount.c:153:server_get_mount()) get mount ffff91ddf34a7800 from lustre-MDT0001, refs=2 00000020:00000080:1.0:1789131119.388238:0:18509:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff91ddc5723490) 00000020:00000080:1.0:1789131119.388248:0:18509:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:1.0:1789131119.388318:0:18509:0:(lod_dev.c:2292:lod_obd_connect()) connect #0 00000020:00000080:1.0:1789131119.388339:0:18509:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf3fe2838e1fc3487 00000020:00000080:1.0:1789131119.388452:0:18509:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:1.0:1789131119.388918:0:18509:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1789131119.388927:0:18509:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xf3fe2838e1fc348e 00080000:01000000:1.0:1789131119.388936:0:18509:0:(osd_handler.c:8895:osd_obd_connect()) connect #2 00000020:00000080:1.0:1789131119.388941:0:18509:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xf3fe2838e1fc3495 00010000:00010000:2.0:1789131119.506158:0:18509:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:2.0:1789131119.508435:0:18509:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 4294967301 00000001:00080000:2.0:1789131119.512808:0:18509:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1789131119.517099:0:18509:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:1.0:1789131119.517138:0:18509:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789131119.517147:0:18509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789131119.517149:0:18509:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:1.0:1789131119.517154:0:18509:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789131119.517162:0:18509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789131119.517165:0:18509:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:1.0:1789131119.517169:0:18509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789131119.517176:0:18509:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.111@tcp to nid 0x20000c0a8cb6f (192.168.203.111@tcp) 00000020:00000080:1.0:1789131119.517219:0:18509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789131119.517240:0:18509:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff91ddc5724ed8) 00000020:00000080:1.0:1789131119.517270:0:18509:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:1.0:1789131119.517278:0:18509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789131119.517437:0:18509:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:1.0:1789131119.517446:0:18509:0:(osd_handler.c:8895:osd_obd_connect()) connect #3 00000020:00000080:1.0:1789131119.517496:0:18509:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xf3fe2838e1fc34a3 00010000:00080000:1.0:1789131119.517540:0:18509:0:(ldlm_lib.c:102:import_set_conn()) imp ffff91de01a7f800@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.111@tcp at head 00010000:00010000:1.0:1789131119.523073:0:18509:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:1.0:1789131119.529440:0:18509:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789131119.529522:0:18509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1789131119.529606:0:18509:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:1.0:1789131119.529636:0:18509:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf3fe2838e1fc34aa 00000100:00080000:1.0:1789131119.529651:0:18509:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789131119.529660:0:18509:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff91de01a7f800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:1.0:1789131119.529711:0:18509:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91dcc8497840 x1876039508879616/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789131119.529741:0:18509:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:1.0:1789131119.530863:0:18509:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789131119.530871:0:18509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789131119.530874:0:18509:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:1.0:1789131119.530878:0:18509:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789131119.530881:0:18509:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1789131119.530883:0:18509:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789131119.530885:0:18509:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789131119.530886:0:18509:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789131119.530889:0:18509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789131119.530891:0:18509:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789131119.530894:0:18509:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789131119.530900:0:18509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789131119.530901:0:18509:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:1.0:1789131119.530904:0:18509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1789131119.530959:0:18509:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1789131119.530976:0:18509:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789131119.530980:0:18509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789131119.530982:0:18509:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:1.0:1789131119.530985:0:18509:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789131119.530987:0:18509:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #18 00000020:01000000:1.0:1789131119.530988:0:18509:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789131119.530990:0:18509:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789131119.530992:0:18509:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789131119.530994:0:18509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789131119.530996:0:18509:0:(obd_config.c:1563:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789131119.530999:0:18509:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789131119.531014:0:18509:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1789131119.531018:0:18509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789131119.531019:0:18509:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1789131119.531023:0:18509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789131119.531028:0:18509:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.111@tcp to nid 0x20000c0a8cb6f (192.168.203.111@tcp) 00000020:01000000:1.0:1789131119.531060:0:18509:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1789131119.531063:0:18509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789131119.531082:0:18509:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff91ddc5721a48) 00000020:00000080:1.0:1789131119.531101:0:18509:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:1.0:1789131119.531117:0:18509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789131119.531191:0:18509:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:1.0:1789131119.531201:0:18509:0:(osd_handler.c:8895:osd_obd_connect()) connect #4 00000020:00000080:1.0:1789131119.531209:0:18509:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xf3fe2838e1fc34b8 00010000:00080000:1.0:1789131119.531251:0:18509:0:(ldlm_lib.c:102:import_set_conn()) imp ffff91ddc5749800@lustre-OST0000-osc-MDT0001: add connection 192.168.203.111@tcp at head 00010000:00010000:1.0:1789131119.532695:0:18509:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00100000:2.0:1789131119.533318:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8497840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3624:1876039508879616:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789131119.533420:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:01000000:1.0:1789131119.534691:0:18509:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1789131119.534798:0:17777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508879616 00000100:00100000:2.0:1789131119.534811:0:17777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508879616 00000040:01000000:1.0:1789131119.534940:0:18509:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000100:00100000:0.0:1789131119.535515:0:17777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789131119.535527:0:17777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd286c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3624:x1876039508879616:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1789131119.535565:0:17777:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 475 last 0 00000020:00000080:0.0:1789131119.535606:0:17777:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf3fe2838e1fc34bf 00000004:00100000:0.0:1789131119.535628:0:17777:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1789131119.535635:0:17777:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:0.0:1789131119.536969:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1789131119.536979:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1789131119.536984:0:8:0:(import.c:65:import_set_state_nolock()) ffff91ddcf4da000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789131119.537003:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 472 00000100:00080000:0.0:1789131119.537010:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1789131119.537018:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff91ddcf4da000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:0.0:1789131119.537062:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91dcc860ad00 x1876039508879744/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789131119.537087:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789131119.537091:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789131119.537093:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789131119.537097:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789131119.537148:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789131119.537167:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8609a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3625:1876039508879872:0@lo:400:kworker.0 00000100:00100000:0.0:1789131119.537255:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131119.537368:0:17771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508879872 00000100:00100000:2.0:1789131119.537379:0:17771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508879872 00000100:00100000:2.0:1789131119.537436:0:17771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789131119.537445:0:17771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc860a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1876039508879872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131119.537533:0:17771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc860a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1876039508879872:12345-0@lo:400:kworker.0 Request processed in 88us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131119.537541:0:17771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789131119.537590:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff91dcc8609a40 x1876039508879872/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789131135 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789131119.537606:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8609a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3625:1876039508879872:0@lo:400:kworker.0 00000100:00100000:2.0:1789131119.537634:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc860ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3624:1876039508879744:0@lo:38:kworker.0 00000100:00100000:2.0:1789131119.537682:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131119.537711:0:17776:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:2.0:1789131119.537720:0:17776:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:2.0:1789131119.537852:0:17776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508879744 00000100:00100000:2.0:1789131119.537856:0:17776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508879744 00000100:00100000:2.0:1789131119.537966:0:18514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789131119.537971:0:18514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd286f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3624:x1876039508879744:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1789131119.538023:0:18514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd286f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3624:x1876039508879744:12345-0@lo:38:kworker.0 Request processed in 50us (339us total) trans 0 rc -11/-11 00000100:00100000:2.0:1789131119.538029:0:18514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789131119.538049:0:3624:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789131119.538056:0:3624:0:(import.c:65:import_set_state_nolock()) ffff91ddcf4da000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789131119.538060:0:3624:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1789131119.538064:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc860ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3624:1876039508879744:0@lo:38:kworker.0 00000040:00080000:2.0:1789131119.542088:0:18509:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789131119.542611:0:18509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:2.0:1789131119.542795:0:18509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 64 off8256 00000040:00080000:2.0:1789131119.543170:0:18515:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789131119.543175:0:18515:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1789131119.543869:0:18509:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1789131119.543885:0:18509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1789131119.543935:0:18509:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1789131119.543966:0:18509:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf3fe2838e1fc34c6 00000100:00080000:2.0:1789131119.543980:0:18509:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789131119.543988:0:18509:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff91ddc5749800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:2.0:1789131119.544037:0:18509:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91ddd286da40 x1876039508880000/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789131119.544104:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd286da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3624:1876039508880000:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1789131119.544187:0:3624:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876039508880000 offset 0 length 520: 4 00000100:00080000:2.0:1789131119.544308:0:18509:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1789131119.544389:0:18509:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789131119.544394:0:18509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789131119.544396:0:18509:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1789131119.544399:0:18509:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1789131119.544403:0:18509:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:2.0:1789131119.544404:0:18509:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789131119.544406:0:18509:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789131119.544408:0:18509:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1789131119.544410:0:18509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789131119.544412:0:18509:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:2.0:1789131119.544415:0:18509:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789131119.544419:0:18509:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1789131119.544422:0:18509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789131119.544424:0:18509:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1789131119.544426:0:18509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789131119.544430:0:18509:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.111@tcp to nid 0x20000c0a8cb6f (192.168.203.111@tcp) 00000020:01000000:2.0:1789131119.544473:0:18509:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1789131119.544477:0:18509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789131119.544492:0:18509:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff91ddd10eb490) 00000020:00000080:2.0:1789131119.544506:0:18509:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:2.0:1789131119.544512:0:18509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789131119.544597:0:18509:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:2.0:1789131119.544605:0:18509:0:(osd_handler.c:8895:osd_obd_connect()) connect #5 00000020:00000080:2.0:1789131119.544612:0:18509:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xf3fe2838e1fc34d4 00010000:00080000:2.0:1789131119.544649:0:18509:0:(ldlm_lib.c:102:import_set_conn()) imp ffff91ddff618800@lustre-OST0001-osc-MDT0001: add connection 192.168.203.111@tcp at head 00010000:00010000:2.0:1789131119.544889:0:18509:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:2.0:1789131119.544971:0:18509:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1789131119.544990:0:18509:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:2.0:1789131119.546707:0:18509:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789131119.546901:0:18509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:2.0:1789131119.547039:0:18509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000100:00080000:0.0:1789131119.547498:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789131119.547505:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789131119.547508:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789131119.547511:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789131119.548653:0:17777:0:(import.c:65:import_set_state_nolock()) ffff91ddc574e800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789131119.548784:0:17777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd286c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3624:x1876039508879616:12345-0@lo:38:llog_process_th.0 Request processed in 13254us (15360us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131119.548799:0:17777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789131119.549014:0:3624:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789131119.549029:0:3624:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 2 00000100:00080000:0.0:1789131119.549047:0:3624:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1789131119.549054:0:3624:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789131119.549057:0:3624:0:(import.c:65:import_set_state_nolock()) ffff91de01a7f800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789131119.549073:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8497840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3624:1876039508879616:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789131119.549408:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc86083c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508880128:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789131119.549501:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131119.549644:0:17776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508880128 00000100:00100000:2.0:1789131119.549660:0:17776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508880128 00000100:00100000:2.0:1789131119.549718:0:17776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789131119.549729:0:17776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8495e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3627:x1876039508880128:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789131119.549765:0:17776:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1789131119.549884:0:17776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8495e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3627:x1876039508880128:12345-0@lo:41:osp-pre-0-1.0 Request processed in 158us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131119.549892:0:17776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000040:00080000:2.0:1789131119.550098:0:18517:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789131119.550104:0:18517:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1789131119.551050:0:18509:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1789131119.551066:0:18509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1789131119.551131:0:18509:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1789131119.551159:0:18509:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf3fe2838e1fc34db 00000100:00080000:2.0:1789131119.551170:0:18509:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789131119.551177:0:18509:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff91ddff618800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:2.0:1789131119.551215:0:18509:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91ddd286e1c0 x1876039508880256/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789131119.551283:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd286e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3624:1876039508880256:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1789131119.551355:0:3624:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876039508880256 offset 0 length 520: 4 00000100:00080000:2.0:1789131119.551420:0:18509:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1789131119.551516:0:18509:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789131119.551521:0:18509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789131119.551524:0:18509:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1789131119.551527:0:18509:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789131119.551532:0:18509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789131119.551534:0:18509:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789131119.551537:0:18509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789131119.551540:0:18509:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789131119.551542:0:18509:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789131119.551545:0:18509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789131119.551546:0:18509:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:2.0:1789131119.551549:0:18509:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789131119.551559:0:18509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789131119.551561:0:18509:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789131119.551565:0:18509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1789131119.551598:0:18509:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789131119.551601:0:18509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789131119.551602:0:18509:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789131119.551606:0:18509:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000020:01000000:2.0:1789131119.551691:0:18505:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:2.0:1789131119.551730:0:18505:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1789131119.551748:0:18505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7e600/0xf3fe2838e1fc345d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc3464 expref: -99 pid: 18505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131119.551761:0:18505:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7e600/0xf3fe2838e1fc345d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc3464 expref: -99 pid: 18505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789131119.551771:0:18505:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff91ddf34a7800 from 1 10000000:01000000:2.0:1789131119.551774:0:18505:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789131119.551805:0:18505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7fe00/0xf3fe2838e1fc34e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131119.551813:0:18505:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7fe00/0xf3fe2838e1fc34e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131119.551825:0:18505:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7fe00/0xf3fe2838e1fc34e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131119.551842:0:18505:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd286cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:18505:1876039508880384:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789131119.551885:0:18505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131119.551907:0:18505:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddc5d1f900 going to sleep for 11 seconds 00000100:00100000:1.0:1789131119.552290:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc86083c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508880128:0@lo:41:osp-pre-0-1.0 00000100:00080000:0.0:1789131119.552422:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789131119.552428:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789131119.552431:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789131119.552434:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789131119.552455:0:17764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508880384 00000100:00100000:0.0:1789131119.557649:0:17764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508880384 00000100:00100000:0.0:1789131119.557755:0:17764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789131119.557767:0:17764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddfff16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+15:18505:x1876039508880384:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789131119.557790:0:17764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789131119.557818:0:17764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91de01ad6e00/0xf3fe2838e1fc34e9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3fe2838e1fc34e2 expref: -99 pid: 17764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131119.557887:0:17764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91de01ad6e00/0xf3fe2838e1fc34e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3fe2838e1fc34e2 expref: 16 pid: 17764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131119.557902:0:17764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91de01ad6e00/0xf3fe2838e1fc34e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc34e2 expref: 16 pid: 17764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131119.557913:0:17764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91de01ad6e00, rc 0) 00000100:00100000:0.0:1789131119.558023:0:17764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddfff16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+16:18505:x1876039508880384:12345-0@lo:101:mount.lustre.0 Request processed in 257us (6137us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131119.558038:0:17764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789131119.558254:0:18505:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd286cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:18505:1876039508880384:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789131119.558278:0:18505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7fe00/0xf3fe2838e1fc34e2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc34e9 expref: -99 pid: 18505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131119.558296:0:18505:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7fe00/0xf3fe2838e1fc34e2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3fe2838e1fc34e9 expref: -99 pid: 18505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131119.558992:0:18505:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd286cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:18505:1876039508880512:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1789131119.559053:0:18505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131119.559169:0:18505:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddc5d1f900 going to sleep for 11 seconds 00000100:00100000:1.0:1789131119.560055:0:17765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508880512 00000100:00100000:1.0:1789131119.560067:0:17765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508880512 00000100:00100000:1.0:1789131119.560179:0:17765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789131119.560190:0:17765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddfff14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+16:18505:x1876039508880512:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1789131119.560217:0:17765:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1789131119.560248:0:17765:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1789131119.560251:0:17765:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:1.0:1789131119.560486:0:17765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddfff14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+16:18505:x1876039508880512:12345-0@lo:256:mount.lustre.0 Request processed in 293us (1427us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131119.560495:0:17765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789131119.560597:0:18505:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd286cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:18505:1876039508880512:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1789131119.561295:0:18505:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789131119.561396:0:18505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7fe00/0xf3fe2838e1fc34e2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc34e9 expref: -99 pid: 18505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131119.561410:0:18505:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7fe00/0xf3fe2838e1fc34e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc34e9 expref: -99 pid: 18505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789131119.561423:0:18505:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91ddf34a7800 from 1 10000000:01000000:2.0:1789131119.561432:0:18505:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789131119.561504:0:18505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7fc00/0xf3fe2838e1fc34f0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131119.561513:0:18505:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7fc00/0xf3fe2838e1fc34f0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131119.561523:0:18505:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7fc00/0xf3fe2838e1fc34f0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131119.561549:0:18505:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd286cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:18505:1876039508880640:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789131119.561610:0:18505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131119.561881:0:18505:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddc5d1f900 going to sleep for 11 seconds 00000100:00100000:0.0:1789131119.561948:0:17764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508880640 00000100:00100000:0.0:1789131119.561956:0:17764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508880640 00000100:00100000:0.0:1789131119.561999:0:17764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789131119.562009:0:17764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddfff15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+16:18505:x1876039508880640:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789131119.562024:0:17764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789131119.562041:0:17764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91de01ad6000/0xf3fe2838e1fc34f7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3fe2838e1fc34f0 expref: -99 pid: 17764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131119.562069:0:17764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91de01ad6000/0xf3fe2838e1fc34f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3fe2838e1fc34f0 expref: 17 pid: 17764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131119.562081:0:17764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91de01ad6000/0xf3fe2838e1fc34f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc34f0 expref: 17 pid: 17764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131119.562092:0:17764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91de01ad6000, rc 0) 00000100:00100000:0.0:1789131119.562153:0:17764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddfff15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+17:18505:x1876039508880640:12345-0@lo:101:mount.lustre.0 Request processed in 145us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131119.562161:0:17764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789131119.562236:0:18505:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd286cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:18505:1876039508880640:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789131119.562251:0:18505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7fc00/0xf3fe2838e1fc34f0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc34f7 expref: -99 pid: 18505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131119.562261:0:18505:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7fc00/0xf3fe2838e1fc34f0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3fe2838e1fc34f7 expref: -99 pid: 18505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789131119.562442:0:18505:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789131119.562508:0:18505:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd286cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:18505:1876039508880768:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789131119.562537:0:18505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131119.562554:0:18505:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddc5d1f000 going to sleep for 11 seconds 00000100:00100000:0.0:1789131119.562669:0:17764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508880768 00000100:00100000:0.0:1789131119.562674:0:17764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508880768 00000100:00100000:0.0:1789131119.562695:0:17764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789131119.562702:0:17764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddfff17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+17:18505:x1876039508880768:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789131119.562801:0:17764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddfff17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+17:18505:x1876039508880768:12345-0@lo:501:mount.lustre.0 Request processed in 98us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131119.562809:0:17764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789131119.562870:0:18505:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd286cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:18505:1876039508880768:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789131119.562897:0:18505:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd286cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:18505:1876039508880896:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789131119.562948:0:18505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131119.563037:0:18505:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddc5d1f000 going to sleep for 11 seconds 00000100:00100000:1.0:1789131119.563126:0:17765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508880896 00000100:00100000:1.0:1789131119.563130:0:17765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508880896 00000100:00100000:1.0:1789131119.563159:0:17765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789131119.563167:0:17765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddfff17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+17:18505:x1876039508880896:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789131119.563340:0:17765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddfff17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+17:18505:x1876039508880896:12345-0@lo:503:mount.lustre.0 Request processed in 173us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131119.563348:0:17765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789131119.564431:0:18505:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd286cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:18505:1876039508880896:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789131119.564986:0:18505:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789131119.565089:0:18505:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd286cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:18505:1876039508881024:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789131119.565181:0:18505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131119.565290:0:18505:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddc5d1f900 going to sleep for 11 seconds 00000100:00100000:3.0:1789131119.565396:0:17766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508881024 00000100:00100000:3.0:1789131119.565404:0:17766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508881024 00000100:00100000:3.0:1789131119.565536:0:17766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789131119.565547:0:17766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddfff16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+17:18505:x1876039508881024:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789131119.565682:0:17766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddfff16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+17:18505:x1876039508881024:12345-0@lo:502:mount.lustre.0 Request processed in 137us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131119.565691:0:17766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789131119.565787:0:18505:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd286cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:18505:1876039508881024:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789131119.566023:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1789131119.566053:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 112 off8528 00000040:00080000:2.0:1789131119.566069:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 224 off8752 00000040:00080000:2.0:1789131119.566085:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8976 00000040:00080000:2.0:1789131119.566121:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 112 off9088 00000040:00080000:2.0:1789131119.566137:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 224 off9312 00000040:00080000:2.0:1789131119.566149:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9536 00000040:00080000:2.0:1789131119.566163:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 144 off9680 00000040:00080000:2.0:1789131119.566179:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9904 00000040:00080000:2.0:1789131119.566194:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off10128 00000040:00080000:2.0:1789131119.566207:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 144 off10272 00000040:00080000:2.0:1789131119.566219:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10496 00000040:00080000:2.0:1789131119.566231:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 224 off10720 00000040:00080000:2.0:1789131119.566243:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10848 00000040:00080000:2.0:1789131119.566258:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 224 off11072 00000040:00080000:2.0:1789131119.566272:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 224 off11296 00000040:00080000:2.0:1789131119.566285:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 128 off11424 00000100:00100000:2.0:1789131119.566313:0:18505:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd286cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:18505:1876039508881152:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789131119.566370:0:18505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131119.566622:0:18505:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddc5d1f900 going to sleep for 11 seconds 00000100:00100000:1.0:1789131119.566701:0:17765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508881152 00000100:00100000:1.0:1789131119.566709:0:17765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508881152 00000100:00100000:1.0:1789131119.566747:0:17765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789131119.566756:0:17765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddfff15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+17:18505:x1876039508881152:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789131119.566870:0:17765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddfff15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+17:18505:x1876039508881152:12345-0@lo:502:mount.lustre.0 Request processed in 114us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131119.566877:0:17765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789131119.566974:0:18505:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd286cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:18505:1876039508881152:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789131119.567029:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11648 00000040:00080000:2.0:1789131119.567039:0:18505:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 18 count 19 00000020:01000000:1.0:1789131119.567628:0:18519:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789131119.567640:0:18519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789131119.567643:0:18519:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789131119.567654:0:18519:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff91ddf34a7800 00000020:00000080:1.0:1789131119.567657:0:18519:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789131119.567666:0:18519:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789131119.567669:0:18519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789131119.567671:0:18519:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1789131119.567673:0:18519:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789131119.567676:0:18519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789131119.567683:0:18519:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789131119.567688:0:18519:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff91ddf34a7800 00000020:00000080:1.0:1789131119.567692:0:18519:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789131119.567779:0:18519:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789131119.567784:0:18519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789131119.567785:0:18519:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1789131119.567789:0:18519:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789131119.567791:0:18519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789131119.567793:0:18519:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:1.0:1789131119.567797:0:18519:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff91ddf34a7800 00000020:00000080:1.0:1789131119.567800:0:18519:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789131119.567820:0:18519:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789131119.567823:0:18519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789131119.567825:0:18519:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:1.0:1789131119.567828:0:18519:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789131119.567831:0:18519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789131119.567832:0:18519:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre lod.lustre-MDT0001-mdtlov.enable_compr_rotational 00000020:01000000:1.0:1789131119.567836:0:18519:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff91ddf34a7800 00000020:00000080:1.0:1789131119.567838:0:18519:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789131119.567855:0:18519:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789131119.567858:0:18519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789131119.567860:0:18519:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre lod.lustre-MDT0001-mdtlov.enable_compr_rotational 00000020:01000000:1.0:1789131119.567862:0:18519:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789131119.567865:0:18519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789131119.567867:0:18519:0:(obd_config.c:1563:class_process_config()) marker 6 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789131119.567870:0:18519:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff91ddf34a7800 00000020:00000080:1.0:1789131119.567873:0:18519:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789131119.567888:0:18519:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789131119.567890:0:18519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789131119.567892:0:18519:0:(obd_config.c:1563:class_process_config()) marker 6 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789131119.567895:0:18519:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789131119.567897:0:18519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789131119.567898:0:18519:0:(obd_config.c:1563:class_process_config()) marker 7 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1789131119.567909:0:18519:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff91ddf34a7800 00000020:00000080:1.0:1789131119.567911:0:18519:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789131119.567935:0:18519:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789131119.567939:0:18519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789131119.567941:0:18519:0:(obd_config.c:1563:class_process_config()) marker 7 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1789131119.567944:0:18519:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 19 count 19 00000020:01000000:1.0:1789131119.568010:0:18505:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-18 (rc=0) 10000000:01000000:1.0:1789131119.568038:0:18505:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789131119.568059:0:18505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7fc00/0xf3fe2838e1fc34f0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc34f7 expref: -99 pid: 18505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131119.568073:0:18505:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7fc00/0xf3fe2838e1fc34f0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc34f7 expref: -99 pid: 18505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789131119.568136:0:18505:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789131119.568140:0:18505:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff91ddf34a7800 10000000:01000000:1.0:1789131119.568143:0:18505:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff91ddf34a7800 10000000:01000000:1.0:1789131119.568147:0:18505:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789131119.568155:0:18505:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff91ddf34a7800 from 1 10000000:01000000:1.0:1789131119.568158:0:18505:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789131119.568196:0:18505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff91dcc85cba00/0xf3fe2838e1fc34fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131119.568205:0:18505:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff91dcc85cba00/0xf3fe2838e1fc34fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131119.568216:0:18505:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff91dcc85cba00/0xf3fe2838e1fc34fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131119.568239:0:18505:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8496d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:18505:1876039508881280:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789131119.568296:0:18505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131119.568412:0:18505:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddfcfc2780 going to sleep for 11 seconds 00000100:00100000:1.0:1789131119.568435:0:17765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508881280 00000100:00100000:1.0:1789131119.568442:0:17765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508881280 00000100:00100000:1.0:1789131119.568510:0:17765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789131119.568519:0:17765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dde1d3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+17:18505:x1876039508881280:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789131119.568535:0:17765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789131119.568549:0:17765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91dcc85cb800/0xf3fe2838e1fc3505 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3fe2838e1fc34fe expref: -99 pid: 17765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131119.568577:0:17765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91dcc85cb800/0xf3fe2838e1fc3505 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3fe2838e1fc34fe expref: 18 pid: 17765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131119.568588:0:17765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91dcc85cb800/0xf3fe2838e1fc3505 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc34fe expref: 18 pid: 17765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131119.568598:0:17765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dcc85cb800, rc 0) 00000100:00100000:1.0:1789131119.568636:0:17765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dde1d3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+18:18505:x1876039508881280:12345-0@lo:101:mount.lustre.0 Request processed in 118us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131119.568643:0:17765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789131119.568687:0:18505:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8496d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:18505:1876039508881280:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789131119.568702:0:18505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff91dcc85cba00/0xf3fe2838e1fc34fe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc3505 expref: -99 pid: 18505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131119.568713:0:18505:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff91dcc85cba00/0xf3fe2838e1fc34fe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3fe2838e1fc3505 expref: -99 pid: 18505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789131119.571691:0:18505:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:1.0:1789131119.572072:0:18505:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789131119.572312:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:1.0:1789131119.572427:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 120 off8536 00000040:00080000:1.0:1789131119.572443:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 168 off8704 00000040:00080000:1.0:1789131119.572486:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8928 00000040:00080000:1.0:1789131119.572504:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9152 00000040:00080000:1.0:1789131119.572520:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 120 off9272 00000040:00080000:1.0:1789131119.572533:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 168 off9440 00000040:00080000:1.0:1789131119.572547:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9664 00000040:00080000:1.0:1789131119.572560:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 224 off9888 00000040:00080000:1.0:1789131119.572592:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 120 off10008 00000040:00080000:1.0:1789131119.572607:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10232 00000040:00080000:1.0:1789131119.572620:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 224 off10456 00000040:00080000:1.0:1789131119.572634:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 88 off10544 00000040:00080000:1.0:1789131119.572648:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].14, 128 off10672 00000040:00080000:1.0:1789131119.572661:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].15, 144 off10816 00000040:00080000:1.0:1789131119.572675:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].16, 160 off10976 00000040:00080000:1.0:1789131119.572688:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].17, 224 off11200 00000040:00080000:1.0:1789131119.572701:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].18, 224 off11424 00000040:00080000:1.0:1789131119.572714:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].19, 80 off11504 00000040:00080000:1.0:1789131119.572726:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].20, 224 off11728 00000040:00080000:1.0:1789131119.572738:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].21, 224 off11952 00000040:00080000:1.0:1789131119.572749:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].22, 88 off12040 00000040:00080000:1.0:1789131119.572762:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].23, 128 off12168 00000040:00080000:1.0:1789131119.572775:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].24, 144 off12312 00000040:00080000:1.0:1789131119.572786:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].25, 160 off12472 00000040:00080000:1.0:1789131119.572814:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].26, 224 off12696 00000040:00080000:1.0:1789131119.572827:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].27, 224 off12920 00000040:00080000:1.0:1789131119.572839:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].28, 80 off13000 00000040:00080000:1.0:1789131119.572858:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].29, 224 off13224 00000040:00080000:1.0:1789131119.572863:0:18505:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:1.0:1789131119.572972:0:18505:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8496d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:18505:1876039508881408:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789131119.573059:0:18505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131119.573127:0:18505:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddfcfc2900 going to sleep for 11 seconds 00000100:00100000:1.0:1789131119.573168:0:17765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508881408 00000100:00100000:1.0:1789131119.573177:0:17765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508881408 00000100:00100000:1.0:1789131119.573232:0:17765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789131119.573242:0:17765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dde1d3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+18:18505:x1876039508881408:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789131119.573452:0:17765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dde1d3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+18:18505:x1876039508881408:12345-0@lo:501:mount.lustre.0 Request processed in 209us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131119.573475:0:17765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789131119.573535:0:18505:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8496d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:18505:1876039508881408:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789131119.573573:0:18505:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8496d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:18505:1876039508881536:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789131119.573613:0:18505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131119.573634:0:18505:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddfcfc2900 going to sleep for 11 seconds 00000100:00100000:3.0:1789131119.574019:0:17766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508881536 00000100:00100000:3.0:1789131119.574026:0:17766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508881536 00000100:00100000:3.0:1789131119.574065:0:17766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789131119.574074:0:17766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc7057c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+18:18505:x1876039508881536:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789131119.574182:0:17766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc7057c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+18:18505:x1876039508881536:12345-0@lo:503:mount.lustre.0 Request processed in 109us (568us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131119.574190:0:17766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789131119.576154:0:18505:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8496d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:18505:1876039508881536:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789131119.579845:0:18505:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789131119.579974:0:18505:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8496d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:18505:1876039508881664:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789131119.580264:0:18505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131119.580338:0:18505:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddfcfc2780 going to sleep for 11 seconds 00000100:00100000:0.0:1789131119.581653:0:17764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508881664 00000100:00100000:0.0:1789131119.581677:0:17764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508881664 00000100:00100000:3.0:1789131119.581981:0:17766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789131119.581995:0:17766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc7054450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+18:18505:x1876039508881664:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789131119.582204:0:17766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc7054450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+18:18505:x1876039508881664:12345-0@lo:502:mount.lustre.0 Request processed in 212us (1940us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131119.582214:0:17766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789131119.582593:0:18505:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8496d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:18505:1876039508881664:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789131119.583020:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:1.0:1789131119.583058:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 120 off8536 00000040:00080000:1.0:1789131119.583074:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 168 off8704 00000040:00080000:1.0:1789131119.583089:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8928 00000040:00080000:1.0:1789131119.583104:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9152 00000040:00080000:1.0:1789131119.583134:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 120 off9272 00000040:00080000:1.0:1789131119.583148:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 168 off9440 00000040:00080000:1.0:1789131119.583160:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9664 00000040:00080000:1.0:1789131119.583180:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 224 off9888 00000040:00080000:1.0:1789131119.583194:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 120 off10008 00000040:00080000:1.0:1789131119.583233:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10232 00000040:00080000:1.0:1789131119.583247:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 224 off10456 00000040:00080000:1.0:1789131119.583419:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 88 off10544 00000040:00080000:1.0:1789131119.583433:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].14, 128 off10672 00000040:00080000:1.0:1789131119.583446:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].15, 144 off10816 00000040:00080000:1.0:1789131119.583489:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].16, 160 off10976 00000040:00080000:1.0:1789131119.583506:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].17, 224 off11200 00000040:00080000:1.0:1789131119.583520:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].18, 224 off11424 00000040:00080000:1.0:1789131119.583534:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].19, 80 off11504 00000040:00080000:1.0:1789131119.583547:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].20, 224 off11728 00000040:00080000:1.0:1789131119.583560:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].21, 224 off11952 00000040:00080000:1.0:1789131119.583572:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].22, 88 off12040 00000040:00080000:1.0:1789131119.583584:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].23, 128 off12168 00000040:00080000:1.0:1789131119.583596:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].24, 144 off12312 00000040:00080000:1.0:1789131119.583609:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].25, 160 off12472 00000040:00080000:1.0:1789131119.583622:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].26, 224 off12696 00000040:00080000:1.0:1789131119.583648:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].27, 224 off12920 00000040:00080000:1.0:1789131119.583662:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].28, 80 off13000 00000040:00080000:1.0:1789131119.584243:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].29, 224 off13224 00000040:00080000:1.0:1789131119.585488:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].30, 224 off13448 00000040:00080000:1.0:1789131119.585511:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].31, 88 off13536 00000040:00080000:1.0:1789131119.585525:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].32, 128 off13664 00000040:00080000:1.0:1789131119.585537:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].33, 144 off13808 00000040:00080000:1.0:1789131119.585551:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].34, 128 off13936 00000040:00080000:1.0:1789131119.585566:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].35, 224 off14160 00000040:00080000:1.0:1789131119.585580:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].36, 224 off14384 00000040:00080000:1.0:1789131119.585592:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].37, 80 off14464 00000040:00080000:1.0:1789131119.585605:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].38, 224 off14688 00000040:00080000:1.0:1789131119.585621:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].39, 224 off14912 00000040:00080000:1.0:1789131119.585636:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].40, 88 off15000 00000040:00080000:1.0:1789131119.585649:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].41, 128 off15128 00000040:00080000:1.0:1789131119.585662:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].42, 144 off15272 00000040:00080000:1.0:1789131119.585704:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].43, 128 off15400 00000040:00080000:1.0:1789131119.585728:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].44, 224 off15624 00000040:00080000:1.0:1789131119.585745:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].45, 224 off15848 00000040:00080000:1.0:1789131119.585759:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].46, 80 off15928 00000040:00080000:1.0:1789131119.585772:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].47, 224 off16152 00000040:00080000:1.0:1789131119.585784:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].48, 232 off16384 00000100:00100000:1.0:1789131119.585859:0:18505:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8496d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:18505:1876039508881792:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789131119.585959:0:18505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131119.586034:0:18505:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddfcfc2780 going to sleep for 11 seconds 00000100:00100000:0.0:1789131119.587650:0:17765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508881792 00000100:00100000:0.0:1789131119.587667:0:17765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508881792 00000100:00100000:0.0:1789131119.587812:0:17765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789131119.587825:0:17765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd2c8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+18:18505:x1876039508881792:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789131119.588426:0:17765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd2c8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+18:18505:x1876039508881792:12345-0@lo:502:mount.lustre.0 Request processed in 600us (2463us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131119.588437:0:17765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789131119.588541:0:18505:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8496d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:18505:1876039508881792:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789131119.588995:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].49, 224 off16608 00000040:00080000:1.0:1789131119.589032:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].50, 120 off16728 00000100:00100000:1.0:1789131119.589077:0:18505:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8496d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:18505:1876039508881920:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789131119.589155:0:18505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131119.589198:0:17766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508881920 00000100:00100000:3.0:1789131119.589205:0:17766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508881920 00000100:00100000:1.0:1789131119.589207:0:18505:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddfcfc2780 going to sleep for 11 seconds 00000100:00100000:3.0:1789131119.589258:0:17766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789131119.589267:0:17766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd2c8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+18:18505:x1876039508881920:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789131119.589366:0:17766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd2c8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+18:18505:x1876039508881920:12345-0@lo:502:mount.lustre.0 Request processed in 100us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131119.589374:0:17766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789131119.590532:0:18505:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8496d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:18505:1876039508881920:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789131119.590610:0:18505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].51, 224 off16952 00000040:00080000:1.0:1789131119.590625:0:18505:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1789131119.593699:0:18524:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:1.0:1789131119.593720:0:18524:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff91ddc5720000) 00000020:00000080:1.0:1789131119.593753:0:18524:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:1.0:1789131119.593891:0:18524:0:(tgt_mount.c:153:server_get_mount()) get mount ffff91ddf34a7800 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1789131119.593895:0:18524:0:(tgt_mount.c:187:server_put_mount()) put mount ffff91ddf34a7800 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1789131119.593898:0:18524:0:(obd_mount.c:710:lustre_put_lsi()) put ffff91ddf34a7800 3 00010000:00080000:1.0:1789131119.593945:0:18524:0:(ldlm_lib.c:102:import_set_conn()) imp ffff91ddd0290800@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.111@tcp at head 00010000:00010000:0.0:1789131119.604706:0:18524:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:0.0:1789131119.604993:0:18524:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:0.0:1789131119.605057:0:18524:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789131119.605073:0:18524:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xf3fe2838e1fc3513 00000100:00080000:0.0:1789131119.605088:0:18524:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789131119.605095:0:18524:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff91ddd0290800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:0.0:1789131119.606567:0:18524:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91dcc860a580 x1876039508882048/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789131119.606620:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc860a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3624:1876039508882048:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789131119.606728:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789131119.606869:0:18524:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1789131119.606898:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789131119.606903:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789131119.606906:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789131119.606909:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789131119.606955:0:17772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508882048 00000100:00100000:2.0:1789131119.606965:0:17772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508882048 00000100:00100000:2.0:1789131119.607012:0:17772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789131119.607025:0:17772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc860b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3624:x1876039508882048:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1789131119.607057:0:17772:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 475 last 0 00000020:00000080:2.0:1789131119.607097:0:17772:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xf3fe2838e1fc351a 00000004:00100000:2.0:1789131119.607132:0:17772:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789131119.607309:0:17772:0:(import.c:65:import_set_state_nolock()) ffff91ddff61e000 : changing import state from RECOVER to FULL 00010000:00080000:0.0:1789131119.607500:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff91dcc860a580 x1876039508882048/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789131129 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789131119.607527:0:3624:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789131119.607536:0:3624:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 2 00000100:00080000:0.0:1789131119.607547:0:3624:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1789131119.607553:0:3624:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789131119.607556:0:3624:0:(import.c:65:import_set_state_nolock()) ffff91ddd0290800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789131119.607564:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc860a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3624:1876039508882048:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789131119.607706:0:17772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc860b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1876039508882048:12345-0@lo:38:llog_process_th.0 Request processed in 683us (976us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131119.607726:0:17772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000040:00080000:1.0:1789131119.609908:0:18524:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000020:01000000:1.0:1789131119.609992:0:18505:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1789131119.610032:0:18505:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789131119.612203:0:18505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff91dcc85cba00/0xf3fe2838e1fc34fe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc3505 expref: -99 pid: 18505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131119.612233:0:18505:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff91dcc85cba00/0xf3fe2838e1fc34fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc3505 expref: -99 pid: 18505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789131119.612319:0:18505:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789131119.612322:0:18505:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1789131119.612324:0:18505:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789131119.612325:0:18505:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789131119.612327:0:18505:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789131119.612329:0:18505:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789131119.612330:0:18505:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789131119.612333:0:18505:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789131119.612335:0:18505:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789131119.612340:0:18505:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:1.0:1789131119.612343:0:18505:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789131119.612344:0:18505:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1789131119.612346:0:18505:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789131119.612347:0:18505:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789131119.612348:0:18505:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789131119.612350:0:18505:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789131119.612351:0:18505:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789131119.612352:0:18505:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789131119.612353:0:18505:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789131119.612390:0:18505:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1789131119.612417:0:18505:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8496d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:18505:1876039508882176:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789131119.612527:0:18505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131119.612593:0:18505:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddc8681180 going to sleep for 11 seconds 00000100:00100000:1.0:1789131119.614538:0:17765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508882176 00000100:00100000:1.0:1789131119.614554:0:17765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508882176 00000100:00100000:1.0:1789131119.614614:0:17765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789131119.614625:0:17765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd2c88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+18:18505:x1876039508882176:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789131119.614948:0:17765:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1789131119.614966:0:17765:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:0.0:1789131119.617557:0:17751:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:1.0:1789131119.621535:0:17765:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789131119.621555:0:17765:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:1.0:1789131119.621628:0:17787:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1789131119.621634:0:17787:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1789131119.621952:0:17787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91dcc85ca400/0xf3fe2838e1fc3521 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131119.621978:0:17787:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91de01ad7a00/0xf3fe2838e1fc3425 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc341e expref: 18 pid: 17764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131119.621987:0:17787:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91de01ad6e00/0xf3fe2838e1fc34e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc34e2 expref: 18 pid: 17764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131119.621995:0:17787:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91dcc85ca400/0xf3fe2838e1fc3521 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131119.622615:0:17765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd2c88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+18:18505:x1876039508882176:12345-0@lo:253:mount.lustre.0 Request processed in 7987us (10083us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131119.622629:0:17765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00010000:1.0:1789131119.622731:0:17787:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91de01ad6e00/0xf3fe2838e1fc34e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf3fe2838e1fc34e2 expref: 17 pid: 17764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131119.622750:0:17787:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91de01ad6e00/0xf3fe2838e1fc34e9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf3fe2838e1fc34e2 expref: 17 pid: 17764 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131119.622765:0:17787:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8495a40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17787:1876039508882304:0@lo:104: 00000100:00100000:1.0:1789131119.622807:0:17787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789131119.622869:0:17787:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91de01ad7a00/0xf3fe2838e1fc3425 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf3fe2838e1fc341e expref: 17 pid: 17764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131119.622878:0:17787:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91de01ad7a00/0xf3fe2838e1fc3425 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf3fe2838e1fc341e expref: 17 pid: 17764 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131119.622887:0:17787:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8494780 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17787:1876039508882432:0@lo:104: 00000100:00100000:1.0:1789131119.622909:0:17787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131119.622942:0:17787:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddc8681e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789131119.623014:0:17755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508882304 00000100:00100000:2.0:1789131119.623023:0:17755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508882304 00000100:00100000:2.0:1789131119.623057:0:17755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508882432 00000100:00100000:2.0:1789131119.623061:0:17755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508882432 00000100:00100000:2.0:1789131119.623076:0:17755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789131119.623085:0:17755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8494b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+4:17787:x1876039508882304:12345-0@lo:104: 00010000:00010000:2.0:1789131119.623100:0:17755:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7fe00/0xf3fe2838e1fc34e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3fe2838e1fc34e9 expref: -99 pid: 18505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131119.623178:0:17755:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789131119.623184:0:17755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8494b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+4:17787:x1876039508882304:12345-0@lo:104: Request processed in 101us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131119.623191:0:17755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789131119.623205:0:17755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789131119.623213:0:17755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8497840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+3:17787:x1876039508882432:12345-0@lo:104: 00010000:00010000:2.0:1789131119.623222:0:17755:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff91dcc85cb200/0xf3fe2838e1fc341e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3fe2838e1fc3425 expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131119.623266:0:17755:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789131119.623270:0:17787:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8495a40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17787:1876039508882304:0@lo:104: 00000100:00100000:1.0:1789131119.623275:0:18505:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8496d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:18505:1876039508882176:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789131119.623276:0:17755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8497840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+3:17787:x1876039508882432:12345-0@lo:104: Request processed in 61us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131119.623288:0:17755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789131119.623290:0:17787:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8494780 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17787:1876039508882432:0@lo:104: 10000000:01000000:1.0:1789131119.623295:0:18505:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1789131119.623300:0:18505:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789131119.623302:0:18505:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1789131119.623304:0:18505:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789131119.623306:0:18505:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789131119.623307:0:18505:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789131119.623309:0:18505:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789131119.623311:0:18505:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789131119.623313:0:18505:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789131119.623314:0:18505:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00010000:00010000:0.0:1789131119.623316:0:17787:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91dcc85ca400/0xf3fe2838e1fc3521 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131119.623396:0:17759:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789131119.623404:0:17759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7fe00/0xf3fe2838e1fc34e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3fe2838e1fc34e9 expref: -99 pid: 18505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131119.623413:0:17759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc7f7fe00 already unused, calling callback (ffffffffc124bc20) 10000000:00010000:2.0:1789131119.623424:0:17759:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7fe00/0xf3fe2838e1fc34e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf3fe2838e1fc34e9 expref: -99 pid: 18505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131119.623434:0:17759:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7fe00/0xf3fe2838e1fc34e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf3fe2838e1fc34e9 expref: -99 pid: 18505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789131119.623454:0:17759:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7fe00/0xf3fe2838e1fc34e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf3fe2838e1fc34e9 expref: -99 pid: 18505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:02000000:1.0:1789131119.623772:0:18505:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 10000000:01000000:2.0:1789131119.624421:0:17759:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789131119.624495:0:17759:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7fe00/0xf3fe2838e1fc34e2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc34e9 expref: -99 pid: 18505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131119.624503:0:17759:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789131119.624594:0:17759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7fe00/0xf3fe2838e1fc34e2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc34e9 expref: -99 pid: 18505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131119.624603:0:17759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7fe00/0xf3fe2838e1fc34e2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc34e9 expref: -99 pid: 18505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131119.624619:0:17759:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789131119.624623:0:17759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff91dcc85cb200/0xf3fe2838e1fc341e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3fe2838e1fc3425 expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131119.624630:0:17759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc85cb200 already unused, calling callback (ffffffffc124bc20) 10000000:00010000:2.0:1789131119.624633:0:17759:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff91dcc85cb200/0xf3fe2838e1fc341e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf3fe2838e1fc3425 expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131119.624642:0:17759:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff91dcc85cb200/0xf3fe2838e1fc341e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf3fe2838e1fc3425 expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789131119.624660:0:17759:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff91dcc85cb200/0xf3fe2838e1fc341e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf3fe2838e1fc3425 expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789131119.624666:0:17759:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789131119.625086:0:17759:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff91dcc85cb200/0xf3fe2838e1fc341e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc3425 expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131119.625095:0:17759:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789131119.625128:0:17759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff91dcc85cb200/0xf3fe2838e1fc341e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc3425 expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131119.625136:0:17759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff91dcc85cb200/0xf3fe2838e1fc341e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc3425 expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131119.625152:0:17759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131119.625154:0:17759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131119.625156:0:17759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131119.625171:0:17760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789131119.625193:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789131119.625214:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd286cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:3627:1876039508882560:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789131119.625287:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131119.625409:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd286ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:3625:1876039508882688:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789131119.625443:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131119.625901:0:17756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508882560 00000100:00100000:2.0:1789131119.625910:0:17756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508882560 00010000:00010000:2.0:1789131119.625943:0:17756:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91de01ad6e00/0xf3fe2838e1fc34e9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3fe2838e1fc34e2 expref: 18 pid: 17764 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131119.626259:0:17756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508882688 00000100:00100000:2.0:1789131119.626272:0:17756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508882688 00010000:00010000:2.0:1789131119.626291:0:17756:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91de01ad7a00/0xf3fe2838e1fc3425 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3fe2838e1fc341e expref: 19 pid: 17764 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131119.631477:0:17758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789131119.631508:0:17758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd286d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+19:3627:x1876039508882560:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789131119.631522:0:17756:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1789131119.631536:0:17756:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:0.0:1789131119.631548:0:17758:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789131119.631563:0:17758:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91de01ad6e00/0xf3fe2838e1fc34e9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3fe2838e1fc34e2 expref: 19 pid: 17764 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131119.631571:0:17757:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:0.0:1789131119.631598:0:17758:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91de01ad6e00/0xf3fe2838e1fc34e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf3fe2838e1fc34e2 expref: 19 pid: 17764 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131119.631604:0:17757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789131119.631618:0:17757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd286cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+19:3625:x1876039508882688:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789131119.631636:0:17758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91de01ad6e00/0xf3fe2838e1fc34e9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf3fe2838e1fc34e2 expref: 19 pid: 17764 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131119.631643:0:17757:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789131119.631651:0:17757:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91de01ad7a00/0xf3fe2838e1fc3425 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3fe2838e1fc341e expref: 19 pid: 17764 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131119.631671:0:17757:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91de01ad7a00/0xf3fe2838e1fc3425 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf3fe2838e1fc341e expref: 19 pid: 17764 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131119.631685:0:17758:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789131119.631691:0:17757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91de01ad7a00/0xf3fe2838e1fc3425 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf3fe2838e1fc341e expref: 18 pid: 17764 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131119.631812:0:17757:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91dcc85ca400/0xf3fe2838e1fc3521 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131119.631825:0:17757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91dcc85ca400/0xf3fe2838e1fc3521 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789131119.631847:0:17757:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.010213369s 00010000:00010000:2.0:1789131119.631852:0:17757:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91dcc85ca400/0xf3fe2838e1fc3521 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131119.631860:0:17757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91dcc85ca400/0xf3fe2838e1fc3521 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131119.631879:0:17757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91dcc85ca400/0xf3fe2838e1fc3521 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131119.631887:0:17757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91dcc85ca400/0xf3fe2838e1fc3521 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131119.631893:0:17757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc85ca400 already unused, calling callback (ffffffffc0c4e550) 00010000:00010000:2.0:1789131119.631898:0:17757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91dcc85ca400/0xf3fe2838e1fc3521 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131119.631908:0:17757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91dcc85ca400/0xf3fe2838e1fc3521 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131119.631926:0:17757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91dcc85ca400/0xf3fe2838e1fc3521 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131119.631939:0:17757:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789131119.632089:0:17758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd286d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+17:3627:x1876039508882560:12345-0@lo:103:ldlm_bl.0 Request processed in 595us (6801us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131119.632100:0:17758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789131119.632123:0:17757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd286cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+17:3625:x1876039508882688:12345-0@lo:103:ldlm_bl.0 Request processed in 507us (6676us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131119.632132:0:17757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789131119.632289:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd286cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:3627:1876039508882560:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789131119.632338:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd286ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:3625:1876039508882688:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789131119.632372:0:17787:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91dcc85ca400/0xf3fe2838e1fc3521 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131119.632381:0:17787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91dcc85ca400/0xf3fe2838e1fc3521 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131119.632398:0:17787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91dcc85ca400/0xf3fe2838e1fc3521 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131119.638477:0:17759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1789131119.640124:0:18505:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:2.0:1789131119.640134:0:18533:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:2.0:1789131119.640140:0:18533:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:2.0:1789131119.640746:0:18534:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1789131119.641135:0:18505:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:1.0:1789131119.642208:0:18535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8496d00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:18535:1876039508882816:0@lo:1000:lod0001_rec0000.0 00000040:01000000:2.0:1789131119.642266:0:18505:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000100:00100000:1.0:1789131119.642312:0:18535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:2.0:1789131119.642328:0:18505:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789131119.642367:0:17777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508882816 00000100:00100000:1.0:1789131119.642377:0:17777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508882816 00000100:00100000:1.0:1789131119.642432:0:17777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789131119.642441:0:17777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8495680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:18535:x1876039508882816:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1789131119.642538:0:17777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8495680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:18535:x1876039508882816:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 98us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131119.642547:0:17777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789131119.642574:0:18535:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddc5190b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789131119.642599:0:18535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8496d00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:18535:1876039508882816:0@lo:1000:lod0001_rec0000.0 00000040:01000000:1.0:1789131119.642642:0:18535:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1789131119.642671:0:18535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8496d00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:18535:1876039508882944:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1789131119.642701:0:18535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00000080:2.0:1789131119.642778:0:18505:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1789131119.642786:0:18505:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:2.0:1789131119.642824:0:18505:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789131119.643849:0:17776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508882944 00000100:00100000:1.0:1789131119.643869:0:17776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508882944 00000100:00100000:1.0:1789131119.643915:0:17776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789131119.643925:0:17776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8496940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:18535:x1876039508882944:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1789131119.644197:0:17776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8496940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:18535:x1876039508882944:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 272us (1493us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131119.644205:0:17776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789131119.644232:0:18535:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddc5190b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789131119.644254:0:18535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8496d00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:18535:1876039508882944:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1789131119.644349:0:18535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8496d00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:18535:1876039508883072:0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1789131119.644390:0:18535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131119.644416:0:18535:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddc5190f00 going to sleep for 11 seconds 00000040:00080000:2.0:1789131119.644953:0:18505:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1789131119.646758:0:18505:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1789131119.646840:0:18505:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000100:00100000:3.0:1789131119.647452:0:17782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508883072 00000100:00100000:3.0:1789131119.647488:0:17782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508883072 00000100:00100000:3.0:1789131119.647541:0:17782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789131119.647564:0:17782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc84952c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:18535:x1876039508883072:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1789131119.647710:0:17782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc84952c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:18535:x1876039508883072:12345-0@lo:900:lod0001_rec0000.0 Request processed in 147us (3318us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131119.647718:0:17782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000040:00080000:3.0:1789131119.648061:0:18534:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789131119.649352:0:18505:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1789131119.651207:0:18505:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x2f:0x0] (8/32) registered 00010000:00080000:0.0:1789131119.653094:0:18535:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91dcc8496d00 x1876039508883072/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789131135 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789131119.653131:0:18535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8496d00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:18535:1876039508883072:0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1789131119.653575:0:18535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc860a580 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:18535:1876039508883200:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1789131119.653662:0:18535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131119.653713:0:18535:0:(client.c:2715:ptlrpc_set_wait()) set ffff91dcc85469c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789131119.653714:0:18514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508883200 00000100:00100000:1.0:1789131119.653723:0:18514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508883200 00000100:00100000:1.0:1789131119.653792:0:18514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789131119.653802:0:18514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc860a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:18535:x1876039508883200:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1789131119.653899:0:18514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc860a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:18535:x1876039508883200:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 98us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131119.653907:0:18514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000040:00080000:3.0:1789131119.655220:0:18534:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1789131119.655557:0:18534:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000100:00100000:0.0:1789131119.655916:0:18535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc860a580 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:18535:1876039508883200:0@lo:1000:lod0001_rec0000.0 00000040:00080000:0.0:1789131119.656090:0:18535:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00000004:2.0:1789131119.657261:0:18505:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000040:00080000:0.0:1789131119.660487:0:18535:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1789131119.660595:0:18535:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1789131119.660601:0:18535:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00080000:2.0:1789131119.674676:0:18505:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1789131119.674724:0:18505:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffb3f44197b988 00100000:10000000:2.0:1789131119.674736:0:18505:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:2.0:1789131119.675905:0:18505:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789131119.675941:0:18505:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.111@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789131119.675967:0:18505:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1789131119.675997:0:18505:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:2.0:1789131119.678799:0:18505:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789131119.680786:0:18505:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1789131120.082005:0:17815:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddd8364f00 going to sleep for 0 seconds 00010000:00010000:3.0:1789131120.664061:0:17760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789131120.666693:0:18526:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:3.0:1789131120.981692:0:17768:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789131120.981699:0:17768:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff91ddf34a7800 from 8 10000000:01000000:3.0:1789131120.981705:0:17768:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789131120.981755:0:17768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff91ddfd0b4800/0xf3fe2838e1fc3528 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131120.981768:0:17768:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff91ddfd0b4800/0xf3fe2838e1fc3528 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131120.981779:0:17768:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff91ddfd0b4800/0xf3fe2838e1fc3528 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131120.981805:0:17768:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd1dad680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:17768:1876039508883328:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789131120.981875:0:17768:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131120.981932:0:17768:0:(client.c:2715:ptlrpc_set_wait()) set ffff91dcc6ea0600 going to sleep for 11 seconds 00000100:00100000:3.0:1789131120.981976:0:17764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508883328 00000100:00100000:3.0:1789131120.981983:0:17764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508883328 00000100:00100000:3.0:1789131120.982032:0:17764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789131120.982042:0:17764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd2c8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+16:17768:x1876039508883328:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789131120.982055:0:17764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789131120.982079:0:17764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91ddfd0b4200/0xf3fe2838e1fc352f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3fe2838e1fc3528 expref: -99 pid: 17764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131120.982121:0:17764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91ddfd0b4200/0xf3fe2838e1fc352f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3fe2838e1fc3528 expref: 17 pid: 17764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131120.982134:0:17764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91ddfd0b4200/0xf3fe2838e1fc352f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc3528 expref: 17 pid: 17764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131120.982143:0:17764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ddfd0b4200, rc 0) 00000100:00100000:3.0:1789131120.982181:0:17764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd2c8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+17:17768:x1876039508883328:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 141us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131120.982188:0:17764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789131120.982246:0:17768:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd1dad680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:17768:1876039508883328:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789131120.982266:0:17768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff91ddfd0b4800/0xf3fe2838e1fc3528 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc352f expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131120.982276:0:17768:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff91ddfd0b4800/0xf3fe2838e1fc3528 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3fe2838e1fc352f expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131120.982326:0:17768:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd1dad680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:17768:1876039508883456:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789131120.982359:0:17768:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131120.982380:0:17768:0:(client.c:2715:ptlrpc_set_wait()) set ffff91dcc6ea0600 going to sleep for 11 seconds 00000100:00100000:3.0:1789131120.982393:0:17765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508883456 00000100:00100000:3.0:1789131120.982397:0:17765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508883456 00000100:00100000:3.0:1789131120.982421:0:17765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789131120.982668:0:17765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd2c89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+17:17768:x1876039508883456:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1789131120.982683:0:17765:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789131120.982702:0:17765:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789131120.982705:0:17765:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:3.0:1789131120.982786:0:17765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd2c89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+17:17768:x1876039508883456:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 357us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131120.982794:0:17765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789131120.982827:0:17768:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd1dad680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:17768:1876039508883456:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789131120.982866:0:17768:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789131120.982873:0:17768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff91ddfd0b4800/0xf3fe2838e1fc3528 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc352f expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131120.982881:0:17768:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff91ddfd0b4800/0xf3fe2838e1fc3528 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc352f expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789131120.982890:0:17768:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789131120.982893:0:17768:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff91dcc78a7000 from 8 10000000:01000000:3.0:1789131120.982895:0:17768:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789131120.982914:0:17768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff91ddfd0b4400/0xf3fe2838e1fc3536 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131120.982922:0:17768:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff91ddfd0b4400/0xf3fe2838e1fc3536 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131120.982930:0:17768:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff91ddfd0b4400/0xf3fe2838e1fc3536 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131120.982945:0:17768:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd1dad680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:17768:1876039508883584:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789131120.982974:0:17768:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131120.982994:0:17768:0:(client.c:2715:ptlrpc_set_wait()) set ffff91dcc6ea0600 going to sleep for 11 seconds 00000100:00100000:1.0:1789131120.983020:0:17766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508883584 00000100:00100000:1.0:1789131120.983026:0:17766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508883584 00000100:00100000:1.0:1789131120.983061:0:17766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789131120.983069:0:17766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd2c8a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+17:17768:x1876039508883584:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789131120.983078:0:17766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789131120.983088:0:17766:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91dcc85cbc00/0xf3fe2838e1fc353d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3fe2838e1fc3536 expref: -99 pid: 17766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131120.985902:0:17766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91dcc85cbc00/0xf3fe2838e1fc353d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3fe2838e1fc3536 expref: 18 pid: 17766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131120.985933:0:17766:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91dcc85cbc00/0xf3fe2838e1fc353d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc3536 expref: 18 pid: 17766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131120.985943:0:17766:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dcc85cbc00, rc 0) 00000100:00100000:1.0:1789131120.986029:0:17766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd2c8a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+18:17768:x1876039508883584:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 2959us (3053us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131120.986038:0:17766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789131120.987649:0:17768:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd1dad680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:17768:1876039508883584:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789131120.987694:0:17768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff91ddfd0b4400/0xf3fe2838e1fc3536 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc353d expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131120.987705:0:17768:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff91ddfd0b4400/0xf3fe2838e1fc3536 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3fe2838e1fc353d expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131120.987782:0:17768:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd1dad680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:17768:1876039508883712:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789131120.987832:0:17768:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131120.987877:0:17768:0:(client.c:2715:ptlrpc_set_wait()) set ffff91dcc6ea0600 going to sleep for 11 seconds 00000100:00100000:1.0:1789131120.987975:0:17764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508883712 00000100:00100000:1.0:1789131120.987981:0:17764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508883712 00000100:00100000:1.0:1789131120.988028:0:17764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789131120.988036:0:17764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd2c89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+18:17768:x1876039508883712:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1789131120.988053:0:17764:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789131120.988067:0:17764:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789131120.988070:0:17764:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:1.0:1789131120.988186:0:17764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd2c89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+18:17768:x1876039508883712:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 150us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131120.988193:0:17764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789131120.989540:0:17768:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd1dad680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:17768:1876039508883712:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1789131120.989596:0:17768:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789131120.989605:0:17768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff91ddfd0b4400/0xf3fe2838e1fc3536 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc353d expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131120.989623:0:17768:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff91ddfd0b4400/0xf3fe2838e1fc3536 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc353d expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131121.105659:0:17815:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddd8364f00 going to sleep for 0 seconds 00000040:00080000:3.0:1789131121.682084:0:18526:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789131121.683231:0:17759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789131122.132919:0:17815:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddd8364f00 going to sleep for 0 seconds 00010000:00010000:3.0:1789131122.709632:0:17760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789131123.153552:0:17815:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddd8364f00 going to sleep for 0 seconds 00010000:00010000:2.0:1789131123.734043:0:17759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789131123.915450:0:18779:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg311-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1789131124.177593:0:17815:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddd8364f00 going to sleep for 0 seconds 00010000:00010000:3.0:1789131124.755225:0:17760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789131124.793966:0:18831:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789131124.794353:0:18831:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1789131124.818011:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1876039508883840:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789131124.818094:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131124.819609:0:17777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508883840 00000100:00100000:1.0:1789131124.819622:0:17777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508883840 00000100:00100000:1.0:1789131124.819687:0:17777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789131124.819698:0:17777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd286ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1876039508883840:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789131124.819734:0:17777:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1789131124.819811:0:17777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd286ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1876039508883840:12345-0@lo:41:osp-pre-0-1.0 Request processed in 115us (1717us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131124.819818:0:17777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789131124.819874:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1876039508883840:0@lo:41:osp-pre-0-1.0 00000100:00080000:1.0:1789131124.819879:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1789131124.819890:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1789131124.819894:0:38:0:(import.c:65:import_set_state_nolock()) ffff91ddcf4da000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789131124.819902:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff91ddcf4da000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:2.0:1789131124.819906:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8496d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:3627:1876039508883968:0@lo:400:kworker.0 00000100:00100000:1.0:1789131124.819926:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91dcc8494780 x1876039508884096/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789131124.819944:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789131124.819947:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789131124.819950:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789131124.819953:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789131124.819965:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789131124.819967:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789131124.819969:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789131124.819972:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789131124.820002:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8495a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3628:1876039508884224:0@lo:400:kworker.0 00000100:00100000:2.0:1789131124.820017:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131124.820045:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131124.820068:0:17766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508883968 00000100:00100000:2.0:1789131124.820083:0:17766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508883968 00000100:00100000:2.0:1789131124.820114:0:17766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789131124.820121:0:17766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd2c8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+18:3627:x1876039508883968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131124.820178:0:17766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd2c8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+18:3627:x1876039508883968:12345-0@lo:400:kworker.0 Request processed in 57us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131124.820186:0:17766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789131124.820218:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3625:1876039508884352:0@lo:400:kworker.0 00000100:00100000:2.0:1789131124.820247:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131124.820282:0:17772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508884224 00000100:00100000:2.0:1789131124.820286:0:17772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508884224 00000100:00100000:2.0:1789131124.820315:0:17772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508884352 00000100:00100000:2.0:1789131124.820319:0:17772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508884352 00000100:00100000:2.0:1789131124.820338:0:17772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789131124.820345:0:17772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7892940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1876039508884224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131124.820396:0:17772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7892940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1876039508884224:12345-0@lo:400:kworker.0 Request processed in 51us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131124.820403:0:17772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789131124.820416:0:17772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789131124.820421:0:17772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd286cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1876039508884352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131124.820452:0:17772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd286cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1876039508884352:12345-0@lo:400:kworker.0 Request processed in 31us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131124.820476:0:17772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1789131124.820506:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91dcc8497480 x1876039508884352/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789131140 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789131124.820516:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3625:1876039508884352:0@lo:400:kworker.0 00010000:00080000:2.0:1789131124.820539:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91dcc8495a40 x1876039508884224/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789131140 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789131124.820548:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8495a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3628:1876039508884224:0@lo:400:kworker.0 00000100:00100000:2.0:1789131124.820567:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8496d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:3627:1876039508883968:0@lo:400:kworker.0 00000100:00100000:1.0:1789131124.822040:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8494780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3624:1876039508884096:0@lo:38:kworker.0 00000100:00100000:1.0:1789131124.822107:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131124.822330:0:17776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508884096 00000100:00100000:0.0:1789131124.822339:0:17776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508884096 00000100:00100000:0.0:1789131124.822378:0:17776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789131124.822386:0:17776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7890b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3624:x1876039508884096:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1789131124.822599:0:17776:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 480 last 0 00000020:00000080:0.0:1789131124.822645:0:17776:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf3fe2838e1fc3544 00000004:00100000:0.0:1789131124.822660:0:17776:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1789131124.822677:0:17776:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:1.0:1789131124.842241:0:17776:0:(import.c:65:import_set_state_nolock()) ffff91dcc844b000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789131124.842344:0:17776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7890b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3624:x1876039508884096:12345-0@lo:38:kworker.0 Request processed in 19956us (20234us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131124.842356:0:17776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:0.0:1789131124.842627:0:3624:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1789131124.842644:0:3624:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1789131124.842652:0:3624:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1789131124.842656:0:3624:0:(import.c:65:import_set_state_nolock()) ffff91ddcf4da000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:0.0:1789131124.842684:0:3624:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 0000000001fd3e0b): req@ffff91dcc860b480 x1876039508877056/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789131124.842709:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8494780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3624:1876039508884096:0@lo:38:kworker.0 00000100:00100000:2.0:1789131124.842801:0:17815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131124.842838:0:17815:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddd8364f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789131124.842860:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd1dad680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508884480:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789131124.842885:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131124.843016:0:18514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508877056 00000100:00100000:0.0:1789131124.843025:0:18514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508877056 00000100:00100000:0.0:1789131124.843089:0:18514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508884480 00000100:00100000:0.0:1789131124.843092:0:18514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508884480 00000100:00100000:0.0:1789131124.843112:0:18514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789131124.843122:0:18514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd286f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:17815:x1876039508877056:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1789131124.843171:0:17776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789131124.843185:0:17776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd286f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:3626:x1876039508884480:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789131124.843213:0:17776:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789131124.843255:0:17776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd286f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:3626:x1876039508884480:12345-0@lo:41:osp-pre-1-0.0 Request processed in 75us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131124.843270:0:17776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789131124.843315:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd1dad680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508884480:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789131124.843597:0:18514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd286f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17815:x1876039508877056:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 474us (795us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131124.843607:0:18514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789131124.848737:0:17815:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc860b480 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17815:1876039508877056:0@lo:1000:lod0000_rec0001.0 00000040:01000000:2.0:1789131124.848785:0:17815:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1789131124.848833:0:17815:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd286fc00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17815:1876039508884608:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1789131124.848901:0:17815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131124.849025:0:17815:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddd8364600 going to sleep for 11 seconds 00000100:00100000:2.0:1789131124.849385:0:17776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508884608 00000100:00100000:2.0:1789131124.849393:0:17776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508884608 00000100:00100000:2.0:1789131124.849443:0:17776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789131124.849452:0:17776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd286e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17815:x1876039508884608:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1789131124.850138:0:17776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd286e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17815:x1876039508884608:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 685us (1235us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131124.850147:0:17776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789131124.850195:0:17815:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd286fc00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17815:1876039508884608:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1789131124.850277:0:17815:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd286fc00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17815:1876039508884736:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1789131124.850308:0:17815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131124.850329:0:17815:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddcf5c40c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789131124.850346:0:17777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508884736 00000100:00100000:2.0:1789131124.850349:0:17777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508884736 00000100:00100000:2.0:1789131124.850376:0:17777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789131124.850384:0:17777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd286de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17815:x1876039508884736:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1789131124.850438:0:17777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd286de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17815:x1876039508884736:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 55us (129us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131124.850456:0:17777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789131124.850509:0:17815:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd286fc00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17815:1876039508884736:0@lo:1000:lod0000_rec0001.0 00000040:00080000:2.0:1789131124.850549:0:17815:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789131124.853617:0:17815:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1789131124.853690:0:17815:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 18, retries 0 00000004:00080000:2.0:1789131124.853695:0:17815:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000020:00000004:1.0:1789131125.755930:0:18881:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789131125.756789:0:18881:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789131125.781559:0:17759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789131126.727346:0:18929:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe5383e1b0 20000000:00000080:3.0:1789131126.727365:0:18929:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff91dddf269000 uarg=0000000000000000 20000000:01000000:3.0:1789131126.727406:0:18929:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1789131126.727413:0:18929:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1789131126.727418:0:18929:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1789131126.728088:0:18930:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 19 20000000:00000400:3.0:1789131126.728243:0:18929:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:3.0:1789131126.736781:0:18929:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789131126.736814:0:18929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91ddfd0b5e00/0xf3fe2838e1fc354b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131126.736833:0:18929:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91dcc85caa00/0xf3fe2838e1fc33f4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc33ed expref: 17 pid: 17766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131126.736855:0:18929:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91de01ad6000/0xf3fe2838e1fc34f7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc34f0 expref: 17 pid: 17764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131126.736862:0:18929:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91ddfd0b5e00/0xf3fe2838e1fc354b lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131126.736900:0:18929:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91de01ad6000/0xf3fe2838e1fc34f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf3fe2838e1fc34f0 expref: 17 pid: 17764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131126.736914:0:18929:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91de01ad6000/0xf3fe2838e1fc34f7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf3fe2838e1fc34f0 expref: 17 pid: 17764 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131126.736928:0:18929:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd1dae1c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18929:1876039508884864:0@lo:104: 00000100:00100000:3.0:1789131126.736989:0:18929:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789131126.737089:0:18929:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91dcc85caa00/0xf3fe2838e1fc33f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf3fe2838e1fc33ed expref: 17 pid: 17766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131126.737097:0:18929:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91dcc85caa00/0xf3fe2838e1fc33f4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf3fe2838e1fc33ed expref: 17 pid: 17766 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131126.737106:0:18929:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd1daed00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18929:1876039508884992:0@lo:104: 00000100:00100000:3.0:1789131126.737128:0:18929:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131126.737225:0:18929:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddc302a480 going to sleep for 11 seconds 00000100:00100000:2.0:1789131126.737442:0:17755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508884864 00000100:00100000:2.0:1789131126.737449:0:17755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508884864 00000100:00100000:2.0:1789131126.737517:0:17755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508884992 00000100:00100000:2.0:1789131126.737521:0:17755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508884992 00000100:00100000:2.0:1789131126.737534:0:17755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789131126.737542:0:17755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd1dac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+4:18929:x1876039508884864:12345-0@lo:104: 00010000:00010000:2.0:1789131126.737555:0:17755:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7fc00/0xf3fe2838e1fc34f0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3fe2838e1fc34f7 expref: -99 pid: 18505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131126.737615:0:17755:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789131126.737620:0:17755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd1dac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+4:18929:x1876039508884864:12345-0@lo:104: Request processed in 80us (632us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131126.737627:0:17755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789131126.737643:0:17755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789131126.737649:0:17755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd1daf840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+3:18929:x1876039508884992:12345-0@lo:104: 00010000:00010000:2.0:1789131126.737656:0:17755:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7f200/0xf3fe2838e1fc33ed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3fe2838e1fc33f4 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131126.737685:0:17755:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789131126.737700:0:17755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd1daf840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+3:18929:x1876039508884992:12345-0@lo:104: Request processed in 42us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131126.737717:0:17755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1789131126.737734:0:17759:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789131126.737740:0:17759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7fc00/0xf3fe2838e1fc34f0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3fe2838e1fc34f7 expref: -99 pid: 18505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131126.737748:0:17759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc7f7fc00 already unused, calling callback (ffffffffc124bc20) 10000000:00010000:2.0:1789131126.737752:0:17759:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7fc00/0xf3fe2838e1fc34f0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf3fe2838e1fc34f7 expref: -99 pid: 18505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131126.737761:0:17759:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7fc00/0xf3fe2838e1fc34f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf3fe2838e1fc34f7 expref: -99 pid: 18505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789131126.737769:0:17759:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7fc00/0xf3fe2838e1fc34f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf3fe2838e1fc34f7 expref: -99 pid: 18505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789131126.737774:0:17759:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789131126.737802:0:17759:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7fc00/0xf3fe2838e1fc34f0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc34f7 expref: -99 pid: 18505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131126.737809:0:17759:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789131126.737827:0:17759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7fc00/0xf3fe2838e1fc34f0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc34f7 expref: -99 pid: 18505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131126.737834:0:17759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7fc00/0xf3fe2838e1fc34f0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc34f7 expref: -99 pid: 18505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131126.737846:0:17759:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789131126.737849:0:17759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7f200/0xf3fe2838e1fc33ed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3fe2838e1fc33f4 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131126.737865:0:17759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc7f7f200 already unused, calling callback (ffffffffc124bc20) 10000000:00010000:2.0:1789131126.737867:0:17759:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7f200/0xf3fe2838e1fc33ed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf3fe2838e1fc33f4 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131126.737873:0:17759:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7f200/0xf3fe2838e1fc33ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf3fe2838e1fc33f4 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789131126.737878:0:17759:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7f200/0xf3fe2838e1fc33ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf3fe2838e1fc33f4 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789131126.737883:0:17759:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789131126.737897:0:17759:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7f200/0xf3fe2838e1fc33ed lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc33f4 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131126.737903:0:17759:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789131126.737909:0:17759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7f200/0xf3fe2838e1fc33ed lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc33f4 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131126.737915:0:17759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7f200/0xf3fe2838e1fc33ed lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc33f4 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131126.737927:0:17759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131126.737929:0:17759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131126.737930:0:17759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789131126.737950:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd286e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:3627:1876039508885120:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789131126.737979:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131126.738040:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789131126.738046:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd286fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:3627:1876039508885248:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789131126.738090:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131126.738119:0:17757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508885120 00000100:00100000:2.0:1789131126.738123:0:17757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508885120 00010000:00010000:2.0:1789131126.738141:0:17757:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91de01ad6000/0xf3fe2838e1fc34f7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3fe2838e1fc34f0 expref: 18 pid: 17764 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131126.738160:0:17757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508885248 00000100:00100000:2.0:1789131126.738163:0:17757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508885248 00010000:00010000:2.0:1789131126.738173:0:17757:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91dcc85caa00/0xf3fe2838e1fc33f4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3fe2838e1fc33ed expref: 19 pid: 17766 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131126.738189:0:17757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789131126.738196:0:17757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd286c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+19:3627:x1876039508885120:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789131126.738205:0:17757:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789131126.738210:0:17757:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91de01ad6000/0xf3fe2838e1fc34f7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3fe2838e1fc34f0 expref: 19 pid: 17764 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131126.738219:0:17757:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91de01ad6000/0xf3fe2838e1fc34f7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf3fe2838e1fc34f0 expref: 19 pid: 17764 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131126.738233:0:17757:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789131126.738260:0:17757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd286c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+19:3627:x1876039508885120:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131126.738282:0:17757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789131126.738295:0:17757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789131126.738301:0:17757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8496580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+18:3627:x1876039508885248:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789131126.738309:0:17757:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789131126.738312:0:17757:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91dcc85caa00/0xf3fe2838e1fc33f4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3fe2838e1fc33ed expref: 18 pid: 17766 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131126.738333:0:17757:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91dcc85caa00/0xf3fe2838e1fc33f4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf3fe2838e1fc33ed expref: 18 pid: 17766 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131126.738344:0:17757:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91ddfd0b5e00/0xf3fe2838e1fc354b lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131126.738352:0:17757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91ddfd0b5e00/0xf3fe2838e1fc354b lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131126.738365:0:17757:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91ddfd0b5e00/0xf3fe2838e1fc354b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131126.738372:0:17757:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91ddfd0b5e00/0xf3fe2838e1fc354b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131126.738379:0:17757:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91ddfd0b5e00/0xf3fe2838e1fc354b lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131126.738385:0:17757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91ddfd0b5e00/0xf3fe2838e1fc354b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131126.738390:0:17757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddfd0b5e00 already unused, calling callback (ffffffffc0c4e550) 00010000:00010000:2.0:1789131126.738394:0:17757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91ddfd0b5e00/0xf3fe2838e1fc354b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131126.738401:0:17757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91ddfd0b5e00/0xf3fe2838e1fc354b lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131126.738409:0:17757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91ddfd0b5e00/0xf3fe2838e1fc354b lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131126.738428:0:17757:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789131126.738452:0:17757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8496580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+18:3627:x1876039508885248:12345-0@lo:103:ldlm_bl.0 Request processed in 152us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131126.738481:0:17757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789131126.738521:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd286fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:3627:1876039508885248:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789131126.738530:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd286e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:3627:1876039508885120:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789131126.738818:0:18929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91de01ad6000/0xf3fe2838e1fc34f7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf3fe2838e1fc34f0 expref: 17 pid: 17764 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131126.738830:0:18929:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd1dae1c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18929:1876039508884864:0@lo:104: 00010000:00010000:3.0:1789131126.738839:0:18929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91dcc85caa00/0xf3fe2838e1fc33f4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf3fe2838e1fc33ed expref: 16 pid: 17766 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131126.738862:0:18929:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd1daed00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18929:1876039508884992:0@lo:104: 00010000:00010000:3.0:1789131126.738879:0:18929:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91ddfd0b5e00/0xf3fe2838e1fc354b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131126.738888:0:18929:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91ddfd0b5e00/0xf3fe2838e1fc354b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131126.738895:0:18929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91ddfd0b5e00/0xf3fe2838e1fc354b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131126.738901:0:18929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91ddfd0b5e00/0xf3fe2838e1fc354b lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131126.740407:0:17760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789131126.801673:0:17759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789131127.826037:0:17760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789131128.017739:0:17768:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789131128.017747:0:17768:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91ddf34a7800 from 19 10000000:01000000:2.0:1789131128.017752:0:17768:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789131128.017801:0:17768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7ec00/0xf3fe2838e1fc3552 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131128.017814:0:17768:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7ec00/0xf3fe2838e1fc3552 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131128.017825:0:17768:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7ec00/0xf3fe2838e1fc3552 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131128.017854:0:17768:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8496d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:17768:1876039508885376:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789131128.017927:0:17768:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131128.017970:0:17768:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddf5d1e6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789131128.018499:0:17765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508885376 00000100:00100000:3.0:1789131128.018508:0:17765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508885376 00000100:00100000:3.0:1789131128.021169:0:17765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789131128.021195:0:17765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd2c89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+16:17768:x1876039508885376:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789131128.021216:0:17765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789131128.021237:0:17765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91ddfd0b5e00/0xf3fe2838e1fc3559 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3fe2838e1fc3552 expref: -99 pid: 17765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131128.021266:0:17765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91ddfd0b5e00/0xf3fe2838e1fc3559 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3fe2838e1fc3552 expref: 17 pid: 17765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131128.021279:0:17765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91ddfd0b5e00/0xf3fe2838e1fc3559 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc3552 expref: 17 pid: 17765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131128.021289:0:17765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ddfd0b5e00, rc 0) 00000100:00100000:3.0:1789131128.021394:0:17765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd2c89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+17:17768:x1876039508885376:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 212us (3467us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131128.021402:0:17765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789131128.024178:0:17768:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8496d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:17768:1876039508885376:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789131128.024209:0:17768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7ec00/0xf3fe2838e1fc3552 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc3559 expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131128.024222:0:17768:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7ec00/0xf3fe2838e1fc3552 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3fe2838e1fc3559 expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131128.024313:0:17768:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8496d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:17768:1876039508885504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789131128.024379:0:17768:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131128.027585:0:17768:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddf5d1e6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789131128.029108:0:17766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508885504 00000100:00100000:1.0:1789131128.029119:0:17766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508885504 00000100:00100000:1.0:1789131128.029202:0:17766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789131128.029211:0:17766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd2c8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+17:17768:x1876039508885504:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789131128.029367:0:17766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd2c8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+17:17768:x1876039508885504:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 156us (4988us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131128.029375:0:17766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789131128.029542:0:17768:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8496d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:17768:1876039508885504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789131128.029591:0:17768:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8496d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:17768:1876039508885632:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789131128.029638:0:17768:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131128.029668:0:17768:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddf5d1e6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789131128.029838:0:17766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508885632 00000100:00100000:1.0:1789131128.029842:0:17766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508885632 00000100:00100000:1.0:1789131128.029859:0:17766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789131128.029864:0:17766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd2c88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+17:17768:x1876039508885632:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789131128.030009:0:17766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd2c88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+17:17768:x1876039508885632:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 143us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131128.030015:0:17766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789131128.037558:0:17768:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8496d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:17768:1876039508885632:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789131128.042500:0:18998:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 19 00000020:01000000:0.0:1789131128.042804:0:17768:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 19-18 (rc=0) 10000000:01000000:0.0:1789131128.042830:0:17768:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789131128.042842:0:17768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7ec00/0xf3fe2838e1fc3552 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc3559 expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131128.042853:0:17768:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7ec00/0xf3fe2838e1fc3552 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc3559 expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789131128.042884:0:17768:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789131128.042886:0:17768:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91dcc78a7000 from 19 10000000:01000000:0.0:1789131128.042889:0:17768:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789131128.042925:0:17768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff91de01ad6a00/0xf3fe2838e1fc3560 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131128.042932:0:17768:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff91de01ad6a00/0xf3fe2838e1fc3560 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131128.042941:0:17768:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff91de01ad6a00/0xf3fe2838e1fc3560 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131128.042967:0:17768:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8609e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:17768:1876039508885760:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789131128.043045:0:17768:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131128.043099:0:17768:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddd831e9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789131128.043170:0:17765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508885760 00000100:00100000:3.0:1789131128.043178:0:17765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508885760 00000100:00100000:3.0:1789131128.043229:0:17765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789131128.043239:0:17765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd2c8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+17:17768:x1876039508885760:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789131128.043251:0:17765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789131128.043273:0:17765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91ddfd0b5800/0xf3fe2838e1fc3567 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3fe2838e1fc3560 expref: -99 pid: 17765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131128.043296:0:17765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91ddfd0b5800/0xf3fe2838e1fc3567 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3fe2838e1fc3560 expref: 18 pid: 17765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131128.043306:0:17765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91ddfd0b5800/0xf3fe2838e1fc3567 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc3560 expref: 18 pid: 17765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131128.043314:0:17765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ddfd0b5800, rc 0) 00000100:00100000:3.0:1789131128.043367:0:17765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd2c8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+18:17768:x1876039508885760:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131128.043374:0:17765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789131128.043610:0:17768:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8609e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:17768:1876039508885760:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789131128.043624:0:17768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff91de01ad6a00/0xf3fe2838e1fc3560 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc3567 expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131128.043632:0:17768:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff91de01ad6a00/0xf3fe2838e1fc3560 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3fe2838e1fc3567 expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131128.043685:0:17768:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8609e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:17768:1876039508885888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789131128.043709:0:17768:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131128.043731:0:17768:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddd831e9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789131128.044220:0:17764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508885888 00000100:00100000:2.0:1789131128.044226:0:17764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508885888 00000100:00100000:2.0:1789131128.044258:0:17764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789131128.044275:0:17764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd2c8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+18:17768:x1876039508885888:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789131128.044408:0:17764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd2c8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+18:17768:x1876039508885888:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 136us (698us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131128.044416:0:17764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789131128.044551:0:17768:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8609e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:17768:1876039508885888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789131128.044586:0:17768:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7892580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:17768:1876039508886016:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789131128.044631:0:17768:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131128.044655:0:17768:0:(client.c:2715:ptlrpc_set_wait()) set ffff91dcc85463c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789131128.044818:0:17766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508886016 00000100:00100000:2.0:1789131128.044823:0:17766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508886016 00000100:00100000:2.0:1789131128.044846:0:17766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789131128.044852:0:17766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd2c89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+18:17768:x1876039508886016:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789131128.044929:0:17766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd2c89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+18:17768:x1876039508886016:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 75us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131128.044936:0:17766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789131128.044977:0:17768:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7892580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:17768:1876039508886016:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789131128.046015:0:18999:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 19 00000020:01000000:1.0:1789131128.052669:0:17768:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 19-18 (rc=0) 10000000:01000000:1.0:1789131128.052711:0:17768:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789131128.052723:0:17768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff91de01ad6a00/0xf3fe2838e1fc3560 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc3567 expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131128.052736:0:17768:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff91de01ad6a00/0xf3fe2838e1fc3560 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc3567 expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789131128.210032:0:17805:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789131128.851900:0:17759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789131129.878891:0:17760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789131129.943204:0:3624:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789131119/real 1789131119] req@ffff91ddd286e1c0 x1876039508880256/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789131129 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789131129.943252:0:3624:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff91ddd286e1c0 x1876039508880256/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789131129 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789131129.943263:0:3624:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789131119/real 1789131119] req@ffff91ddd286da40 x1876039508880000/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789131129 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789131129.943274:0:3624:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff91ddd286da40 x1876039508880000/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789131129 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789131129.943298:0:3624:0:(import.c:65:import_set_state_nolock()) ffff91ddff618800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789131129.943308:0:3624:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789131129.943312:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd286e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3624:1876039508880256:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1789131129.943319:0:3624:0:(import.c:65:import_set_state_nolock()) ffff91ddc5749800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789131129.943323:0:3624:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789131129.943327:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd286da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3624:1876039508880000:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1789131129.943597:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789131129.943603:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789131129.943606:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789131129.943609:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789131129.943636:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789131129.943638:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1789131129.943641:0:38:0:(import.c:65:import_set_state_nolock()) ffff91ddc5749800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789131129.943648:0:38:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 475 00000100:00080000:2.0:1789131129.943655:0:38:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789131129.943663:0:38:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff91ddc5749800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:2.0:1789131129.943685:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91ddd286da40 x1876039508886656/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789131129.943698:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789131129.943702:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789131129.943703:0:38:0:(import.c:65:import_set_state_nolock()) ffff91ddff618800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789131129.943706:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 475 00000100:00080000:2.0:1789131129.943708:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789131129.943712:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff91ddff618800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:2.0:1789131129.943722:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91ddd286e1c0 x1876039508886784/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789131129.943807:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8496d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:3625:1876039508886144:0@lo:400:kworker.0 00000100:00100000:2.0:1789131129.943902:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131129.943947:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd286d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3625:1876039508886912:0@lo:400:kworker.0 00000100:00100000:2.0:1789131129.943973:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131129.943997:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789131129.944002:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8495a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508886272:0@lo:400:kworker.0 00000100:00100000:2.0:1789131129.944201:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131129.944276:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd286c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508887040:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789131129.944333:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131129.944379:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3627:1876039508886400:0@lo:400:kworker.0 00000100:00100000:2.0:1789131129.944408:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131129.944427:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc78912c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1876039508887168:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789131129.944448:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131129.944507:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789131129.944514:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8494780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508886528:0@lo:400:kworker.0 00000100:00100000:2.0:1789131129.944537:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131129.944566:0:17766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508886144 00000100:00100000:2.0:1789131129.944573:0:17766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508886144 00000100:00100000:2.0:1789131129.944637:0:17766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789131129.944648:0:17766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddfce54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+18:3625:x1876039508886144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131129.944701:0:17766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddfce54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+18:3625:x1876039508886144:12345-0@lo:400:kworker.0 Request processed in 56us (798us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131129.944709:0:17766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789131129.944742:0:17772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508886912 00000100:00100000:2.0:1789131129.944746:0:17772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508886912 00000100:00100000:2.0:1789131129.944775:0:17772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508886400 00000100:00100000:2.0:1789131129.944779:0:17772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508886400 00000100:00100000:1.0:1789131129.944813:0:17773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789131129.945081:0:17773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd286e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1876039508886912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789131129.945154:0:17773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd286e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1876039508886912:12345-0@lo:400:kworker.0 Request processed in 330us (1178us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131129.945884:0:17772:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1789131129.945897:0:17772:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1789131129.945986:0:18514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508886272 00000100:00100000:2.0:1789131129.945993:0:18514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508886272 00000100:00100000:2.0:1789131129.946020:0:18514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508887040 00000100:00100000:2.0:1789131129.946023:0:18514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508887040 00000100:00100000:2.0:1789131129.946045:0:18514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508887168 00000100:00100000:2.0:1789131129.946048:0:18514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508887168 00000100:00100000:2.0:1789131129.946059:0:18514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508886528 00000100:00100000:2.0:1789131129.946062:0:18514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508886528 00000100:00100000:2.0:1789131129.946075:0:18514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789131129.946083:0:18514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd286fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:3625:x1876039508886272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131129.946205:0:18514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd286fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:3625:x1876039508886272:12345-0@lo:400:kworker.0 Request processed in 122us (2011us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131129.946214:0:18514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789131129.946232:0:18514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789131129.946239:0:18514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7ffed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3625:x1876039508887040:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789131129.946263:0:18514:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1789131129.946295:0:18514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7ffed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3625:x1876039508887040:12345-0@lo:41:osp-pre-0-1.0 Request processed in 56us (1961us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131129.946301:0:18514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789131129.946312:0:18514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789131129.946318:0:18514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7fff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3627:x1876039508887168:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789131129.946334:0:18514:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789131129.946367:0:18514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7fff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3627:x1876039508887168:12345-0@lo:41:osp-pre-1-0.0 Request processed in 48us (1917us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131129.946373:0:18514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789131129.946385:0:18514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789131129.946403:0:18514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7fff0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508886528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131129.947632:0:18514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7fff0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508886528:12345-0@lo:400:kworker.0 Request processed in 1223us (3087us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131129.947644:0:18514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789131129.947683:0:17771:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1789131129.947696:0:17771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789131129.947705:0:17771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7ffda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1876039508886400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131129.947996:0:17771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7ffda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1876039508886400:12345-0@lo:400:kworker.0 Request processed in 293us (3587us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131129.948004:0:17771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789131129.948086:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8494780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508886528:0@lo:400:kworker.0 00010000:00080000:2.0:1789131129.948101:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91dcc8497480 x1876039508886400/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789131145 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789131129.948122:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3627:1876039508886400:0@lo:400:kworker.0 00000100:00100000:2.0:1789131129.948142:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc78912c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1876039508887168:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789131129.948181:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd286da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3624:1876039508886656:0@lo:8:kworker.0 00000400:00000100:2.0:1789131129.948213:0:3624:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876039508886656 offset 0 length 520: 4 00000100:00100000:2.0:1789131129.948232:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd286e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3624:1876039508886784:0@lo:8:kworker.0 00000400:00000100:2.0:1789131129.948266:0:3624:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876039508886784 offset 0 length 520: 4 00000100:00100000:2.0:1789131129.948301:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8495a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508886272:0@lo:400:kworker.0 00000100:00100000:2.0:1789131129.948314:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd286c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508887040:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789131129.948323:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8496d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:3625:1876039508886144:0@lo:400:kworker.0 00010000:00080000:2.0:1789131129.948347:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91ddd286d2c0 x1876039508886912/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789131145 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789131129.948357:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd286d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3625:1876039508886912:0@lo:400:kworker.0 00000100:00100000:1.0:1789131129.949706:0:17773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1789131130.908161:0:17759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789131130.967646:0:18506:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000040:00080000:2.0:1789131131.923162:0:18526:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789131131.924931:0:17760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789131131.985566:0:3624:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789131116/real 1789131116] req@ffff91dcc8497c00 x1876039508878080/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789131131 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789131131.985596:0:3624:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff91dcc8497c00 x1876039508878080/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789131131 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789131131.985605:0:3624:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789131116/real 1789131116] req@ffff91dcc8494f00 x1876039508878208/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789131131 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789131131.985630:0:3624:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff91dcc8494f00 x1876039508878208/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789131131 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789131131.985650:0:3624:0:(import.c:65:import_set_state_nolock()) ffff91dcc85e4800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789131131.985677:0:3624:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789131131.985681:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8497c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3624:1876039508878080:0@lo:8:kworker.0 00000100:00080000:3.0:1789131131.985695:0:3624:0:(import.c:65:import_set_state_nolock()) ffff91dcc85e2000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789131131.985701:0:3624:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789131131.985704:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8494f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3624:1876039508878208:0@lo:8:kworker.0 00000100:00080000:1.0:1789131131.985941:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789131131.985945:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1789131131.985953:0:8:0:(import.c:65:import_set_state_nolock()) ffff91dcc85e4800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789131131.985958:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 472 00000100:00080000:1.0:1789131131.985963:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1789131131.985969:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff91dcc85e4800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:1.0:1789131131.985989:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91dcc7893480 x1876039508887552/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789131131.986002:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789131131.986005:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789131131.986006:0:8:0:(import.c:65:import_set_state_nolock()) ffff91dcc85e2000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789131131.986009:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 472 00000100:00080000:1.0:1789131131.986011:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1789131131.986014:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff91dcc85e2000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:1.0:1789131131.986035:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91dcc78903c0 x1876039508887680/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789131131.986055:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789131131.986058:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789131131.986061:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789131131.986063:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789131131.986089:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7891e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508887424:0@lo:400:kworker.0 00000100:00100000:1.0:1789131131.986147:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131131.986188:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789131131.986194:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7893c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3625:1876039508887808:0@lo:400:kworker.0 00000100:00100000:1.0:1789131131.986216:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131131.986249:0:18514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508887424 00000100:00100000:1.0:1789131131.986265:0:18514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508887424 00000100:00100000:1.0:1789131131.986308:0:18514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789131131.986316:0:18514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc78930c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1876039508887424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789131131.986363:0:18514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc78930c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1876039508887424:12345-0@lo:400:kworker.0 Request processed in 48us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131131.986371:0:18514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789131131.986392:0:17771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508887808 00000100:00100000:1.0:1789131131.986396:0:17771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508887808 00000100:00100000:1.0:1789131131.986421:0:17771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789131131.986427:0:17771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc78921c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1876039508887808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789131131.986477:0:17771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc78921c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1876039508887808:12345-0@lo:400:kworker.0 Request processed in 29us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131131.986483:0:17771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789131131.986592:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7890780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:3628:1876039508887296:0@lo:400:kworker.0 00000100:00100000:2.0:1789131131.986622:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131131.986642:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7890000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3628:1876039508888064:0@lo:400:kworker.0 00000100:00100000:2.0:1789131131.986663:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131131.986679:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789131131.986696:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7893840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1876039508887936:0@lo:400:kworker.0 00000100:00100000:2.0:1789131131.986717:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131131.986741:0:17772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508888064 00000100:00100000:2.0:1789131131.986745:0:17772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508888064 00000100:00100000:2.0:1789131131.986770:0:17772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789131131.986776:0:17772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7fffc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3628:x1876039508888064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131131.986809:0:17772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7fffc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3628:x1876039508888064:12345-0@lo:400:kworker.0 Request processed in 33us (145us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131131.986815:0:17772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789131131.986833:0:17776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508887936 00000100:00100000:2.0:1789131131.986835:0:17776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508887936 00000100:00100000:2.0:1789131131.986853:0:17776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789131131.986859:0:17776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7ffc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3628:x1876039508887936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131131.986887:0:17776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7ffc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3628:x1876039508887936:12345-0@lo:400:kworker.0 Request processed in 28us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131131.986893:0:17776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789131131.986936:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7893840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1876039508887936:0@lo:400:kworker.0 00010000:00080000:2.0:1789131131.986947:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91dcc7890000 x1876039508888064/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789131147 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789131131.986956:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7890000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3628:1876039508888064:0@lo:400:kworker.0 00010000:00080000:1.0:1789131131.987100:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91dcc7893c00 x1876039508887808/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789131147 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789131131.987111:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7893c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3625:1876039508887808:0@lo:400:kworker.0 00000100:00100000:1.0:1789131131.987120:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7891e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508887424:0@lo:400:kworker.0 00000100:00100000:3.0:1789131131.987283:0:17765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508887296 00000100:00100000:3.0:1789131131.987287:0:17765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508887296 00000100:00100000:3.0:1789131131.987322:0:17765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789131131.987329:0:17765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddfce57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+18:3628:x1876039508887296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789131131.987371:0:17765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddfce57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+18:3628:x1876039508887296:12345-0@lo:400:kworker.0 Request processed in 43us (748us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131131.987377:0:17765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789131131.987407:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7893480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3624:1876039508887552:0@lo:8:kworker.0 00000400:00000100:3.0:1789131131.987430:0:3624:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876039508887552 offset 0 length 520: 4 00000100:00100000:3.0:1789131131.987442:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc78903c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3624:1876039508887680:0@lo:8:kworker.0 00000400:00000100:3.0:1789131131.987486:0:3624:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876039508887680 offset 0 length 520: 4 00000100:00100000:2.0:1789131131.988365:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7890780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:3628:1876039508887296:0@lo:400:kworker.0 00010000:00010000:1.0:1789131132.956830:0:17759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789131133.128840:0:19278:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789131133.128846:0:19278:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:3.0:1789131133.128847:0:19278:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1789131133.129640:0:19278:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff91ddfd258000 00000020:01000004:3.0:1789131133.129663:0:19278:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1789131133.129697:0:19278:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1789131133.129714:0:19278:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff91ddff71b490) 00000020:00000080:3.0:1789131133.129735:0:19278:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1789131133.205072:0:19278:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1789131133.206699:0:19278:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1789131133.207301:0:19278:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1789131133.207794:0:19278:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1789131133.208196:0:19278:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:0.0:1789131133.208413:0:19278:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:0.0:1789131133.209002:0:19278:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:01000000:0.0:1789131133.212639:0:19278:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1789131133.212917:0:19278:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1789131133.212948:0:19278:0:(osd_handler.c:8895:osd_obd_connect()) connect #0 00000020:00000080:0.0:1789131133.212965:0:19278:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xf3fe2838e1fc3575 00000020:01000004:0.0:1789131133.212973:0:19278:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:0.0:1789131133.213003:0:19278:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.111@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1789131133.213007:0:19278:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.111@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1789131133.213027:0:19278:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1789131133.213033:0:19278:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1789131133.213048:0:19278:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff91de01a01a48) 00000020:00000080:0.0:1789131133.213062:0:19278:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:0.0:1789131133.217520:0:19278:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789131133.217781:0:19278:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1789131133.217790:0:19278:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1789131133.221900:0:19278:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1789131133.221916:0:19278:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1789131133.222319:0:19278:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1789131133.222328:0:19278:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1789131133.224187:0:19278:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789131133.224403:0:19278:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1789131133.224410:0:19278:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1789131133.231051:0:19278:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1789131133.231067:0:19278:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1789131133.261096:0:19278:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789131133.261342:0:19278:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1789131133.261348:0:19278:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1789131133.269615:0:19278:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1789131133.269633:0:19278:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1789131133.273064:0:19278:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1789131133.273082:0:19278:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1789131133.285419:0:19278:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789131133.286970:0:19278:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1789131133.286978:0:19278:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1789131133.287947:0:19278:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1789131133.287956:0:19278:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1789131133.345004:0:19278:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789131133.345212:0:19278:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1789131133.345219:0:19278:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1789131133.347094:0:19278:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1789131133.347109:0:19278:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1789131133.347664:0:19278:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1789131133.347694:0:19278:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:0.0:1789131133.347700:0:19278:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.111@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1789131133.373035:0:19278:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.111@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789131133.373089:0:19278:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.111@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1789131133.373094:0:19278:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789131133.373097:0:19278:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789131133.373098:0:19278:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789131133.373100:0:19278:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789131133.373101:0:19278:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789131133.373103:0:19278:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789131133.373104:0:19278:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789131133.373106:0:19278:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789131133.373107:0:19278:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789131133.373112:0:19278:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1789131133.373114:0:19278:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789131133.373115:0:19278:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789131133.373116:0:19278:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789131133.373117:0:19278:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789131133.373118:0:19278:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789131133.373123:0:19278:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789131133.373124:0:19278:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789131133.373125:0:19278:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789131133.373126:0:19278:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789131133.373161:0:19278:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1789131133.373189:0:19278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7ffe580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:19278:1876039508888192:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789131133.373336:0:19278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131133.373488:0:19278:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddcf5c4480 going to sleep for 11 seconds 00000100:00100000:0.0:1789131133.373585:0:17766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508888192 00000100:00100000:0.0:1789131133.373594:0:17766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508888192 00000100:00100000:0.0:1789131133.374033:0:17766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789131133.374046:0:17766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc1ed5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+18:19278:x1876039508888192:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789131133.374091:0:17766:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1789131133.374095:0:17766:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1789131133.374100:0:17766:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1789131133.374631:0:17766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc1ed5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+18:19278:x1876039508888192:12345-0@lo:253:mount.lustre.0 Request processed in 585us (1294us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131133.374642:0:17766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789131133.374787:0:19278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7ffe580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:19278:1876039508888192:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789131133.374801:0:19278:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1789131133.374805:0:19278:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789131133.374807:0:19278:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789131133.374808:0:19278:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789131133.374809:0:19278:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789131133.374811:0:19278:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789131133.374812:0:19278:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789131133.374813:0:19278:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789131133.374815:0:19278:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789131133.374816:0:19278:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789131133.374857:0:19278:0:(tgt_mount.c:101:server_register_mount()) register mount ffff91ddfd258000 from lustre-OST0000 10000000:01000000:2.0:1789131133.374893:0:19278:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1789131133.374896:0:19278:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1789131133.374907:0:19278:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff91ddff71ced8 local copy 00010000:00010000:2.0:1789131133.374920:0:19278:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff91dcc85cb600/0xf3fe2838e1fc3330 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc3337 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131133.375067:0:19278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7ffe580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:19278:1876039508888320:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789131133.375115:0:19278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131133.375147:0:19278:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddcf5c4a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789131133.375284:0:17764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508888320 00000100:00100000:1.0:1789131133.375291:0:17764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508888320 00000100:00100000:1.0:1789131133.375334:0:17764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789131133.375341:0:17764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc1ed4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+18:19278:x1876039508888320:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789131133.375419:0:17764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc1ed4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+18:19278:x1876039508888320:12345-0@lo:501:mount.lustre.0 Request processed in 78us (304us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789131133.375427:0:17764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789131133.375505:0:19278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7ffe580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:19278:1876039508888320:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1789131133.375521:0:19278:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.111@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1789131133.375540:0:19278:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.111@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1789131133.375554:0:19278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff91dcc85cb600/0xf3fe2838e1fc3330 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc3337 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131133.375564:0:19278:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff91dcc85cb600/0xf3fe2838e1fc3330 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc3337 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789131133.375599:0:19278:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff91ddfd258000 10000000:01000000:2.0:1789131133.375605:0:19278:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789131133.375612:0:19278:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1789131133.375615:0:19278:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789131133.375620:0:19278:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1789131133.375623:0:19278:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1789131133.375650:0:19278:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7f200/0xf3fe2838e1fc3583 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131133.375658:0:19278:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7f200/0xf3fe2838e1fc3583 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131133.375669:0:19278:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7f200/0xf3fe2838e1fc3583 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131133.375683:0:19278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7ffe580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:19278:1876039508888448:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789131133.375710:0:19278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131133.375722:0:19278:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddcf5c4a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789131133.375916:0:17765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508888448 00000100:00100000:3.0:1789131133.375921:0:17765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508888448 00000100:00100000:3.0:1789131133.375959:0:17765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789131133.375966:0:17765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc1ed6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+18:19278:x1876039508888448:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789131133.375976:0:17765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789131133.375992:0:17765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91ddfd0b4600/0xf3fe2838e1fc358a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3fe2838e1fc3583 expref: -99 pid: 17765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131133.376180:0:17765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91ddfd0b4600/0xf3fe2838e1fc358a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3fe2838e1fc3583 expref: 19 pid: 17765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131133.376193:0:17765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91ddfd0b4600/0xf3fe2838e1fc358a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc3583 expref: 19 pid: 17765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131133.376204:0:17765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ddfd0b4600, rc 0) 00000100:00100000:3.0:1789131133.376241:0:17765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc1ed6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+19:19278:x1876039508888448:12345-0@lo:101:mount.lustre.0 Request processed in 276us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131133.376249:0:17765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789131133.376445:0:19278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7ffe580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:19278:1876039508888448:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789131133.376498:0:19278:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7f200/0xf3fe2838e1fc3583 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc358a expref: -99 pid: 19278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131133.376509:0:19278:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7f200/0xf3fe2838e1fc3583 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3fe2838e1fc358a expref: -99 pid: 19278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789131133.379419:0:19278:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1789131133.385417:0:19278:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789131133.394332:0:19278:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1789131133.394417:0:19278:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1789131133.394435:0:19278:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1789131133.394449:0:19278:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1789131133.396572:0:19278:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1789131133.397281:0:19278:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1789131133.397333:0:19278:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1789131133.397362:0:19278:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1789131133.397559:0:19278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd1dad2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:19278:1876039508888576:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789131133.397985:0:19278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131133.398124:0:19278:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddc4c14480 going to sleep for 11 seconds 00000100:00100000:0.0:1789131133.399682:0:17765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508888576 00000100:00100000:0.0:1789131133.399700:0:17765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508888576 00000100:00100000:0.0:1789131133.399811:0:17765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789131133.399824:0:17765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc1ed5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+19:19278:x1876039508888576:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789131133.400102:0:17765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc1ed5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+19:19278:x1876039508888576:12345-0@lo:501:mount.lustre.0 Request processed in 279us (2117us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131133.400111:0:17765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789131133.400517:0:19278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd1dad2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:19278:1876039508888576:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789131133.400587:0:19278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd1dad2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:19278:1876039508888704:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789131133.400675:0:19278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131133.402180:0:19278:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddc4c14480 going to sleep for 11 seconds 00000100:00100000:2.0:1789131133.402350:0:17764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508888704 00000100:00100000:2.0:1789131133.402361:0:17764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508888704 00000100:00100000:2.0:1789131133.402423:0:17764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789131133.402434:0:17764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc1ed7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+19:19278:x1876039508888704:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789131133.405194:0:17764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc1ed7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+19:19278:x1876039508888704:12345-0@lo:503:mount.lustre.0 Request processed in 2746us (4504us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131133.405213:0:17764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789131133.405429:0:19278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd1dad2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:19278:1876039508888704:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789131133.406334:0:19278:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789131133.406702:0:19278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd1dad2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:19278:1876039508888832:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789131133.406805:0:19278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131133.406899:0:19278:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddc4c14480 going to sleep for 11 seconds 00000100:00100000:2.0:1789131133.406949:0:17764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508888832 00000100:00100000:2.0:1789131133.406959:0:17764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508888832 00000100:00100000:2.0:1789131133.407104:0:17764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789131133.407115:0:17764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc1ed6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+19:19278:x1876039508888832:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789131133.407899:0:17764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc1ed6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+19:19278:x1876039508888832:12345-0@lo:502:mount.lustre.0 Request processed in 783us (1092us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131133.407910:0:17764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789131133.408004:0:19278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd1dad2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:19278:1876039508888832:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789131133.408416:0:19278:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1789131133.408441:0:19278:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1789131133.408448:0:19278:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1789131133.408716:0:19278:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1789131133.408908:0:19278:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1789131133.408949:0:19278:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1789131133.408964:0:19278:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1789131133.408975:0:19278:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1789131133.408985:0:19278:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:2.0:1789131133.408995:0:19278:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:2.0:1789131133.409005:0:19278:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:2.0:1789131133.409031:0:19278:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:2.0:1789131133.409078:0:19278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7ffe580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:19278:1876039508888960:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789131133.409155:0:19278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131133.409214:0:19278:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddcf5c4a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789131133.409502:0:17766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508888960 00000100:00100000:1.0:1789131133.409519:0:17766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508888960 00000100:00100000:1.0:1789131133.409582:0:17766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789131133.409592:0:17766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc1ed6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+19:19278:x1876039508888960:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789131133.409747:0:17766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc1ed6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+19:19278:x1876039508888960:12345-0@lo:502:mount.lustre.0 Request processed in 155us (590us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131133.409756:0:17766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789131133.410287:0:19278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7ffe580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:19278:1876039508888960:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789131133.410366:0:19278:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:2.0:1789131133.410380:0:19278:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:2.0:1789131133.412029:0:19295:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789131133.412046:0:19295:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:2.0:1789131133.412056:0:19295:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789131133.412060:0:19295:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1789131133.412069:0:19295:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789131133.412093:0:19295:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff91ddfcdf8000) 00000020:00000080:2.0:1789131133.412125:0:19295:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:2.0:1789131133.412131:0:19295:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789131133.412255:0:19295:0:(tgt_mount.c:153:server_get_mount()) get mount ffff91ddfd258000 from lustre-OST0000, refs=2 00080000:01000000:2.0:1789131133.412266:0:19295:0:(osd_handler.c:8895:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789131133.412276:0:19295:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xf3fe2838e1fc3598 00010000:00010000:3.0:1789131133.417339:0:19295:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:3.0:1789131133.418289:0:19295:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967311 00080000:10000000:3.0:1789131133.425396:0:19295:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:1.0:1789131133.434392:0:19295:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1789131133.434416:0:19295:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789131133.434427:0:19295:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789131133.434430:0:19295:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1789131133.434436:0:19295:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789131133.434439:0:19295:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:1.0:1789131133.434441:0:19295:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789131133.434442:0:19295:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789131133.434444:0:19295:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789131133.434446:0:19295:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789131133.434448:0:19295:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789131133.434450:0:19295:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789131133.434453:0:19295:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789131133.434455:0:19295:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789131133.434775:0:19295:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789131133.434778:0:19295:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789131133.434781:0:19295:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789131133.434784:0:19295:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789131133.434785:0:19295:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:1.0:1789131133.434788:0:19295:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789131133.434791:0:19295:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789131133.434792:0:19295:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789131133.434795:0:19295:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1789131133.434831:0:19295:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789131133.434835:0:19295:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789131133.434836:0:19295:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789131133.434839:0:19295:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:2.0:1789131133.436778:0:19278:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:2.0:1789131133.436839:0:19278:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1789131133.436868:0:19278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7f200/0xf3fe2838e1fc3583 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc358a expref: -99 pid: 19278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131133.436883:0:19278:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7f200/0xf3fe2838e1fc3583 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc358a expref: -99 pid: 19278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789131133.436892:0:19278:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91ddfd258000 from 1 10000000:01000000:2.0:1789131133.436895:0:19278:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789131133.436949:0:19278:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7f600/0xf3fe2838e1fc359f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131133.436959:0:19278:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7f600/0xf3fe2838e1fc359f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131133.436981:0:19278:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7f600/0xf3fe2838e1fc359f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131133.437022:0:19278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7ffe580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:19278:1876039508889088:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789131133.437121:0:19278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131133.437176:0:19278:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddcf5c4000 going to sleep for 11 seconds 00000100:00100000:3.0:1789131133.437409:0:17764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508889088 00000100:00100000:3.0:1789131133.437419:0:17764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508889088 00000100:00100000:3.0:1789131133.437500:0:17764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789131133.437513:0:17764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc1ed4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+19:19278:x1876039508889088:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789131133.437532:0:17764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789131133.437549:0:17764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91ddfd0b5c00/0xf3fe2838e1fc35a6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3fe2838e1fc359f expref: -99 pid: 17764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131133.437589:0:17764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91ddfd0b5c00/0xf3fe2838e1fc35a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3fe2838e1fc359f expref: 20 pid: 17764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131133.437601:0:17764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91ddfd0b5c00/0xf3fe2838e1fc35a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc359f expref: 20 pid: 17764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131133.437613:0:17764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ddfd0b5c00, rc 0) 00000100:00100000:3.0:1789131133.437664:0:17764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc1ed4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+20:19278:x1876039508889088:12345-0@lo:101:mount.lustre.0 Request processed in 155us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131133.437672:0:17764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789131133.439440:0:19278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7ffe580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:19278:1876039508889088:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789131133.439492:0:19278:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7f600/0xf3fe2838e1fc359f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc35a6 expref: -99 pid: 19278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131133.439507:0:19278:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7f600/0xf3fe2838e1fc359f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3fe2838e1fc35a6 expref: -99 pid: 19278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789131133.444146:0:19278:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1789131133.444646:0:19278:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789131133.444882:0:19278:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1789131133.444910:0:19278:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1789131133.444929:0:19278:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1789131133.444935:0:19278:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1789131133.445095:0:19278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7ffe580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:19278:1876039508889216:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789131133.445266:0:19278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131133.445365:0:19278:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddcf5c4a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789131133.445430:0:17766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508889216 00000100:00100000:1.0:1789131133.445439:0:17766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508889216 00000100:00100000:1.0:1789131133.445790:0:17766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789131133.445802:0:17766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc1ed4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+20:19278:x1876039508889216:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789131133.445955:0:17766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc1ed4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+20:19278:x1876039508889216:12345-0@lo:501:mount.lustre.0 Request processed in 154us (689us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131133.445964:0:17766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789131133.446069:0:19278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7ffe580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:19278:1876039508889216:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789131133.446114:0:19278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7ffe580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:19278:1876039508889344:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789131133.446172:0:19278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131133.446207:0:19278:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddcf5c4a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789131133.446311:0:17766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508889344 00000100:00100000:1.0:1789131133.446317:0:17766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508889344 00000100:00100000:1.0:1789131133.446350:0:17766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789131133.446357:0:17766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc1ed5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+20:19278:x1876039508889344:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789131133.446475:0:17766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc1ed5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+20:19278:x1876039508889344:12345-0@lo:503:mount.lustre.0 Request processed in 100us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131133.446484:0:17766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789131133.446488:0:19278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7ffe580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:19278:1876039508889344:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789131133.446895:0:19278:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789131133.446961:0:19278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7ffe580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:19278:1876039508889472:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789131133.446992:0:19278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131133.447035:0:19278:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddc32933c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789131133.447068:0:17765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508889472 00000100:00100000:0.0:1789131133.447077:0:17765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508889472 00000100:00100000:0.0:1789131133.447113:0:17765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789131133.447121:0:17765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc1ed7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+20:19278:x1876039508889472:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789131133.447216:0:17765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc1ed7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+20:19278:x1876039508889472:12345-0@lo:502:mount.lustre.0 Request processed in 96us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131133.447308:0:19278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7ffe580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:19278:1876039508889472:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789131133.447446:0:17765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000040:00080000:2.0:1789131133.447524:0:19278:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1789131133.447552:0:19278:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1789131133.447566:0:19278:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1789131133.447574:0:19278:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1789131133.447581:0:19278:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1789131133.447587:0:19278:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1789131133.447610:0:19278:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1789131133.447618:0:19278:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 144 off9680 00000040:00080000:2.0:1789131133.447625:0:19278:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9904 00000040:00080000:2.0:1789131133.447631:0:19278:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10128 00000040:00080000:2.0:1789131133.447638:0:19278:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 144 off10272 00000040:00080000:2.0:1789131133.447645:0:19278:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10496 00000040:00080000:2.0:1789131133.447651:0:19278:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10720 00000040:00080000:2.0:1789131133.447658:0:19278:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 128 off10848 00000040:00080000:2.0:1789131133.447664:0:19278:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off11072 00000040:00080000:2.0:1789131133.447671:0:19278:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11296 00000040:00080000:2.0:1789131133.447678:0:19278:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 128 off11424 00000100:00100000:2.0:1789131133.447693:0:19278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7ffe580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:19278:1876039508889600:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789131133.447721:0:19278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131133.447738:0:19278:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddcf5c4000 going to sleep for 11 seconds 00000100:00100000:1.0:1789131133.447764:0:17766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508889600 00000100:00100000:1.0:1789131133.447810:0:17766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508889600 00000100:00100000:1.0:1789131133.447874:0:17766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789131133.447882:0:17766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc1ed4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+20:19278:x1876039508889600:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789131133.447963:0:17766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc1ed4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+20:19278:x1876039508889600:12345-0@lo:502:mount.lustre.0 Request processed in 82us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131133.447968:0:17766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789131133.448030:0:19278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7ffe580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:19278:1876039508889600:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789131133.448074:0:19278:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11648 00000040:00080000:2.0:1789131133.448089:0:19278:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 18 count 19 00000020:01000000:2.0:1789131133.449416:0:19299:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789131133.449433:0:19299:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789131133.449436:0:19299:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789131133.449446:0:19299:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff91ddfd258000 00000020:00000080:2.0:1789131133.449449:0:19299:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789131133.449541:0:19299:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789131133.449546:0:19299:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789131133.449547:0:19299:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1789131133.449549:0:19299:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789131133.449552:0:19299:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789131133.449553:0:19299:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789131133.449556:0:19299:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff91ddfd258000 00000020:00000080:2.0:1789131133.449558:0:19299:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789131133.449661:0:19299:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789131133.449666:0:19299:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789131133.449667:0:19299:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1789131133.449670:0:19299:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789131133.449672:0:19299:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789131133.449673:0:19299:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:2.0:1789131133.449677:0:19299:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff91ddfd258000 00000020:00000080:2.0:1789131133.449680:0:19299:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789131133.449699:0:19299:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789131133.449702:0:19299:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789131133.449703:0:19299:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:2.0:1789131133.449706:0:19299:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789131133.449708:0:19299:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789131133.449709:0:19299:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre lod.lustre-MDT0001-mdtlov.enable_compr_rotational 00000020:01000000:2.0:1789131133.449712:0:19299:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff91ddfd258000 00000020:00000080:2.0:1789131133.449714:0:19299:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789131133.449743:0:19299:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789131133.449747:0:19299:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789131133.449748:0:19299:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre lod.lustre-MDT0001-mdtlov.enable_compr_rotational 00000020:01000000:2.0:1789131133.449933:0:19299:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789131133.449937:0:19299:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789131133.449938:0:19299:0:(obd_config.c:1563:class_process_config()) marker 6 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789131133.449942:0:19299:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff91ddfd258000 00000020:00000080:2.0:1789131133.449944:0:19299:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789131133.449964:0:19299:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789131133.449968:0:19299:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789131133.449969:0:19299:0:(obd_config.c:1563:class_process_config()) marker 6 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789131133.449972:0:19299:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789131133.449974:0:19299:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789131133.449975:0:19299:0:(obd_config.c:1563:class_process_config()) marker 7 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1789131133.449978:0:19299:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff91ddfd258000 00000020:00000080:2.0:1789131133.449980:0:19299:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789131133.450004:0:19299:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789131133.450007:0:19299:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789131133.450019:0:19299:0:(obd_config.c:1563:class_process_config()) marker 7 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1789131133.450022:0:19299:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 19 count 19 00000020:01000000:0.0:1789131133.450397:0:19278:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-18 (rc=0) 10000000:01000000:0.0:1789131133.450436:0:19278:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789131133.450492:0:19278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7f600/0xf3fe2838e1fc359f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc35a6 expref: -99 pid: 19278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131133.450507:0:19278:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7f600/0xf3fe2838e1fc359f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc35a6 expref: -99 pid: 19278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789131133.450573:0:19278:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789131133.450577:0:19278:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff91ddfd258000 10000000:01000000:0.0:1789131133.450580:0:19278:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff91ddfd258000 10000000:01000000:0.0:1789131133.450584:0:19278:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789131133.450592:0:19278:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff91ddfd258000 from 1 10000000:01000000:0.0:1789131133.450594:0:19278:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789131133.450639:0:19278:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff91de01ad7800/0xf3fe2838e1fc35ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131133.450648:0:19278:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff91de01ad7800/0xf3fe2838e1fc35ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131133.450661:0:19278:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff91de01ad7800/0xf3fe2838e1fc35ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131133.450691:0:19278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8608b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:19278:1876039508889728:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789131133.451271:0:19278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131133.451382:0:19278:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddc4ccf180 going to sleep for 11 seconds 00000100:00100000:2.0:1789131133.451448:0:17765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508889728 00000100:00100000:2.0:1789131133.451530:0:17765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508889728 00000100:00100000:2.0:1789131133.451632:0:17765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789131133.451643:0:17765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddfbfe3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+20:19278:x1876039508889728:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789131133.451660:0:17765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789131133.451677:0:17765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91dcc7f7fc00/0xf3fe2838e1fc35b4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3fe2838e1fc35ad expref: -99 pid: 17765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131133.451707:0:17765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91dcc7f7fc00/0xf3fe2838e1fc35b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3fe2838e1fc35ad expref: 21 pid: 17765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131133.451731:0:17765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91dcc7f7fc00/0xf3fe2838e1fc35b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc35ad expref: 21 pid: 17765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131133.451742:0:17765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dcc7f7fc00, rc 0) 00000100:00100000:2.0:1789131133.451999:0:17765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddfbfe3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+21:19278:x1876039508889728:12345-0@lo:101:mount.lustre.0 Request processed in 358us (730us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131133.452017:0:17765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789131133.452251:0:19278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8608b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:19278:1876039508889728:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789131133.452270:0:19278:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff91de01ad7800/0xf3fe2838e1fc35ad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc35b4 expref: -99 pid: 19278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131133.452280:0:19278:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff91de01ad7800/0xf3fe2838e1fc35ad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3fe2838e1fc35b4 expref: -99 pid: 19278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789131133.457780:0:19278:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:1.0:1789131133.458210:0:19278:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789131133.459115:0:19278:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1789131133.459149:0:19278:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1789131133.459165:0:19278:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1789131133.459179:0:19278:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1789131133.459193:0:19278:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1789131133.459206:0:19278:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1789131133.459219:0:19278:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1789131133.460385:0:19278:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1789131133.460406:0:19278:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1789131133.460420:0:19278:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1789131133.460434:0:19278:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1789131133.460449:0:19278:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1789131133.460477:0:19278:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1789131133.460494:0:19278:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1789131133.460508:0:19278:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1789131133.460523:0:19278:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1789131133.460538:0:19278:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1789131133.462763:0:19278:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1789131133.462839:0:19278:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1789131133.462858:0:19278:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1789131133.462895:0:19278:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1789131133.462912:0:19278:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1789131133.462924:0:19278:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1789131133.462937:0:19278:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1789131133.462949:0:19278:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:1.0:1789131133.462962:0:19278:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:1.0:1789131133.462976:0:19278:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:1.0:1789131133.462989:0:19278:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:1.0:1789131133.463001:0:19278:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:1.0:1789131133.463041:0:19278:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:1.0:1789131133.463056:0:19278:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:1.0:1789131133.463069:0:19278:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:1.0:1789131133.463081:0:19278:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:1.0:1789131133.463094:0:19278:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:1.0:1789131133.463107:0:19278:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:1.0:1789131133.463122:0:19278:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:1.0:1789131133.463149:0:19278:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:1.0:1789131133.463180:0:19278:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:1.0:1789131133.463185:0:19278:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:1.0:1789131133.464019:0:19278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7893c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:19278:1876039508889856:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789131133.464117:0:19278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131133.464174:0:19278:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddd804f300 going to sleep for 11 seconds 00000100:00100000:0.0:1789131133.464817:0:17766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508889856 00000100:00100000:0.0:1789131133.464828:0:17766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508889856 00000100:00100000:0.0:1789131133.464947:0:17766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789131133.464958:0:17766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddfbfe2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+21:19278:x1876039508889856:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789131133.465161:0:17766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddfbfe2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+21:19278:x1876039508889856:12345-0@lo:501:mount.lustre.0 Request processed in 204us (1044us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131133.465171:0:17766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789131133.465454:0:19278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7893c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:19278:1876039508889856:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789131133.465700:0:19278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7893c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:19278:1876039508889984:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789131133.465761:0:19278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131133.465794:0:19278:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddd804f300 going to sleep for 11 seconds 00000100:00100000:0.0:1789131133.465977:0:17766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508889984 00000100:00100000:0.0:1789131133.465982:0:17766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508889984 00000100:00100000:0.0:1789131133.466026:0:17766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789131133.466034:0:17766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddfbfe0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+21:19278:x1876039508889984:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789131133.466153:0:17766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddfbfe0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+21:19278:x1876039508889984:12345-0@lo:503:mount.lustre.0 Request processed in 118us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131133.466161:0:17766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789131133.466515:0:19278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7893c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:19278:1876039508889984:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789131133.467241:0:19278:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789131133.467342:0:19278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7ffe580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:19278:1876039508890112:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789131133.467414:0:19278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131133.467454:0:19278:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddcf5c4000 going to sleep for 11 seconds 00000100:00100000:1.0:1789131133.468412:0:17765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508890112 00000100:00100000:1.0:1789131133.468424:0:17765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508890112 00000100:00100000:1.0:1789131133.468509:0:17765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789131133.468520:0:17765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddfbfe3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+21:19278:x1876039508890112:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789131133.468708:0:17765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddfbfe3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+21:19278:x1876039508890112:12345-0@lo:502:mount.lustre.0 Request processed in 190us (1292us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131133.468717:0:17765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789131133.468933:0:19278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7ffe580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:19278:1876039508890112:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789131133.469197:0:19278:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1789131133.469233:0:19278:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1789131133.469250:0:19278:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1789131133.469263:0:19278:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1789131133.469275:0:19278:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1789131133.469286:0:19278:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1789131133.469299:0:19278:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1789131133.469312:0:19278:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1789131133.469326:0:19278:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1789131133.469360:0:19278:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1789131133.469377:0:19278:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1789131133.469390:0:19278:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1789131133.469405:0:19278:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1789131133.469416:0:19278:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1789131133.469429:0:19278:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1789131133.469440:0:19278:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1789131133.469451:0:19278:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1789131133.469490:0:19278:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1789131133.469503:0:19278:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1789131133.469514:0:19278:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1789131133.469536:0:19278:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1789131133.469547:0:19278:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1789131133.469560:0:19278:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1789131133.469574:0:19278:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1789131133.469586:0:19278:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:2.0:1789131133.469610:0:19278:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:2.0:1789131133.469622:0:19278:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:2.0:1789131133.469633:0:19278:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:2.0:1789131133.469643:0:19278:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:2.0:1789131133.469654:0:19278:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:2.0:1789131133.469666:0:19278:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:2.0:1789131133.469677:0:19278:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:2.0:1789131133.469690:0:19278:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:2.0:1789131133.469704:0:19278:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:2.0:1789131133.469717:0:19278:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:2.0:1789131133.469728:0:19278:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:2.0:1789131133.469741:0:19278:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:2.0:1789131133.469755:0:19278:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:2.0:1789131133.469785:0:19278:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:2.0:1789131133.469801:0:19278:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:2.0:1789131133.471343:0:19278:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:2.0:1789131133.471417:0:19278:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:2.0:1789131133.471435:0:19278:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:2.0:1789131133.471449:0:19278:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:2.0:1789131133.471477:0:19278:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:2.0:1789131133.471492:0:19278:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:2.0:1789131133.471505:0:19278:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:2.0:1789131133.471518:0:19278:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:2.0:1789131133.471591:0:19278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7ffe580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:19278:1876039508890240:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789131133.471693:0:19278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131133.472915:0:19278:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddcf5c4000 going to sleep for 11 seconds 00000100:00100000:3.0:1789131133.474748:0:17764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508890240 00000100:00100000:3.0:1789131133.474779:0:17764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508890240 00000100:00100000:0.0:1789131133.479627:0:17764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789131133.479646:0:17764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddfbfe3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+21:19278:x1876039508890240:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789131133.479894:0:17764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddfbfe3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+21:19278:x1876039508890240:12345-0@lo:502:mount.lustre.0 Request processed in 252us (8200us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131133.479903:0:17764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789131133.483428:0:19278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7ffe580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:19278:1876039508890240:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789131133.483741:0:19278:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:2.0:1789131133.484004:0:19278:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:2.0:1789131133.484067:0:19278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7ffe580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:19278:1876039508890368:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789131133.484167:0:19278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131133.484222:0:19278:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddcf5c4000 going to sleep for 11 seconds 00000100:00100000:1.0:1789131133.484870:0:17765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508890368 00000100:00100000:1.0:1789131133.484880:0:17765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508890368 00000100:00100000:1.0:1789131133.484950:0:17765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789131133.484962:0:17765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddfbfe1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+21:19278:x1876039508890368:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789131133.485143:0:17765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddfbfe1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+21:19278:x1876039508890368:12345-0@lo:502:mount.lustre.0 Request processed in 182us (975us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131133.485153:0:17765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789131133.485280:0:19278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7ffe580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:19278:1876039508890368:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789131133.485355:0:19278:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:3.0:1789131133.485368:0:19278:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1789131133.487107:0:19304:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1789131133.487141:0:19304:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff91dcc7d01a48) 00000020:00000080:1.0:1789131133.487180:0:19304:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:1.0:1789131133.487302:0:19304:0:(tgt_mount.c:153:server_get_mount()) get mount ffff91ddfd258000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1789131133.487307:0:19304:0:(tgt_mount.c:187:server_put_mount()) put mount ffff91ddfd258000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1789131133.487311:0:19304:0:(obd_mount.c:710:lustre_put_lsi()) put ffff91ddfd258000 3 00010000:00080000:1.0:1789131133.487368:0:19304:0:(ldlm_lib.c:102:import_set_conn()) imp ffff91ddc5748000@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.111@tcp at head 00010000:00010000:1.0:1789131133.492742:0:19304:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:2.0:1789131133.496196:0:19304:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1789131133.496268:0:19304:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789131133.496287:0:19304:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xf3fe2838e1fc35c2 00000100:00080000:2.0:1789131133.496301:0:19304:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789131133.496309:0:19304:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff91ddc5748000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:2.0:1789131133.496356:0:19304:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91dcc7ffcb40 x1876039508890496/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789131133.496392:0:19304:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1789131133.496450:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789131133.496455:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789131133.496475:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789131133.496479:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789131133.496504:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789131133.496507:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789131133.496511:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789131133.496514:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789131133.496552:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7ffe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3628:1876039508891008:0@lo:400:kworker.0 00000100:00100000:2.0:1789131133.496643:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131133.496692:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789131133.496698:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7ffe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1876039508890880:0@lo:400:kworker.0 00000100:00100000:2.0:1789131133.496731:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131133.497982:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7ffcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3624:1876039508890496:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789131133.498060:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131133.498145:0:19096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508891008 00000100:00100000:3.0:1789131133.498153:0:19096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508891008 00000100:00100000:3.0:1789131133.498204:0:19096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508890496 00000100:00100000:3.0:1789131133.498207:0:19096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508890496 00000100:00100000:3.0:1789131133.498231:0:19096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789131133.498241:0:19096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7ffd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3628:x1876039508891008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789131133.498306:0:19096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7ffd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3628:x1876039508891008:12345-0@lo:400:kworker.0 Request processed in 66us (1663us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131133.498315:0:19096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789131133.498347:0:19096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789131133.498351:0:19096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd1dae940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3624:x1876039508890496:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1789131133.498392:0:19096:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 489 last 0 00000020:00000080:3.0:1789131133.498444:0:19096:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xf3fe2838e1fc35c9 00000004:00100000:3.0:1789131133.498487:0:19096:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789131133.498532:0:19096:0:(import.c:65:import_set_state_nolock()) ffff91dcc7880000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789131133.498573:0:19096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd1dae940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1876039508890496:12345-0@lo:38:llog_process_th.0 Request processed in 220us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131133.498580:0:19096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1789131133.498618:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91dcc7ffcb40 x1876039508890496/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789131143 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789131133.498630:0:3624:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789131133.498639:0:3624:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:3.0:1789131133.498649:0:3624:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789131133.498654:0:3624:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789131133.498657:0:3624:0:(import.c:65:import_set_state_nolock()) ffff91ddc5748000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789131133.498663:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7ffcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3624:1876039508890496:0@lo:38:llog_process_th.0 00010000:00080000:3.0:1789131133.498706:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91dcc7ffe940 x1876039508891008/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789131149 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789131133.498716:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7ffe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3628:1876039508891008:0@lo:400:kworker.0 00000100:00100000:1.0:1789131133.500857:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7ffc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508890624:0@lo:400:kworker.0 00000100:00100000:2.0:1789131133.500952:0:17776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508890880 00000100:00100000:1.0:1789131133.500955:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131133.500975:0:17776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508890880 00000100:00100000:1.0:1789131133.501004:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789131133.501025:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7fff840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3625:1876039508890752:0@lo:400:kworker.0 00000100:00100000:2.0:1789131133.501039:0:17776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508890624 00000100:00100000:2.0:1789131133.501044:0:17776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508890624 00000100:00100000:1.0:1789131133.501061:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131133.501068:0:17776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789131133.501080:0:17776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7ffde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3628:x1876039508890880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789131133.501134:0:17771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508890752 00000100:00100000:1.0:1789131133.501140:0:17771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508890752 00000100:00100000:2.0:1789131133.501159:0:17776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7ffde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3628:x1876039508890880:12345-0@lo:400:kworker.0 Request processed in 82us (4425us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131133.501169:0:17776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789131133.501196:0:17776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789131133.501196:0:17771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789131133.501212:0:17771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7891a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1876039508890752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131133.501213:0:17776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7890f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1876039508890624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789131133.501262:0:17771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7891a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1876039508890752:12345-0@lo:400:kworker.0 Request processed in 54us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131133.501273:0:17776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7890f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1876039508890624:12345-0@lo:400:kworker.0 Request processed in 64us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131133.501273:0:17771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789131133.501282:0:17776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789131133.501326:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7ffe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1876039508890880:0@lo:400:kworker.0 00010000:00080000:1.0:1789131133.501673:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91dcc7fff840 x1876039508890752/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789131149 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789131133.501686:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7fff840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3625:1876039508890752:0@lo:400:kworker.0 00000100:00100000:1.0:1789131133.501708:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7ffc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508890624:0@lo:400:kworker.0 00000020:01000004:3.0:1789131133.504691:0:19304:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1789131133.504716:0:19304:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff91ddff718000) 00000020:00000080:3.0:1789131133.504750:0:19304:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:3.0:1789131133.504979:0:19304:0:(tgt_mount.c:153:server_get_mount()) get mount ffff91ddfd258000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789131133.504985:0:19304:0:(tgt_mount.c:187:server_put_mount()) put mount ffff91ddfd258000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789131133.504993:0:19304:0:(obd_mount.c:710:lustre_put_lsi()) put ffff91ddfd258000 3 00010000:00080000:3.0:1789131133.505048:0:19304:0:(ldlm_lib.c:102:import_set_conn()) imp ffff91dcc8d0c800@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.111@tcp at head 00010000:00010000:3.0:1789131133.513986:0:19304:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:3.0:1789131133.514381:0:19304:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:3.0:1789131133.514446:0:19304:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789131133.514487:0:19304:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xf3fe2838e1fc35d7 00000100:00080000:3.0:1789131133.514502:0:19304:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789131133.514511:0:19304:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff91dcc8d0c800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:3.0:1789131133.514557:0:19304:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91ddd1dacb40 x1876039508891136/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789131133.514603:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd1dacb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3624:1876039508891136:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789131133.514699:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131133.514741:0:17771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508891136 00000100:00100000:1.0:1789131133.514750:0:17771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508891136 00000100:00080000:3.0:1789131133.514796:0:19304:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:1.0:1789131133.514798:0:17771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789131133.514810:0:17771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd1dacf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3624:x1876039508891136:12345-0@lo:38:llog_process_th.0 00000100:00080000:3.0:1789131133.514834:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789131133.514841:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00080000:1.0:1789131133.514845:0:17771:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 489 last 0 00000100:00080000:3.0:1789131133.514846:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789131133.514854:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789131133.514858:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789131133.514861:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789131133.514864:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789131133.514867:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:00000080:1.0:1789131133.514888:0:17771:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xf3fe2838e1fc35de 00000004:00100000:1.0:1789131133.514909:0:17771:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789131133.514947:0:17771:0:(import.c:65:import_set_state_nolock()) ffff91ddc574b000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789131133.523211:0:17771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd1dacf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1876039508891136:12345-0@lo:38:llog_process_th.0 Request processed in 8387us (8497us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131133.523231:0:17771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1789131133.523370:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91ddd1dacb40 x1876039508891136/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789131143 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789131133.523385:0:3624:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789131133.523399:0:3624:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 2 00000100:00080000:1.0:1789131133.523410:0:3624:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1789131133.523417:0:3624:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1789131133.523422:0:3624:0:(import.c:65:import_set_state_nolock()) ffff91dcc8d0c800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789131133.523432:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd1dacb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3624:1876039508891136:0@lo:38:llog_process_th.0 00000040:00080000:1.0:1789131133.525130:0:19304:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:1.0:1789131133.526021:0:19278:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1789131133.526067:0:19278:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789131133.526091:0:19278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff91de01ad7800/0xf3fe2838e1fc35ad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc35b4 expref: -99 pid: 19278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131133.526123:0:19278:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff91de01ad7800/0xf3fe2838e1fc35ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc35b4 expref: -99 pid: 19278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789131133.526199:0:19278:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789131133.526202:0:19278:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789131133.526204:0:19278:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789131133.526205:0:19278:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789131133.526207:0:19278:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789131133.526209:0:19278:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789131133.526211:0:19278:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789131133.526214:0:19278:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789131133.526216:0:19278:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789131133.526221:0:19278:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1789131133.526223:0:19278:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789131133.526225:0:19278:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789131133.526227:0:19278:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789131133.526229:0:19278:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789131133.526230:0:19278:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789131133.526231:0:19278:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789131133.526232:0:19278:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789131133.526234:0:19278:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789131133.526236:0:19278:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789131133.526273:0:19278:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1789131133.532869:0:19278:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7892d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:19278:1876039508891264:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789131133.532986:0:19278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131133.533076:0:19278:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddd1203f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789131133.533107:0:17766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508891264 00000100:00100000:1.0:1789131133.533117:0:17766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508891264 00000100:00100000:1.0:1789131133.533187:0:17766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789131133.533199:0:17766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddfbfe2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+21:19278:x1876039508891264:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789131133.533242:0:17766:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1789131133.533261:0:17766:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1789131133.544746:0:17766:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789131133.544768:0:17766:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1789131133.545058:0:17787:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1789131133.545069:0:17787:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1789131133.545098:0:17787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91dcc85caa00/0xf3fe2838e1fc35e5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131133.545187:0:17787:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91ddfd0b4200/0xf3fe2838e1fc352f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc3528 expref: 21 pid: 17764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131133.545312:0:17787:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91dcc85cbc00/0xf3fe2838e1fc353d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc3536 expref: 21 pid: 17766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131133.545322:0:17787:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91dcc85caa00/0xf3fe2838e1fc35e5 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131133.545377:0:17787:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91dcc85cbc00/0xf3fe2838e1fc353d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf3fe2838e1fc3536 expref: 21 pid: 17766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131133.545396:0:17787:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91dcc85cbc00/0xf3fe2838e1fc353d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf3fe2838e1fc3536 expref: 21 pid: 17766 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131133.545415:0:17787:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7893c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17787:1876039508891392:0@lo:104: 00000100:00100000:0.0:1789131133.545643:0:17787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789131133.545794:0:17787:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91ddfd0b4200/0xf3fe2838e1fc352f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf3fe2838e1fc3528 expref: 21 pid: 17764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131133.545804:0:17787:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91ddfd0b4200/0xf3fe2838e1fc352f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf3fe2838e1fc3528 expref: 21 pid: 17764 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131133.545814:0:17787:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8609680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17787:1876039508891520:0@lo:104: 00000100:00100000:0.0:1789131133.545847:0:17787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131133.545877:0:17787:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddff8bee40 going to sleep for 11 seconds 00000100:00100000:3.0:1789131133.545951:0:17755:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789131133.545983:0:17755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508891392 00000100:00100000:3.0:1789131133.546001:0:17755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508891392 00000100:00100000:3.0:1789131133.546050:0:17755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508891520 00000100:00100000:3.0:1789131133.546054:0:17755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508891520 00000100:00100000:3.0:1789131133.546068:0:17755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789131133.546075:0:17755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc860b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+4:17787:x1876039508891392:12345-0@lo:104: 00010000:00010000:3.0:1789131133.546092:0:17755:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff91ddfd0b4400/0xf3fe2838e1fc3536 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3fe2838e1fc353d expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131133.546203:0:17755:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789131133.546211:0:17755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc860b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+4:17787:x1876039508891392:12345-0@lo:104: Request processed in 135us (570us total) trans 0 rc 0/0 00010000:00010000:0.0:1789131133.546216:0:17760:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1789131133.546223:0:17755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:0.0:1789131133.546227:0:17760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff91ddfd0b4400/0xf3fe2838e1fc3536 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3fe2838e1fc353d expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131133.546238:0:17760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddfd0b4400 already unused, calling callback (ffffffffc124bc20) 10000000:00010000:0.0:1789131133.546243:0:17760:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff91ddfd0b4400/0xf3fe2838e1fc3536 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf3fe2838e1fc353d expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131133.546249:0:17755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789131133.546263:0:17755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddfce54450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+3:17787:x1876039508891520:12345-0@lo:104: 00010000:00010000:0.0:1789131133.546265:0:17760:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff91ddfd0b4400/0xf3fe2838e1fc3536 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf3fe2838e1fc353d expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131133.546273:0:17755:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff91ddfd0b4800/0xf3fe2838e1fc3528 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3fe2838e1fc352f expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131133.546359:0:17755:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789131133.546366:0:17755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddfce54450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+3:17787:x1876039508891520:12345-0@lo:104: Request processed in 106us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131133.546372:0:17755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1789131133.546414:0:17759:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:00010000:0.0:1789131133.546446:0:17760:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff91ddfd0b4400/0xf3fe2838e1fc3536 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf3fe2838e1fc353d expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789131133.546623:0:17760:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789131133.546670:0:17760:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff91ddfd0b4400/0xf3fe2838e1fc3536 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc353d expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131133.546678:0:17760:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789131133.546784:0:17760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff91ddfd0b4400/0xf3fe2838e1fc3536 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc353d expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131133.546792:0:17760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff91ddfd0b4400/0xf3fe2838e1fc3536 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc353d expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131133.546805:0:17760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789131133.546807:0:17760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789131133.546809:0:17760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789131133.546837:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8609e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:3625:1876039508891648:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789131133.546887:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131133.546983:0:17756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508891648 00000100:00100000:0.0:1789131133.546991:0:17756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508891648 00000100:00100000:2.0:1789131133.547005:0:17766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddfbfe2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+22:19278:x1876039508891264:12345-0@lo:253:mount.lustre.0 Request processed in 13805us (14017us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131133.547032:0:17766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00010000:00010000:0.0:1789131133.547038:0:17756:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91dcc85cbc00/0xf3fe2838e1fc353d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3fe2838e1fc3536 expref: 22 pid: 17766 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131133.547080:0:17756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789131133.547092:0:17756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc860a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+21:3625:x1876039508891648:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789131133.547108:0:17756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789131133.547114:0:17756:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91dcc85cbc00/0xf3fe2838e1fc353d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3fe2838e1fc3536 expref: 21 pid: 17766 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131133.547127:0:19278:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7892d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:19278:1876039508891264:0@lo:253:mount.lustre.0 00010000:00010000:0.0:1789131133.547128:0:17756:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91dcc85cbc00/0xf3fe2838e1fc353d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf3fe2838e1fc3536 expref: 21 pid: 17766 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789131133.547147:0:19278:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1789131133.547153:0:19278:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00010000:00010000:0.0:1789131133.547154:0:17756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000020:01000004:2.0:1789131133.547156:0:19278:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789131133.547159:0:19278:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789131133.547160:0:19278:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789131133.547170:0:19278:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789131133.547172:0:19278:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789131133.547174:0:19278:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789131133.547177:0:19278:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789131133.547179:0:19278:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:0.0:1789131133.547193:0:17756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc860a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+21:3625:x1876039508891648:12345-0@lo:103:ldlm_bl.0 Request processed in 104us (305us total) trans 0 rc 0/0 00000020:02000000:2.0:1789131133.547202:0:19278:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1789131133.547203:0:17756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789131133.547239:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8609e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:3625:1876039508891648:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789131133.547269:0:17787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91dcc85cbc00/0xf3fe2838e1fc353d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf3fe2838e1fc3536 expref: 20 pid: 17766 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131133.547954:0:17787:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7893c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17787:1876039508891392:0@lo:104: 00000100:00100000:0.0:1789131133.547978:0:17787:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8609680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17787:1876039508891520:0@lo:104: 00010000:00010000:0.0:1789131133.548000:0:17787:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91dcc85caa00/0xf3fe2838e1fc35e5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131133.548327:0:19311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789131133.548333:0:19311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789131133.548335:0:19311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131133.549507:0:17759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff91ddfd0b4800/0xf3fe2838e1fc3528 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3fe2838e1fc352f expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131133.549530:0:17759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddfd0b4800 already unused, calling callback (ffffffffc124bc20) 10000000:00010000:2.0:1789131133.549536:0:17759:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff91ddfd0b4800/0xf3fe2838e1fc3528 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf3fe2838e1fc352f expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131133.549549:0:17759:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff91ddfd0b4800/0xf3fe2838e1fc3528 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf3fe2838e1fc352f expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789131133.549558:0:17759:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff91ddfd0b4800/0xf3fe2838e1fc3528 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf3fe2838e1fc352f expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789131133.549564:0:17759:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789131133.551388:0:17759:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff91ddfd0b4800/0xf3fe2838e1fc3528 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc352f expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131133.551408:0:17759:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789131133.551447:0:17759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff91ddfd0b4800/0xf3fe2838e1fc3528 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc352f expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131133.551470:0:17759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff91ddfd0b4800/0xf3fe2838e1fc3528 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc352f expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131133.551503:0:17759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131133.551506:0:17759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131133.551510:0:17759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789131133.555073:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7ffe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:3626:1876039508891776:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789131133.555352:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131133.555528:0:17758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508891776 00000100:00100000:2.0:1789131133.555539:0:17758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508891776 00010000:00010000:2.0:1789131133.555606:0:17758:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91ddfd0b4200/0xf3fe2838e1fc352f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3fe2838e1fc3528 expref: 20 pid: 17764 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131133.558343:0:17758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789131133.558370:0:17758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff4e8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+20:3626:x1876039508891776:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789131133.558396:0:17758:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789131133.558426:0:17758:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91ddfd0b4200/0xf3fe2838e1fc352f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3fe2838e1fc3528 expref: 20 pid: 17764 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131133.558447:0:17758:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91ddfd0b4200/0xf3fe2838e1fc352f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf3fe2838e1fc3528 expref: 20 pid: 17764 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131133.558499:0:17758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91ddfd0b4200/0xf3fe2838e1fc352f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf3fe2838e1fc3528 expref: 20 pid: 17764 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131133.558528:0:17758:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91dcc85caa00/0xf3fe2838e1fc35e5 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131133.558539:0:17758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91dcc85caa00/0xf3fe2838e1fc35e5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789131133.558563:0:17758:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.013495106s 00010000:00010000:3.0:1789131133.558569:0:17758:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91dcc85caa00/0xf3fe2838e1fc35e5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131133.558577:0:17758:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91dcc85caa00/0xf3fe2838e1fc35e5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131133.558586:0:17758:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91dcc85caa00/0xf3fe2838e1fc35e5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131133.558593:0:17758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91dcc85caa00/0xf3fe2838e1fc35e5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131133.558600:0:17758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc85caa00 already unused, calling callback (ffffffffc0c4e550) 00010000:00010000:3.0:1789131133.558605:0:17758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91dcc85caa00/0xf3fe2838e1fc35e5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131133.558627:0:17758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91dcc85caa00/0xf3fe2838e1fc35e5 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131133.558653:0:17758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91dcc85caa00/0xf3fe2838e1fc35e5 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131133.558667:0:17758:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789131133.558781:0:17758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff4e8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+19:3626:x1876039508891776:12345-0@lo:103:ldlm_bl.0 Request processed in 424us (3429us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131133.558792:0:17758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1789131133.559006:0:17787:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91dcc85caa00/0xf3fe2838e1fc35e5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131133.559026:0:17787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91dcc85caa00/0xf3fe2838e1fc35e5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131133.559034:0:17787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91dcc85caa00/0xf3fe2838e1fc35e5 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131133.559103:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7ffe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:3626:1876039508891776:0@lo:103:ldlm_bl.0 00000001:00000004:3.0:1789131133.563908:0:19278:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1789131133.574348:0:19278:0:(ofd_obd.c:543:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1789131133.574362:0:19278:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1789131133.574416:0:19278:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789131133.574507:0:19278:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.111@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789131133.574531:0:19278:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1789131133.574556:0:19278:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:3.0:1789131133.575703:0:19278:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789131133.575945:0:19278:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789131133.969592:0:17760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789131134.521503:0:19361:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789131134.521752:0:19361:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789131134.999190:0:19311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789131135.058471:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789131135.058502:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7ffc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1876039508891904:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789131135.058598:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131135.058663:0:17776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508891904 00000100:00100000:2.0:1789131135.058673:0:17776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508891904 00000100:00100000:2.0:1789131135.058730:0:17776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789131135.058741:0:17776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7ffd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3628:x1876039508891904:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789131135.058788:0:17776:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1789131135.058839:0:17776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7ffd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3628:x1876039508891904:12345-0@lo:41:osp-pre-0-1.0 Request processed in 99us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131135.058847:0:17776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789131135.058901:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7ffc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1876039508891904:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789131135.059059:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7890780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1876039508892032:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789131135.059087:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131135.059304:0:18514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508892032 00000100:00100000:1.0:1789131135.059309:0:18514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508892032 00000100:00100000:1.0:1789131135.059356:0:18514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789131135.059363:0:18514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7ffc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3628:x1876039508892032:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789131135.059385:0:18514:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789131135.059438:0:18514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7ffc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3628:x1876039508892032:12345-0@lo:41:osp-pre-1-0.0 Request processed in 75us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131135.059446:0:18514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789131135.059512:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7890780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1876039508892032:0@lo:41:osp-pre-1-0.0 10000000:01000000:0.0:1789131135.569819:0:17768:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789131135.569848:0:17768:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff91ddf34a7800 from 9 10000000:01000000:0.0:1789131135.569855:0:17768:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789131135.569924:0:17768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff91de01ad6600/0xf3fe2838e1fc35ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131135.569937:0:17768:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff91de01ad6600/0xf3fe2838e1fc35ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131135.569950:0:17768:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff91de01ad6600/0xf3fe2838e1fc35ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131135.569984:0:17768:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc860b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:17768:1876039508892160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789131135.570089:0:17768:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131135.570151:0:17768:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddd06830c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789131135.570699:0:17764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508892160 00000100:00100000:1.0:1789131135.570710:0:17764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508892160 00000100:00100000:1.0:1789131135.570838:0:17764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789131135.570849:0:17764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddfbfe1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+19:17768:x1876039508892160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789131135.570868:0:17764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789131135.570888:0:17764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91dcc85cac00/0xf3fe2838e1fc35f3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3fe2838e1fc35ec expref: -99 pid: 17764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131135.570920:0:17764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91dcc85cac00/0xf3fe2838e1fc35f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3fe2838e1fc35ec expref: 20 pid: 17764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131135.570932:0:17764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91dcc85cac00/0xf3fe2838e1fc35f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc35ec expref: 20 pid: 17764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131135.570944:0:17764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dcc85cac00, rc 0) 00000100:00100000:1.0:1789131135.571021:0:17764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddfbfe1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+20:17768:x1876039508892160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 173us (931us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131135.571028:0:17764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789131135.571146:0:17768:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc860b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:17768:1876039508892160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789131135.571165:0:17768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff91de01ad6600/0xf3fe2838e1fc35ec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc35f3 expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131135.571176:0:17768:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff91de01ad6600/0xf3fe2838e1fc35ec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3fe2838e1fc35f3 expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131135.571244:0:17768:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc860b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:17768:1876039508892288:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1789131135.571281:0:17768:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131135.581304:0:17765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508892288 00000100:00100000:2.0:1789131135.581326:0:17765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508892288 00000100:00100000:2.0:1789131135.581406:0:17765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789131135.581432:0:17765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddfbfe0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+20:17768:x1876039508892288:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789131135.581488:0:17765:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789131135.581520:0:17765:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789131135.581524:0:17765:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:2.0:1789131135.581688:0:17765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddfbfe0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+20:17768:x1876039508892288:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 258us (10404us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131135.581707:0:17765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789131135.587274:0:17768:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddd06830c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789131135.587351:0:17768:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc860b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:17768:1876039508892288:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1789131135.587453:0:17768:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789131135.587484:0:17768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff91de01ad6600/0xf3fe2838e1fc35ec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc35f3 expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131135.587497:0:17768:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff91de01ad6600/0xf3fe2838e1fc35ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc35f3 expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789131135.587509:0:17768:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789131135.587513:0:17768:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff91dcc78a7000 from 9 10000000:01000000:0.0:1789131135.587516:0:17768:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789131135.587562:0:17768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff91de01ad7a00/0xf3fe2838e1fc35fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131135.587571:0:17768:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff91de01ad7a00/0xf3fe2838e1fc35fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131135.587581:0:17768:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff91de01ad7a00/0xf3fe2838e1fc35fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131135.587624:0:17768:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc860b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:17768:1876039508892416:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789131135.588320:0:17768:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131135.588378:0:17768:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddd06830c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789131135.588502:0:17766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508892416 00000100:00100000:3.0:1789131135.588512:0:17766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508892416 00000100:00100000:3.0:1789131135.588651:0:17766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789131135.589581:0:17766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddfbfe2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+20:17768:x1876039508892416:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789131135.589612:0:17766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789131135.589639:0:17766:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91ddfd0b5400/0xf3fe2838e1fc3601 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3fe2838e1fc35fa expref: -99 pid: 17766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131135.589962:0:17766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91ddfd0b5400/0xf3fe2838e1fc3601 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3fe2838e1fc35fa expref: 21 pid: 17766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131135.589976:0:17766:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91ddfd0b5400/0xf3fe2838e1fc3601 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc35fa expref: 21 pid: 17766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131135.589987:0:17766:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ddfd0b5400, rc 0) 00000100:00100000:3.0:1789131135.590086:0:17766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddfbfe2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+21:17768:x1876039508892416:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1424us (1767us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131135.590095:0:17766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789131135.590228:0:17768:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc860b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:17768:1876039508892416:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789131135.590250:0:17768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff91de01ad7a00/0xf3fe2838e1fc35fa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc3601 expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131135.590261:0:17768:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff91de01ad7a00/0xf3fe2838e1fc35fa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3fe2838e1fc3601 expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131135.590344:0:17768:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc860b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:17768:1876039508892544:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1789131135.590386:0:17768:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131135.591197:0:17764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508892544 00000100:00100000:1.0:1789131135.591208:0:17764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508892544 00000100:00100000:1.0:1789131135.591257:0:17764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789131135.591278:0:17764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddfbfe0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+21:17768:x1876039508892544:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1789131135.591302:0:17764:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789131135.591320:0:17764:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789131135.591323:0:17764:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:1.0:1789131135.591444:0:17764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddfbfe0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+21:17768:x1876039508892544:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 168us (1056us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131135.591453:0:17764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789131135.595222:0:17768:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddd06830c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789131135.595295:0:17768:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc860b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:17768:1876039508892544:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1789131135.595407:0:17768:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789131135.595420:0:17768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff91de01ad7a00/0xf3fe2838e1fc35fa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc3601 expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131135.595433:0:17768:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff91de01ad7a00/0xf3fe2838e1fc35fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc3601 expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131136.019089:0:17759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789131137.041845:0:17760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789131138.067702:0:19311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789131138.455805:0:17805:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00080000:1.0:1789131138.641730:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789131138.641735:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789131138.641738:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789131138.641741:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789131138.641766:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789131138.641769:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789131138.641771:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789131138.641774:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789131138.641818:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc78912c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3627:1876039508892928:0@lo:400:kworker.0 00000100:00100000:1.0:1789131138.641886:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131138.641919:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7891e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3627:1876039508893440:0@lo:400:kworker.0 00000100:00100000:1.0:1789131138.641941:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131138.641963:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789131138.641968:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7892580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508893056:0@lo:400:kworker.0 00000100:00100000:1.0:1789131138.642005:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131138.642041:0:17772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508892928 00000100:00100000:2.0:1789131138.642155:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7890000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:3625:1876039508892672:0@lo:400:kworker.0 00000100:00100000:2.0:1789131138.642189:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131138.642216:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7891680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3625:1876039508893184:0@lo:400:kworker.0 00000100:00100000:2.0:1789131138.642236:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131138.642253:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789131138.642258:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7893840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508892800:0@lo:400:kworker.0 00000100:00100000:2.0:1789131138.642276:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131138.642293:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7890780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3625:1876039508893312:0@lo:400:kworker.0 00000100:00100000:2.0:1789131138.642314:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131138.642337:0:19096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508893440 00000100:00100000:2.0:1789131138.642342:0:19096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508893440 00000100:00100000:2.0:1789131138.642381:0:19096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508893184 00000100:00100000:2.0:1789131138.642384:0:19096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508893184 00000100:00100000:2.0:1789131138.642393:0:19096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508893312 00000100:00100000:2.0:1789131138.642395:0:19096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508893312 00000100:00100000:2.0:1789131138.642410:0:19096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789131138.642418:0:19096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7892d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1876039508893440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131138.642486:0:19096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7892d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1876039508893440:12345-0@lo:400:kworker.0 Request processed in 69us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131138.642492:0:19096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789131138.642506:0:19096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789131138.642511:0:19096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7fff840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1876039508893184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131138.642537:0:19096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7fff840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1876039508893184:12345-0@lo:400:kworker.0 Request processed in 26us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131138.642541:0:19096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789131138.642560:0:19096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789131138.642566:0:19096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7ffcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1876039508893312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131138.642593:0:19096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7ffcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1876039508893312:12345-0@lo:400:kworker.0 Request processed in 27us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131138.642598:0:19096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789131138.642615:0:17764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508892672 00000100:00100000:2.0:1789131138.642618:0:17764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508892672 00000100:00100000:2.0:1789131138.642643:0:17764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789131138.642648:0:17764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddfbfe3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+21:3625:x1876039508892672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131138.642674:0:17764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddfbfe3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+21:3625:x1876039508892672:12345-0@lo:400:kworker.0 Request processed in 26us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131138.642680:0:17764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789131138.642707:0:18514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508893056 00000100:00100000:2.0:1789131138.642711:0:18514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508893056 00000100:00100000:2.0:1789131138.642731:0:18514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508892800 00000100:00100000:2.0:1789131138.642734:0:18514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508892800 00000100:00100000:2.0:1789131138.642744:0:18514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789131138.642750:0:18514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddca0c4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508893056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131138.642779:0:18514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddca0c4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508893056:12345-0@lo:400:kworker.0 Request processed in 30us (773us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131138.642785:0:18514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789131138.642796:0:18514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789131138.642802:0:18514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7ffe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1876039508892800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131138.642828:0:18514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7ffe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1876039508892800:12345-0@lo:400:kworker.0 Request processed in 27us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131138.642834:0:18514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:2.0:1789131138.642875:0:17767:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789131138.642884:0:17767:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789131138.642918:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7893840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508892800:0@lo:400:kworker.0 00010000:00080000:2.0:1789131138.642930:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91dcc7890780 x1876039508893312/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789131154 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789131138.642939:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7890780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3625:1876039508893312:0@lo:400:kworker.0 00000100:00100000:2.0:1789131138.642946:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7890000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:3625:1876039508892672:0@lo:400:kworker.0 00010000:00080000:2.0:1789131138.642953:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91dcc7891680 x1876039508893184/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789131154 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789131138.642960:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7891680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3625:1876039508893184:0@lo:400:kworker.0 00000100:00100000:2.0:1789131138.643006:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7892580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508893056:0@lo:400:kworker.0 00010000:00080000:2.0:1789131138.643018:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91dcc7891e00 x1876039508893440/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789131154 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789131138.643026:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7891e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3627:1876039508893440:0@lo:400:kworker.0 00000100:00100000:1.0:1789131138.643240:0:17772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508892928 00000100:00100000:1.0:1789131138.643276:0:17772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789131138.643283:0:17772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7893c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1876039508892928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789131138.643324:0:17772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7893c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1876039508892928:12345-0@lo:400:kworker.0 Request processed in 42us (1437us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131138.643330:0:17772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1789131138.643358:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91dcc78912c0 x1876039508892928/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789131154 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789131138.643366:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc78912c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3627:1876039508892928:0@lo:400:kworker.0 00000001:02000400:0.0:1789131138.834715:0:19651:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg311-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1789131139.089740:0:17759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789131139.567079:0:19703:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789131139.567284:0:19703:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789131140.113934:0:17760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789131140.177609:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddca0c61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1876039508893568:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789131140.177682:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131140.177766:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7ffe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508893696:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789131140.177792:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131140.177839:0:17776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508893568 00000100:00100000:2.0:1789131140.177845:0:17776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508893568 00000100:00100000:2.0:1789131140.177881:0:17776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508893696 00000100:00100000:2.0:1789131140.177884:0:17776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508893696 00000100:00100000:2.0:1789131140.177897:0:17776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789131140.177912:0:17776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7ffc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3628:x1876039508893568:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789131140.177942:0:17776:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789131140.177997:0:17776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7ffc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3628:x1876039508893568:12345-0@lo:41:osp-pre-1-0.0 Request processed in 87us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131140.178003:0:17776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789131140.178019:0:17776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789131140.178025:0:17776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7ffe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508893696:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789131140.178040:0:17776:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1789131140.178068:0:17776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7ffe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508893696:12345-0@lo:41:osp-pre-0-1.0 Request processed in 44us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131140.178073:0:17776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789131140.178111:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7ffe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508893696:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789131140.178137:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddca0c61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1876039508893568:0@lo:41:osp-pre-1-0.0 00000020:00000004:0.0:1789131140.265272:0:19753:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789131140.265548:0:19753:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789131141.140409:0:19311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789131141.141212:0:18526:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789131142.163126:0:17759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131143.187350:0:17760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789131143.768806:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789131143.768815:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789131143.768818:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789131143.768821:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789131143.768839:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789131143.768842:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789131143.768845:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789131143.768848:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789131143.768893:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd1dac3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1876039508893952:0@lo:400:kworker.0 00000100:00100000:3.0:1789131143.768992:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131143.769058:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd1dac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3627:1876039508894464:0@lo:400:kworker.0 00000100:00100000:3.0:1789131143.769086:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131143.769112:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789131143.769117:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd1dade00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3627:1876039508894080:0@lo:400:kworker.0 00000100:00100000:3.0:1789131143.769140:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131143.769157:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd1daf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3627:1876039508894592:0@lo:400:kworker.0 00000100:00100000:3.0:1789131143.769178:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131143.769240:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd1dac780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:3626:1876039508893824:0@lo:400:kworker.0 00000100:00100000:2.0:1789131143.769279:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131143.769313:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd1daf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3626:1876039508894336:0@lo:400:kworker.0 00000100:00100000:2.0:1789131143.769336:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131143.769355:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789131143.769360:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd1daf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1876039508894208:0@lo:400:kworker.0 00000100:00100000:2.0:1789131143.769384:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131143.769423:0:17776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508893952 00000100:00100000:2.0:1789131143.769431:0:17776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508893952 00000100:00100000:2.0:1789131143.769502:0:17776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508894208 00000100:00100000:2.0:1789131143.769506:0:17776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508894208 00000100:00100000:2.0:1789131143.769534:0:17776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789131143.769544:0:17776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd1dada40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1876039508893952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789131143.770745:0:17772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508894464 00000100:00100000:1.0:1789131143.770758:0:17772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508894464 00000100:00100000:1.0:1789131143.770813:0:17772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508894080 00000100:00100000:1.0:1789131143.770816:0:17772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508894080 00000100:00100000:1.0:1789131143.770831:0:17772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508894592 00000100:00100000:1.0:1789131143.770834:0:17772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508894592 00000100:00100000:1.0:1789131143.770847:0:17772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508894336 00000100:00100000:1.0:1789131143.770850:0:17772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508894336 00000100:00100000:1.0:1789131143.770866:0:17772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789131143.770876:0:17772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd1dacb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1876039508894464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789131143.770986:0:17772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd1dacb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1876039508894464:12345-0@lo:400:kworker.0 Request processed in 112us (1898us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131143.770995:0:17772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789131143.771014:0:17772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789131143.771020:0:17772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd1dad2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1876039508894080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789131143.771050:0:17772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd1dad2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1876039508894080:12345-0@lo:400:kworker.0 Request processed in 31us (1909us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131143.771067:0:17772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789131143.771081:0:17772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789131143.771087:0:17772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd1dae580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1876039508894592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789131143.771119:0:17772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd1dae580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1876039508894592:12345-0@lo:400:kworker.0 Request processed in 32us (1940us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131143.771124:0:17772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789131143.771134:0:17772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789131143.771140:0:17772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7ffe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1876039508894336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789131143.771197:0:17772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7ffe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1876039508894336:12345-0@lo:400:kworker.0 Request processed in 56us (1860us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131143.771204:0:17772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789131143.771232:0:18514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789131143.771241:0:18514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc78912c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1876039508894208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789131143.771275:0:18514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc78912c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1876039508894208:12345-0@lo:400:kworker.0 Request processed in 35us (1890us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131143.771282:0:18514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:1.0:1789131143.771301:0:17767:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789131143.771306:0:17767:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789131143.771340:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91ddd1dade00 x1876039508894080/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789131159 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789131143.771357:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd1dade00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3627:1876039508894080:0@lo:400:kworker.0 00010000:00080000:1.0:1789131143.771369:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91ddd1daf840 x1876039508894592/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789131159 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789131143.771378:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd1daf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3627:1876039508894592:0@lo:400:kworker.0 00010000:00080000:1.0:1789131143.771403:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91ddd1dac000 x1876039508894464/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789131159 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789131143.771412:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd1dac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3627:1876039508894464:0@lo:400:kworker.0 00000100:00100000:1.0:1789131143.771451:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd1daf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1876039508894208:0@lo:400:kworker.0 00010000:00080000:1.0:1789131143.771490:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91ddd1daf480 x1876039508894336/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789131159 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789131143.771500:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd1daf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3626:1876039508894336:0@lo:400:kworker.0 00000100:00100000:2.0:1789131143.771741:0:17776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd1dada40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1876039508893952:12345-0@lo:400:kworker.0 Request processed in 2197us (2747us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131143.771750:0:17776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789131143.771878:0:17765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508893824 00000100:00100000:3.0:1789131143.771884:0:17765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508893824 00000100:00100000:3.0:1789131143.771924:0:17765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1789131143.771932:0:17765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddfbfe1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+21:3626:x1876039508893824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789131143.771983:0:17765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddfbfe1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+21:3626:x1876039508893824:12345-0@lo:400:kworker.0 Request processed in 51us (2702us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131143.771989:0:17765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789131143.772741:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd1dac3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1876039508893952:0@lo:400:kworker.0 00000100:00100000:1.0:1789131143.772778:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd1dac780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:3626:1876039508893824:0@lo:400:kworker.0 00010000:00010000:1.0:1789131144.209894:0:19311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789131144.788654:0:3624:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789131129/real 1789131129] req@ffff91ddd286da40 x1876039508886656/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789131144 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789131144.788697:0:3624:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff91ddd286da40 x1876039508886656/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789131144 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789131144.788709:0:3624:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789131129/real 1789131129] req@ffff91ddd286e1c0 x1876039508886784/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789131144 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789131144.788748:0:3624:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff91ddd286e1c0 x1876039508886784/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789131144 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789131144.788773:0:3624:0:(import.c:65:import_set_state_nolock()) ffff91ddc5749800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789131144.788786:0:3624:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789131144.788791:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd286da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3624:1876039508886656:0@lo:8:kworker.0 00000100:00080000:0.0:1789131144.788797:0:3624:0:(import.c:65:import_set_state_nolock()) ffff91ddff618800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789131144.788802:0:3624:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789131144.788805:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd286e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3624:1876039508886784:0@lo:8:kworker.0 00000100:00080000:1.0:1789131144.791766:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789131144.791775:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789131144.791778:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789131144.791781:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789131144.791810:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789131144.791813:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1789131144.791818:0:36:0:(import.c:65:import_set_state_nolock()) ffff91ddc5749800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789131144.791827:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 485 00000100:00080000:1.0:1789131144.791835:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1789131144.791844:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff91ddc5749800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:1.0:1789131144.791873:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91ddca0c4000 x1876039508895232/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789131144.791911:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789131144.791915:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789131144.791917:0:36:0:(import.c:65:import_set_state_nolock()) ffff91ddff618800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789131144.791921:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 485 00000100:00080000:1.0:1789131144.791925:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1789131144.791940:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff91ddff618800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:1.0:1789131144.791955:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91ddca0c61c0 x1876039508895360/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789131144.792181:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddca0c6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508894848:0@lo:400:kworker.0 00000100:00100000:1.0:1789131144.792274:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131144.792321:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7ffcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3626:1876039508895616:0@lo:400:kworker.0 00000100:00100000:1.0:1789131144.792350:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131144.792379:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789131144.792385:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddca0c6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:3626:1876039508894720:0@lo:400:kworker.0 00000100:00100000:1.0:1789131144.792418:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131144.792449:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddca0c5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3626:1876039508895488:0@lo:400:kworker.0 00000100:00100000:1.0:1789131144.792515:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131144.792546:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddca0c4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3627:1876039508894976:0@lo:400:kworker.0 00000100:00100000:1.0:1789131144.792571:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131144.792587:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddca228000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3627:1876039508895744:0@lo:400:kworker.0 00000100:00100000:1.0:1789131144.792609:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131144.792626:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789131144.792632:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddca0c7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508895104:0@lo:400:kworker.0 00000100:00100000:1.0:1789131144.792671:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131144.792701:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddca0c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3624:1876039508895232:0@lo:8:kworker.0 00000100:00100000:1.0:1789131144.792733:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131144.792752:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddca0c61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3624:1876039508895360:0@lo:8:kworker.0 00000100:00100000:1.0:1789131144.792774:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131144.792805:0:18514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508894848 00000100:00100000:1.0:1789131144.792813:0:18514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508894848 00000100:00100000:1.0:1789131144.792860:0:18514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508895104 00000100:00100000:1.0:1789131144.792863:0:18514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508895104 00000100:00100000:1.0:1789131144.792882:0:18514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789131144.792892:0:18514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddca2292c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508894848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789131144.792965:0:18514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddca2292c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508894848:12345-0@lo:400:kworker.0 Request processed in 74us (691us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131144.792973:0:18514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789131144.792994:0:18514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789131144.793000:0:18514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddca22b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508895104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789131144.793036:0:18514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddca22b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508895104:12345-0@lo:400:kworker.0 Request processed in 37us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131144.793042:0:18514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789131144.793060:0:17772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508895616 00000100:00100000:1.0:1789131144.793064:0:17772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508895616 00000100:00100000:1.0:1789131144.793086:0:17772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508895488 00000100:00100000:1.0:1789131144.793089:0:17772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508895488 00000100:00100000:1.0:1789131144.793102:0:17772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508894976 00000100:00100000:1.0:1789131144.793104:0:17772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508894976 00000100:00100000:1.0:1789131144.793115:0:17772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508895744 00000100:00100000:1.0:1789131144.793117:0:17772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508895744 00000100:00100000:1.0:1789131144.793132:0:17772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789131144.793147:0:17772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddca22a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1876039508895616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131144.793174:0:17766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508894720 00000100:00100000:2.0:1789131144.793180:0:17766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508894720 00000100:00100000:1.0:1789131144.793185:0:17772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddca22a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1876039508895616:12345-0@lo:400:kworker.0 Request processed in 38us (833us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131144.793193:0:17772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789131144.793209:0:17772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789131144.793216:0:17772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddca2283c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1876039508895488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789131144.793245:0:17772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddca2283c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1876039508895488:12345-0@lo:400:kworker.0 Request processed in 30us (730us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131144.793251:0:17772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789131144.793263:0:17772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789131144.793269:0:17772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddca229e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1876039508894976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789131144.793295:0:17772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddca229e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1876039508894976:12345-0@lo:400:kworker.0 Request processed in 26us (723us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131144.793301:0:17772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789131144.793312:0:17772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789131144.793318:0:17772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddca22b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1876039508895744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789131144.793344:0:17772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddca22b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1876039508895744:12345-0@lo:400:kworker.0 Request processed in 26us (735us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131144.793350:0:17772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789131144.793383:0:19283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508895232 00000100:00100000:1.0:1789131144.793387:0:19283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508895232 00000100:00100000:1.0:1789131144.793405:0:19283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508895360 00000100:00100000:1.0:1789131144.793408:0:19283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508895360 00000100:00100000:1.0:1789131144.793417:0:19283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789131144.793422:0:19283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddca228b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3624:x1876039508895232:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1789131144.793454:0:19283:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 500 last 0 00000020:00000080:1.0:1789131144.793514:0:19283:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf3fe2838e1fc3608 00002000:00100000:1.0:1789131144.793534:0:19283:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff91ddd1d8a000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113984 ocd_grant: 0 ocd_index: 0 ocd_group 1 00000100:00100000:2.0:1789131144.793537:0:17766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00002000:00080000:1.0:1789131144.793542:0:19283:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:1.0:1789131144.793548:0:19283:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:2.0:1789131144.793554:0:17766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddfbfe2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+21:3626:x1876039508894720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131144.793605:0:17766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddfbfe2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+21:3626:x1876039508894720:12345-0@lo:400:kworker.0 Request processed in 58us (1186us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131144.793614:0:17766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00002000:00080000:1.0:1789131144.793788:0:19283:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:1.0:1789131144.793825:0:19283:0:(import.c:65:import_set_state_nolock()) ffff91dcc8449800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789131144.793871:0:19283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddca228b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3624:x1876039508895232:12345-0@lo:8:kworker.0 Request processed in 447us (1136us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131144.793878:0:19283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789131144.793892:0:19283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789131144.793896:0:19283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddca22a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3624:x1876039508895360:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1789131144.793911:0:19283:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1789131144.799664:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddca0c7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508895104:0@lo:400:kworker.0 00010000:00080000:2.0:1789131144.799694:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91ddca0c4f00 x1876039508894976/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789131160 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789131144.799708:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddca0c4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3627:1876039508894976:0@lo:400:kworker.0 00010000:00080000:2.0:1789131144.799723:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91ddca228000 x1876039508895744/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789131160 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789131144.799733:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddca228000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3627:1876039508895744:0@lo:400:kworker.0 00000100:00100000:2.0:1789131144.799885:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddca0c6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:3626:1876039508894720:0@lo:400:kworker.0 00010000:00080000:2.0:1789131144.799903:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91ddca0c5680 x1876039508895488/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789131160 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789131144.799913:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddca0c5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3626:1876039508895488:0@lo:400:kworker.0 00000100:00100000:2.0:1789131144.799958:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddca0c6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508894848:0@lo:400:kworker.0 00010000:00080000:2.0:1789131144.799972:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91dcc7ffcf00 x1876039508895616/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789131160 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789131144.799981:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7ffcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3626:1876039508895616:0@lo:400:kworker.0 00010000:00080000:0.0:1789131144.800732:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91ddca0c4000 x1876039508895232/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789131164 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789131144.800746:0:3624:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789131144.800760:0:3624:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000100:00080000:0.0:1789131144.800772:0:3624:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789131144.800779:0:3624:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1789131144.800784:0:3624:0:(import.c:65:import_set_state_nolock()) ffff91ddc5749800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789131144.800941:0:3624:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789131144.800949:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddca0c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3624:1876039508895232:0@lo:8:kworker.0 00000004:00080000:3.0:1789131144.803668:0:18515:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1789131144.803816:0:18515:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 500721356345ns, next at 0ns, rc = 0 00080000:00080000:3.0:1789131144.803844:0:18515:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:0.0:1789131144.808103:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7891e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1876039508895872:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789131144.808200:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1789131144.808562:0:18516:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:2.0:1789131144.808884:0:18516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7892580 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:18516:1876039508896000:0@lo:7:osp-pre-0-1.0 00000100:00100000:2.0:1789131144.808945:0:18516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131144.808974:0:18516:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddd804fe40 going to sleep for 11 seconds 00000100:00100000:2.0:1789131144.809010:0:19286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508895872 00000100:00100000:2.0:1789131144.809019:0:19286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508895872 00000100:00100000:2.0:1789131144.809094:0:19286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789131144.809106:0:19286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc86083c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3628:x1876039508895872:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789131144.809883:0:19284:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1789131144.809897:0:19284:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00002000:00000024:2.0:1789131144.810571:0:19286:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923509248 avail 3691986944 00000100:00080000:0.0:1789131144.810711:0:17767:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:3.0:1789131144.810976:0:18506:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:2.0:1789131144.811058:0:19286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc86083c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3628:x1876039508895872:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1950us (2854us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131144.811071:0:19286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789131144.813745:0:19284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508896000 00000100:00100000:3.0:1789131144.813761:0:19284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508896000 00000100:00100000:2.0:1789131144.814033:0:19981:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789131144.814047:0:19981:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7891680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:18516:x1876039508896000:12345-0@lo:7:osp-pre-0-1.0 00000100:00100000:1.0:1789131144.816711:0:19283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddca22a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3624:x1876039508895360:12345-0@lo:8:kworker.0 Request processed in 22800us (23922us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789131144.816727:0:19283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1789131144.817163:0:3624:0:(import.c:65:import_set_state_nolock()) ffff91ddff618800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789131144.817171:0:3624:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789131144.817176:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddca0c61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3624:1876039508895360:0@lo:8:kworker.0 00010000:00080000:0.0:1789131144.818168:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91dcc7891e00 x1876039508895872/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789131160 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789131144.818197:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7891e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1876039508895872:0@lo:13:osp-pre-0-1.0 00002000:00080000:2.0:1789131144.820084:0:19981:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:2.0:1789131144.820096:0:19981:0:(ofd_dev.c:1222:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x21:0x0] 00000100:00100000:2.0:1789131144.820410:0:19981:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7891680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:18516:x1876039508896000:12345-0@lo:7:osp-pre-0-1.0 Request processed in 6360us (11458us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131144.820424:0:19981:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1789131144.821048:0:18516:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91dcc7892580 x1876039508896000/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789131160 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789131144.821065:0:18516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7892580 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:18516:1876039508896000:0@lo:7:osp-pre-0-1.0 00000004:00080000:0.0:1789131144.821082:0:18516:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x21:0x0] 00000100:00100000:1.0:1789131144.821268:0:18516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddca228f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:18516:1876039508896128:0@lo:5:osp-pre-0-1.0 00000100:00100000:1.0:1789131144.821325:0:18516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131144.821402:0:18516:0:(client.c:2715:ptlrpc_set_wait()) set ffff91dcc8546900 going to sleep for 11 seconds 00000100:00100000:3.0:1789131144.821441:0:19284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508896128 00000100:00100000:3.0:1789131144.821451:0:19284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508896128 00000100:00100000:3.0:1789131144.821780:0:19284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789131144.821808:0:19284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddca22a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:18516:x1876039508896128:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:3.0:1789131144.821842:0:19284:0:(ofd_dev.c:1654:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:3.0:1789131144.821903:0:19284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddca22a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:18516:x1876039508896128:12345-0@lo:5:osp-pre-0-1.0 Request processed in 98us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131144.821911:0:19284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1789131144.821973:0:18516:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91ddca228f00 x1876039508896128/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789131160 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789131144.821985:0:18516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddca228f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:18516:1876039508896128:0@lo:5:osp-pre-0-1.0 00000004:00080000:1.0:1789131144.821995:0:18516:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x21:0x0] 00000100:00100000:1.0:1789131144.822029:0:18516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddca228f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:18516:1876039508896256:0@lo:5:osp-pre-0-1.0 00000100:00100000:1.0:1789131144.822056:0:18516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131144.822180:0:18516:0:(client.c:2715:ptlrpc_set_wait()) set ffff91dcc8546900 going to sleep for 11 seconds 00000100:00100000:2.0:1789131144.822313:0:19285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508896256 00000100:00100000:2.0:1789131144.822320:0:19285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508896256 00000100:00100000:2.0:1789131144.822365:0:19285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789131144.822372:0:19285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddca22ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:18516:x1876039508896256:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:2.0:1789131144.822403:0:19285:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 34 00000001:00080000:3.0:1789131144.838827:0:19279:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:3.0:1789131144.838850:0:19279:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:1.0:1789131144.839261:0:19285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddca22ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:18516:x1876039508896256:12345-0@lo:5:osp-pre-0-1.0 Request processed in 16882us (17196us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1789131144.839277:0:19285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1789131144.839411:0:18516:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91ddca228f00 x1876039508896256/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789131160 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789131144.839426:0:18516:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1789131144.839434:0:18516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddca228f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:18516:1876039508896256:0@lo:5:osp-pre-0-1.0 00000004:00080000:2.0:1789131144.839453:0:18516:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:3.0:1789131144.842911:0:18516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd1dafc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:18516:1876039508896384:0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1789131144.843021:0:18516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131144.843070:0:18516:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddff8be6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789131144.843284:0:17783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508896384 00000100:00100000:2.0:1789131144.843294:0:17783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508896384 00000100:00100000:2.0:1789131144.843573:0:17783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789131144.843599:0:17783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd1dae1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:18516:x1876039508896384:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:2.0:1789131144.843712:0:17783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd1dae1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:18516:x1876039508896384:12345-0@lo:900:osp-pre-0-1.0 Request processed in 126us (691us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131144.843723:0:17783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789131144.843960:0:18516:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91ddd1dafc00 x1876039508896384/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789131160 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789131144.843980:0:18516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd1dafc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:18516:1876039508896384:0@lo:900:osp-pre-0-1.0 00010000:00010000:0.0:1789131145.237844:0:17759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789131145.297679:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789131145.297700:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7890000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1876039508896512:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789131145.297765:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131145.297812:0:18514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508896512 00000100:00100000:2.0:1789131145.297820:0:18514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508896512 00000100:00100000:2.0:1789131145.297862:0:18514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789131145.297870:0:18514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7890780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1876039508896512:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789131145.297900:0:18514:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1789131145.297951:0:18514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7890780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1876039508896512:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131145.297958:0:18514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789131145.298016:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7890000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1876039508896512:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789131145.299290:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789131145.299306:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddca229a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508896640:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789131145.299356:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131145.300360:0:17777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508896640 00000100:00100000:1.0:1789131145.300368:0:17777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508896640 00000100:00100000:1.0:1789131145.300412:0:17777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789131145.300421:0:17777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8609a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1876039508896640:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789131145.300490:0:17777:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789131145.300560:0:17777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8609a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3625:x1876039508896640:12345-0@lo:41:osp-pre-1-0.0 Request processed in 139us (1203us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131145.300567:0:17777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789131145.300786:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddca229a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508896640:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789131146.260133:0:17760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789131146.548090:0:20099:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1789131146.548095:0:20099:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:0.0:1789131146.548096:0:20099:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1789131146.548301:0:20099:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff91de01a79000 00000020:01000004:0.0:1789131146.548317:0:20099:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1789131146.548332:0:20099:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1789131146.548346:0:20099:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff91de01a04ed8) 00000020:00000080:0.0:1789131146.548364:0:20099:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1789131146.626561:0:20099:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1789131146.631501:0:20099:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:2.0:1789131146.631892:0:20099:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1789131146.632246:0:20099:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1789131146.633347:0:20099:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1789131146.633869:0:20099:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1789131146.635071:0:20099:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:01000000:2.0:1789131146.638293:0:20099:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1789131146.638615:0:20099:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1789131146.638629:0:20099:0:(osd_handler.c:8895:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789131146.638642:0:20099:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xf3fe2838e1fc3616 00000020:01000004:2.0:1789131146.638648:0:20099:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:2.0:1789131146.638672:0:20099:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.111@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789131146.638676:0:20099:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.111@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789131146.638684:0:20099:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1789131146.638728:0:20099:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:2.0:1789131146.638741:0:20099:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.111@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1789131146.658385:0:20099:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.111@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789131146.658426:0:20099:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.111@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1789131146.658430:0:20099:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789131146.658432:0:20099:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789131146.658433:0:20099:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789131146.658435:0:20099:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789131146.658436:0:20099:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789131146.658438:0:20099:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789131146.658439:0:20099:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789131146.658441:0:20099:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789131146.658442:0:20099:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789131146.658445:0:20099:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1789131146.658451:0:20099:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789131146.658452:0:20099:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789131146.658453:0:20099:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789131146.658454:0:20099:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789131146.658455:0:20099:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789131146.658456:0:20099:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789131146.658480:0:20099:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789131146.658481:0:20099:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789131146.658482:0:20099:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789131146.658684:0:20099:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1789131146.658705:0:20099:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7890000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:20099:1876039508896768:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789131146.658793:0:20099:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131146.658865:0:20099:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddc5165180 going to sleep for 11 seconds 00000100:00100000:2.0:1789131146.659068:0:17764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508896768 00000100:00100000:2.0:1789131146.659075:0:17764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508896768 00000100:00100000:2.0:1789131146.659180:0:17764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789131146.659190:0:17764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddfbfe1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+21:20099:x1876039508896768:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789131146.659219:0:17764:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1789131146.659223:0:17764:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:2.0:1789131146.659226:0:17764:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1789131146.659603:0:17764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddfbfe1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+21:20099:x1876039508896768:12345-0@lo:253:mount.lustre.0 Request processed in 414us (809us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131146.659611:0:17764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789131146.659708:0:20099:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7890000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:20099:1876039508896768:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789131146.659718:0:20099:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1789131146.659720:0:20099:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789131146.659721:0:20099:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789131146.659722:0:20099:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789131146.659724:0:20099:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789131146.659724:0:20099:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789131146.659726:0:20099:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789131146.659727:0:20099:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789131146.659728:0:20099:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789131146.659729:0:20099:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789131146.659764:0:20099:0:(tgt_mount.c:101:server_register_mount()) register mount ffff91de01a79000 from lustre-OST0001 10000000:01000000:1.0:1789131146.659804:0:20099:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1789131146.659807:0:20099:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1789131146.659816:0:20099:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff91ddff71ced8 local copy 00010000:00010000:1.0:1789131146.659830:0:20099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff91dcc85cb600/0xf3fe2838e1fc3330 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc3337 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131146.659908:0:20099:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddca229a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:20099:1876039508896896:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789131146.659951:0:20099:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131146.660600:0:20099:0:(client.c:2715:ptlrpc_set_wait()) set ffff91dded3d5f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789131146.660684:0:17766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508896896 00000100:00100000:0.0:1789131146.660689:0:17766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508896896 00000100:00100000:0.0:1789131146.660719:0:17766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789131146.660726:0:17766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddfbfe0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+21:20099:x1876039508896896:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789131146.660934:0:17766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddfbfe0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+21:20099:x1876039508896896:12345-0@lo:501:mount.lustre.0 Request processed in 208us (982us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789131146.660954:0:17766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789131146.661111:0:20099:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddca229a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:20099:1876039508896896:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1789131146.661137:0:20099:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.111@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1789131146.661157:0:20099:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.111@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1789131146.661165:0:20099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff91dcc85cb600/0xf3fe2838e1fc3330 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc3337 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131146.661174:0:20099:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff91dcc85cb600/0xf3fe2838e1fc3330 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc3337 expref: -99 pid: 17750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789131146.661202:0:20099:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff91de01a79000 10000000:01000000:1.0:1789131146.661207:0:20099:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789131146.661213:0:20099:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1789131146.661215:0:20099:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789131146.661219:0:20099:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1789131146.661222:0:20099:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1789131146.661244:0:20099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff91dcc85cbe00/0xf3fe2838e1fc361d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 20099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131146.661252:0:20099:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff91dcc85cbe00/0xf3fe2838e1fc361d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 20099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131146.661261:0:20099:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff91dcc85cbe00/0xf3fe2838e1fc361d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 20099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131146.661285:0:20099:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddca229a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:20099:1876039508897024:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789131146.661314:0:20099:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131146.661336:0:20099:0:(client.c:2715:ptlrpc_set_wait()) set ffff91dded3d5f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789131146.661512:0:17766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508897024 00000100:00100000:0.0:1789131146.661517:0:17766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508897024 00000100:00100000:0.0:1789131146.661538:0:17766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1789131146.661545:0:17766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddfff14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+21:20099:x1876039508897024:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789131146.661554:0:17766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789131146.661567:0:17766:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91de01ad6000/0xf3fe2838e1fc3624 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3fe2838e1fc361d expref: -99 pid: 17766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131146.661588:0:17766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91de01ad6000/0xf3fe2838e1fc3624 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3fe2838e1fc361d expref: 22 pid: 17766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131146.661598:0:17766:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91de01ad6000/0xf3fe2838e1fc3624 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc361d expref: 22 pid: 17766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131146.661607:0:17766:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91de01ad6000, rc 0) 00000100:00100000:0.0:1789131146.661646:0:17766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddfff14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+22:20099:x1876039508897024:12345-0@lo:101:mount.lustre.0 Request processed in 101us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131146.661653:0:17766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789131146.661896:0:20099:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddca229a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:20099:1876039508897024:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789131146.661909:0:20099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff91dcc85cbe00/0xf3fe2838e1fc361d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc3624 expref: -99 pid: 20099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131146.661927:0:20099:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff91dcc85cbe00/0xf3fe2838e1fc361d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3fe2838e1fc3624 expref: -99 pid: 20099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789131146.663319:0:20099:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1789131146.664038:0:20099:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789131146.669379:0:20099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1789131146.669436:0:20099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1789131146.669453:0:20099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1789131146.669709:0:20099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1789131146.669726:0:20099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1789131146.669870:0:20099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1789131146.669899:0:20099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1789131146.669906:0:20099:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1789131146.670174:0:20099:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc860ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:20099:1876039508897152:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789131146.670254:0:20099:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131146.670336:0:20099:0:(client.c:2715:ptlrpc_set_wait()) set ffff91dcc85466c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789131146.670391:0:17766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508897152 00000100:00100000:2.0:1789131146.670399:0:17766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508897152 00000100:00100000:2.0:1789131146.670652:0:17766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1789131146.670663:0:17766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddfff17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+22:20099:x1876039508897152:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789131146.671026:0:17766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddfff17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+22:20099:x1876039508897152:12345-0@lo:501:mount.lustre.0 Request processed in 363us (770us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131146.671034:0:17766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1789131146.671241:0:20099:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc860ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:20099:1876039508897152:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789131146.671280:0:20099:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddca229a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:20099:1876039508897280:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789131146.671327:0:20099:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131146.671355:0:20099:0:(client.c:2715:ptlrpc_set_wait()) set ffff91dded3d5cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789131146.671402:0:17765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508897280 00000100:00100000:3.0:1789131146.671407:0:17765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508897280 00000100:00100000:3.0:1789131146.671489:0:17765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789131146.671505:0:17765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddfff15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+22:20099:x1876039508897280:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789131146.672240:0:17765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddfff15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+22:20099:x1876039508897280:12345-0@lo:503:mount.lustre.0 Request processed in 734us (910us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131146.672258:0:17765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1789131146.673383:0:20099:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddca229a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:20099:1876039508897280:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789131146.674237:0:20099:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789131146.674333:0:20099:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddca229a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:20099:1876039508897408:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789131146.674396:0:20099:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131146.674438:0:20099:0:(client.c:2715:ptlrpc_set_wait()) set ffff91dded3d5f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789131146.674678:0:17766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508897408 00000100:00100000:2.0:1789131146.674685:0:17766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508897408 00000100:00100000:2.0:1789131146.674719:0:17766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1789131146.674727:0:17766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddfff14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+22:20099:x1876039508897408:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789131146.677116:0:17766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddfff14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+22:20099:x1876039508897408:12345-0@lo:502:mount.lustre.0 Request processed in 2373us (2704us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131146.677142:0:17766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1789131146.677276:0:20099:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddca229a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:20099:1876039508897408:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789131146.677547:0:20099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1789131146.677578:0:20099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1789131146.677869:0:20099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1789131146.677886:0:20099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1789131146.677900:0:20099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1789131146.678221:0:20099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1789131146.678238:0:20099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1789131146.678251:0:20099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1789131146.678264:0:20099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:1.0:1789131146.678301:0:20099:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddca229a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:20099:1876039508897536:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789131146.678362:0:20099:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131146.678404:0:20099:0:(client.c:2715:ptlrpc_set_wait()) set ffff91dded3d5f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789131146.678718:0:17764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508897536 00000100:00100000:0.0:1789131146.678725:0:17764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508897536 00000100:00100000:0.0:1789131146.678775:0:17764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1789131146.678784:0:17764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddfff14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+22:20099:x1876039508897536:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789131146.678891:0:17764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddfff14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+22:20099:x1876039508897536:12345-0@lo:502:mount.lustre.0 Request processed in 108us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131146.678900:0:17764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1789131146.679212:0:20099:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddca229a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:20099:1876039508897536:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789131146.679265:0:20099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:1.0:1789131146.679274:0:20099:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:0.0:1789131146.680609:0:20103:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789131146.680618:0:20103:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:0.0:1789131146.680625:0:20103:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789131146.680627:0:20103:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1789131146.680633:0:20103:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789131146.680649:0:20103:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff91ddcf4c1a48) 00000020:00000080:0.0:1789131146.680673:0:20103:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:0.0:1789131146.680679:0:20103:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1789131146.680749:0:20103:0:(tgt_mount.c:153:server_get_mount()) get mount ffff91de01a79000 from lustre-OST0001, refs=2 00080000:01000000:0.0:1789131146.680758:0:20103:0:(osd_handler.c:8895:osd_obd_connect()) connect #1 00000020:00000080:0.0:1789131146.680764:0:20103:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xf3fe2838e1fc3632 00010000:00010000:0.0:1789131146.687833:0:20103:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:0.0:1789131146.688652:0:20103:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967325 00080000:10000000:0.0:1789131146.690720:0:20103:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:2.0:1789131146.693725:0:20103:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1789131146.693739:0:20103:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789131146.693746:0:20103:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789131146.693749:0:20103:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1789131146.693752:0:20103:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789131146.693756:0:20103:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789131146.693757:0:20103:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789131146.693760:0:20103:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789131146.693762:0:20103:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789131146.693764:0:20103:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789131146.693766:0:20103:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789131146.693768:0:20103:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:2.0:1789131146.693770:0:20103:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789131146.693772:0:20103:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789131146.693773:0:20103:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789131146.693776:0:20103:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1789131146.693797:0:20103:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789131146.693800:0:20103:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789131146.693801:0:20103:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789131146.693804:0:20103:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:0.0:1789131146.696553:0:20099:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:0.0:1789131146.696707:0:20099:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1789131146.696764:0:20099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff91dcc85cbe00/0xf3fe2838e1fc361d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc3624 expref: -99 pid: 20099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131146.696777:0:20099:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff91dcc85cbe00/0xf3fe2838e1fc361d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc3624 expref: -99 pid: 20099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789131146.696792:0:20099:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91de01a79000 from 1 10000000:01000000:0.0:1789131146.696796:0:20099:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789131146.696830:0:20099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff91de01ad6400/0xf3fe2838e1fc3639 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 20099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131146.696837:0:20099:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff91de01ad6400/0xf3fe2838e1fc3639 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 20099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131146.696847:0:20099:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff91de01ad6400/0xf3fe2838e1fc3639 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 20099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131146.696870:0:20099:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc860b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:20099:1876039508897664:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789131146.696956:0:20099:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131146.697014:0:20099:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddff84cc00 going to sleep for 11 seconds 00000100:00100000:3.0:1789131146.698035:0:17766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508897664 00000100:00100000:3.0:1789131146.698044:0:17766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508897664 00000100:00100000:3.0:1789131146.698101:0:17766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1789131146.698111:0:17766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddfff16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+22:20099:x1876039508897664:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789131146.698124:0:17766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789131146.698148:0:17766:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91ddfd0b4200/0xf3fe2838e1fc3640 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3fe2838e1fc3639 expref: -99 pid: 17766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131146.698173:0:17766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91ddfd0b4200/0xf3fe2838e1fc3640 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3fe2838e1fc3639 expref: 23 pid: 17766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131146.698196:0:17766:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91ddfd0b4200/0xf3fe2838e1fc3640 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc3639 expref: 23 pid: 17766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131146.698205:0:17766:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ddfd0b4200, rc 0) 00000100:00100000:3.0:1789131146.698259:0:17766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddfff16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+23:20099:x1876039508897664:12345-0@lo:101:mount.lustre.0 Request processed in 150us (1303us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131146.698266:0:17766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789131146.698490:0:20099:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc860b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:20099:1876039508897664:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789131146.698505:0:20099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff91de01ad6400/0xf3fe2838e1fc3639 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc3640 expref: -99 pid: 20099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131146.698514:0:20099:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff91de01ad6400/0xf3fe2838e1fc3639 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3fe2838e1fc3640 expref: -99 pid: 20099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789131146.703186:0:20099:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1789131146.703893:0:20099:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789131146.704109:0:20099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1789131146.704150:0:20099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1789131146.704171:0:20099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1789131146.704177:0:20099:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1789131146.704249:0:20099:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddca229a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:20099:1876039508897792:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789131146.704313:0:20099:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131146.704360:0:20099:0:(client.c:2715:ptlrpc_set_wait()) set ffff91dded3d56c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789131146.704503:0:17764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508897792 00000100:00100000:2.0:1789131146.704512:0:17764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508897792 00000100:00100000:2.0:1789131146.704557:0:17764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789131146.704567:0:17764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddfff16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+23:20099:x1876039508897792:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789131146.704676:0:17764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddfff16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+23:20099:x1876039508897792:12345-0@lo:501:mount.lustre.0 Request processed in 109us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131146.704683:0:17764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789131146.705073:0:20099:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddca229a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:20099:1876039508897792:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789131146.705108:0:20099:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddca229a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:20099:1876039508897920:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789131146.705152:0:20099:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131146.705180:0:20099:0:(client.c:2715:ptlrpc_set_wait()) set ffff91dded3d56c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789131146.705368:0:17765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508897920 00000100:00100000:2.0:1789131146.705373:0:17765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508897920 00000100:00100000:2.0:1789131146.705414:0:17765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1789131146.705421:0:17765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddfff17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+23:20099:x1876039508897920:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789131146.705531:0:17765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddfff17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+23:20099:x1876039508897920:12345-0@lo:503:mount.lustre.0 Request processed in 110us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131146.705539:0:17765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789131146.705785:0:20099:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddca229a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:20099:1876039508897920:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789131146.706269:0:20099:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789131146.706340:0:20099:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddca229a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:20099:1876039508898048:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789131146.706385:0:20099:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131146.706419:0:20099:0:(client.c:2715:ptlrpc_set_wait()) set ffff91dded3d56c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789131146.706493:0:17766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508898048 00000100:00100000:3.0:1789131146.706499:0:17766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508898048 00000100:00100000:3.0:1789131146.706529:0:17766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789131146.706536:0:17766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddfff15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+23:20099:x1876039508898048:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789131146.706737:0:17766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddfff15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+23:20099:x1876039508898048:12345-0@lo:502:mount.lustre.0 Request processed in 201us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131146.706744:0:17766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789131146.706831:0:20099:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddca229a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:20099:1876039508898048:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789131146.706996:0:20099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1789131146.707087:0:20099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1789131146.707105:0:20099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1789131146.707122:0:20099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1789131146.707213:0:20099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1789131146.707241:0:20099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1789131146.707257:0:20099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1789131146.707270:0:20099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 144 off9680 00000040:00080000:1.0:1789131146.707282:0:20099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9904 00000040:00080000:1.0:1789131146.707294:0:20099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10128 00000040:00080000:1.0:1789131146.707307:0:20099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 144 off10272 00000040:00080000:1.0:1789131146.707319:0:20099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10496 00000040:00080000:1.0:1789131146.707331:0:20099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10720 00000040:00080000:1.0:1789131146.707344:0:20099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 128 off10848 00000040:00080000:1.0:1789131146.707357:0:20099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off11072 00000040:00080000:1.0:1789131146.707369:0:20099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11296 00000040:00080000:1.0:1789131146.707381:0:20099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 128 off11424 00000100:00100000:1.0:1789131146.707403:0:20099:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddca229a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:20099:1876039508898176:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789131146.707443:0:20099:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131146.707535:0:17764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508898176 00000100:00100000:3.0:1789131146.707539:0:17764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508898176 00000100:00100000:1.0:1789131146.707632:0:20099:0:(client.c:2715:ptlrpc_set_wait()) set ffff91dded3d56c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789131146.707724:0:17764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1789131146.707733:0:17764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddfff16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+23:20099:x1876039508898176:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789131146.707813:0:17764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddfff16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+23:20099:x1876039508898176:12345-0@lo:502:mount.lustre.0 Request processed in 82us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131146.707820:0:17764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789131146.707880:0:20099:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddca229a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:20099:1876039508898176:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789131146.707928:0:20099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11648 00000040:00080000:1.0:1789131146.707937:0:20099:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 18 count 19 00000020:01000000:1.0:1789131146.708378:0:20107:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789131146.708386:0:20107:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789131146.708393:0:20107:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789131146.708400:0:20107:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff91de01a79000 00000020:00000080:1.0:1789131146.708402:0:20107:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789131146.708409:0:20107:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789131146.708411:0:20107:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789131146.708412:0:20107:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1789131146.708414:0:20107:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789131146.708415:0:20107:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789131146.708417:0:20107:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789131146.708419:0:20107:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff91de01a79000 00000020:00000080:1.0:1789131146.708421:0:20107:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789131146.708488:0:20107:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789131146.711210:0:20107:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789131146.711217:0:20107:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1789131146.711226:0:20107:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789131146.711232:0:20107:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789131146.711234:0:20107:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:0.0:1789131146.711239:0:20107:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff91de01a79000 00000020:00000080:0.0:1789131146.711242:0:20107:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789131146.711291:0:20107:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789131146.711294:0:20107:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789131146.711295:0:20107:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:0.0:1789131146.711298:0:20107:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789131146.711300:0:20107:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789131146.711301:0:20107:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre lod.lustre-MDT0001-mdtlov.enable_compr_rotational 00000020:01000000:0.0:1789131146.711304:0:20107:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff91de01a79000 00000020:00000080:0.0:1789131146.711307:0:20107:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789131146.711322:0:20107:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789131146.711325:0:20107:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789131146.711326:0:20107:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre lod.lustre-MDT0001-mdtlov.enable_compr_rotational 00000020:01000000:0.0:1789131146.711328:0:20107:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789131146.711330:0:20107:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789131146.711331:0:20107:0:(obd_config.c:1563:class_process_config()) marker 6 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789131146.711334:0:20107:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff91de01a79000 00000020:00000080:0.0:1789131146.711336:0:20107:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789131146.711350:0:20107:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789131146.711353:0:20107:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789131146.711354:0:20107:0:(obd_config.c:1563:class_process_config()) marker 6 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789131146.711356:0:20107:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789131146.711358:0:20107:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789131146.711359:0:20107:0:(obd_config.c:1563:class_process_config()) marker 7 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1789131146.711361:0:20107:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff91de01a79000 00000020:00000080:0.0:1789131146.711364:0:20107:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789131146.711398:0:20107:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789131146.711401:0:20107:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789131146.711403:0:20107:0:(obd_config.c:1563:class_process_config()) marker 7 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1789131146.711406:0:20107:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 19 count 19 00000020:01000000:1.0:1789131146.711576:0:20099:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-18 (rc=0) 10000000:01000000:1.0:1789131146.711672:0:20099:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789131146.711694:0:20099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff91de01ad6400/0xf3fe2838e1fc3639 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc3640 expref: -99 pid: 20099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131146.711706:0:20099:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff91de01ad6400/0xf3fe2838e1fc3639 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc3640 expref: -99 pid: 20099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789131146.711755:0:20099:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789131146.711758:0:20099:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff91de01a79000 10000000:01000000:1.0:1789131146.711761:0:20099:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff91de01a79000 10000000:01000000:1.0:1789131146.711765:0:20099:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789131146.711770:0:20099:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff91de01a79000 from 1 10000000:01000000:1.0:1789131146.711773:0:20099:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789131146.711806:0:20099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff91dcc85ca200/0xf3fe2838e1fc3647 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 20099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131146.711815:0:20099:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff91dcc85ca200/0xf3fe2838e1fc3647 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 20099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131146.711836:0:20099:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff91dcc85ca200/0xf3fe2838e1fc3647 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 20099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131146.711859:0:20099:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddca229a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:20099:1876039508898304:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789131146.711934:0:20099:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131146.712124:0:20099:0:(client.c:2715:ptlrpc_set_wait()) set ffff91dded3d5e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789131146.714097:0:17765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508898304 00000100:00100000:2.0:1789131146.714245:0:17765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508898304 00000100:00100000:2.0:1789131146.714333:0:17766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789131146.714342:0:17766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddfff14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+23:20099:x1876039508898304:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789131146.714415:0:17766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789131146.714432:0:17766:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91dcc7f7ea00/0xf3fe2838e1fc364e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3fe2838e1fc3647 expref: -99 pid: 17766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131146.714487:0:17766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91dcc7f7ea00/0xf3fe2838e1fc364e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3fe2838e1fc3647 expref: 24 pid: 17766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131146.714498:0:17766:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91dcc7f7ea00/0xf3fe2838e1fc364e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc3647 expref: 24 pid: 17766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131146.714507:0:17766:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dcc7f7ea00, rc 0) 00000100:00100000:2.0:1789131146.714580:0:17766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddfff14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+24:20099:x1876039508898304:12345-0@lo:101:mount.lustre.0 Request processed in 239us (2646us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131146.714586:0:17766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789131146.715585:0:20099:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddca229a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:20099:1876039508898304:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789131146.715884:0:20099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff91dcc85ca200/0xf3fe2838e1fc3647 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc364e expref: -99 pid: 20099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131146.715896:0:20099:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff91dcc85ca200/0xf3fe2838e1fc3647 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3fe2838e1fc364e expref: -99 pid: 20099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789131146.721708:0:20099:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000040:00080000:0.0:1789131146.722000:0:20099:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789131146.722864:0:20099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1789131146.722893:0:20099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1789131146.722909:0:20099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1789131146.722948:0:20099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1789131146.722963:0:20099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1789131146.722977:0:20099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1789131146.722992:0:20099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1789131146.724109:0:20099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1789131146.724221:0:20099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1789131146.724238:0:20099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1789131146.724252:0:20099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1789131146.724266:0:20099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1789131146.724278:0:20099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1789131146.724291:0:20099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1789131146.724304:0:20099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1789131146.724318:0:20099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1789131146.724331:0:20099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1789131146.724344:0:20099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1789131146.724358:0:20099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1789131146.724371:0:20099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1789131146.724384:0:20099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1789131146.724398:0:20099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1789131146.724413:0:20099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1789131146.724431:0:20099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1789131146.724478:0:20099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:0.0:1789131146.724498:0:20099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:0.0:1789131146.724512:0:20099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:0.0:1789131146.724527:0:20099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:0.0:1789131146.724539:0:20099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:0.0:1789131146.724554:0:20099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:0.0:1789131146.724567:0:20099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:0.0:1789131146.725069:0:20099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:0.0:1789131146.725096:0:20099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:0.0:1789131146.725113:0:20099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:0.0:1789131146.725205:0:20099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:0.0:1789131146.725227:0:20099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:0.0:1789131146.725252:0:20099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:0.0:1789131146.725269:0:20099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:0.0:1789131146.725283:0:20099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14912 00000040:00080000:0.0:1789131146.725298:0:20099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 88 off15000 00000040:00080000:0.0:1789131146.725325:0:20099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 128 off15128 00000040:00080000:0.0:1789131146.725342:0:20099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 144 off15272 00000040:00080000:0.0:1789131146.725357:0:20099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 128 off15400 00000040:00080000:0.0:1789131146.725374:0:20099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 224 off15624 00000040:00080000:0.0:1789131146.725388:0:20099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off15848 00000040:00080000:0.0:1789131146.725401:0:20099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].46, 80 off15928 00000040:00080000:0.0:1789131146.725428:0:20099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].47, 224 off16152 00000040:00080000:0.0:1789131146.725434:0:20099:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 47 count 48 00000100:00100000:1.0:1789131146.726100:0:20099:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc860b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:20099:1876039508898432:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789131146.726185:0:20099:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131146.726234:0:20099:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddc4ccf000 going to sleep for 11 seconds 00000100:00100000:0.0:1789131146.726350:0:17766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508898432 00000100:00100000:0.0:1789131146.726358:0:17766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508898432 00000100:00100000:0.0:1789131146.726412:0:17766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789131146.726421:0:17766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddfff15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+24:20099:x1876039508898432:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789131146.726571:0:17766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddfff15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+24:20099:x1876039508898432:12345-0@lo:501:mount.lustre.0 Request processed in 151us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131146.726578:0:17766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789131146.727192:0:20099:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc860b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:20099:1876039508898432:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789131146.727234:0:20099:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddca228f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:20099:1876039508898560:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789131146.727280:0:20099:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131146.727311:0:20099:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddc4ccf000 going to sleep for 11 seconds 00000100:00100000:0.0:1789131146.727423:0:17766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508898560 00000100:00100000:0.0:1789131146.727428:0:17766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508898560 00000100:00100000:1.0:1789131146.727682:0:17765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789131146.727691:0:17765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddfff17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+24:20099:x1876039508898560:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789131146.727780:0:17765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddfff17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+24:20099:x1876039508898560:12345-0@lo:503:mount.lustre.0 Request processed in 91us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131146.727787:0:17765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789131146.727831:0:20099:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddca228f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:20099:1876039508898560:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789131146.728938:0:20099:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789131146.730238:0:20099:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddca228f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:20099:1876039508898688:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789131146.730308:0:20099:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131146.730345:0:17765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508898688 00000100:00100000:1.0:1789131146.730357:0:17765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508898688 00000100:00100000:1.0:1789131146.730399:0:17765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789131146.730406:0:17765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddfff17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+24:20099:x1876039508898688:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789131146.730527:0:17765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddfff17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+24:20099:x1876039508898688:12345-0@lo:502:mount.lustre.0 Request processed in 120us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131146.730535:0:17765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789131146.731533:0:20099:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddc302a900 going to sleep for 11 seconds 00000100:00100000:1.0:1789131146.731564:0:20099:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddca228f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:20099:1876039508898688:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789131146.731902:0:20099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1789131146.731944:0:20099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1789131146.731959:0:20099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1789131146.731973:0:20099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1789131146.731988:0:20099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1789131146.732002:0:20099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1789131146.732028:0:20099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1789131146.732041:0:20099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1789131146.732055:0:20099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1789131146.732069:0:20099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1789131146.732083:0:20099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1789131146.732111:0:20099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1789131146.732138:0:20099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1789131146.732155:0:20099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1789131146.732167:0:20099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1789131146.732180:0:20099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1789131146.732191:0:20099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1789131146.732202:0:20099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1789131146.732214:0:20099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1789131146.732226:0:20099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1789131146.732239:0:20099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1789131146.732251:0:20099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1789131146.732276:0:20099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1789131146.732289:0:20099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1789131146.732301:0:20099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:1.0:1789131146.732313:0:20099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:1.0:1789131146.732327:0:20099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:1.0:1789131146.732353:0:20099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:1.0:1789131146.732368:0:20099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:1.0:1789131146.732380:0:20099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:1.0:1789131146.732394:0:20099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:1.0:1789131146.732405:0:20099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:1.0:1789131146.732417:0:20099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:1.0:1789131146.732429:0:20099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:1.0:1789131146.732442:0:20099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:1.0:1789131146.732455:0:20099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:1.0:1789131146.732497:0:20099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:1.0:1789131146.732511:0:20099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:1.0:1789131146.732525:0:20099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:1.0:1789131146.732539:0:20099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:1.0:1789131146.732551:0:20099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:1.0:1789131146.732563:0:20099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:1.0:1789131146.732575:0:20099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:1.0:1789131146.732617:0:20099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:1.0:1789131146.732633:0:20099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:1.0:1789131146.732646:0:20099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:1.0:1789131146.732660:0:20099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:1.0:1789131146.732675:0:20099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:1.0:1789131146.732720:0:20099:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddca228f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:20099:1876039508898816:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789131146.732785:0:20099:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131146.732823:0:20099:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddc302a900 going to sleep for 11 seconds 00000100:00100000:3.0:1789131146.737154:0:17764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508898816 00000100:00100000:3.0:1789131146.737169:0:17764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508898816 00000100:00100000:3.0:1789131146.737239:0:17764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789131146.737249:0:17764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddfff16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+24:20099:x1876039508898816:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789131146.737406:0:17764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddfff16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+24:20099:x1876039508898816:12345-0@lo:502:mount.lustre.0 Request processed in 159us (4621us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131146.737421:0:17764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789131146.739263:0:20099:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddca228f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:20099:1876039508898816:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789131146.739770:0:20099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:1.0:1789131146.739808:0:20099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:1.0:1789131146.739845:0:20099:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddca228f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:20099:1876039508898944:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789131146.739909:0:20099:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131146.739955:0:17766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508898944 00000100:00100000:1.0:1789131146.739961:0:17766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508898944 00000100:00100000:1.0:1789131146.740015:0:17766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789131146.740024:0:17766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddfff15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+24:20099:x1876039508898944:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789131146.740124:0:17766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddfff15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+24:20099:x1876039508898944:12345-0@lo:502:mount.lustre.0 Request processed in 100us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131146.740264:0:17766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789131146.740315:0:20099:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddc302a900 going to sleep for 11 seconds 00000100:00100000:1.0:1789131146.740329:0:20099:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddca228f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:20099:1876039508898944:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789131146.740368:0:20099:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:1.0:1789131146.740375:0:20099:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1789131146.745827:0:20112:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1789131146.745844:0:20112:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff91ddfcdfced8) 00000020:00000080:2.0:1789131146.745869:0:20112:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:2.0:1789131146.745986:0:20112:0:(tgt_mount.c:153:server_get_mount()) get mount ffff91de01a79000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789131146.745991:0:20112:0:(tgt_mount.c:187:server_put_mount()) put mount ffff91de01a79000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789131146.745994:0:20112:0:(obd_mount.c:710:lustre_put_lsi()) put ffff91de01a79000 3 00010000:00080000:2.0:1789131146.746700:0:20112:0:(ldlm_lib.c:102:import_set_conn()) imp ffff91dcc5f33800@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.111@tcp at head 00010000:00010000:2.0:1789131146.753801:0:20112:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:2.0:1789131146.755326:0:20112:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1789131146.755374:0:20112:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789131146.755387:0:20112:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xf3fe2838e1fc365c 00000100:00080000:2.0:1789131146.755398:0:20112:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789131146.755404:0:20112:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff91dcc5f33800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:2.0:1789131146.755449:0:20112:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91dcc7893840 x1876039508899072/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789131146.756656:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7893840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3624:1876039508899072:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789131146.756731:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131146.756799:0:17772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508899072 00000100:00100000:2.0:1789131146.756806:0:17772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508899072 00000100:00100000:2.0:1789131146.756848:0:17772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789131146.756856:0:17772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7890000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3624:x1876039508899072:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1789131146.756885:0:17772:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 502 last 0 00000020:00000080:2.0:1789131146.758310:0:17772:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xf3fe2838e1fc3663 00000004:00100000:2.0:1789131146.758334:0:17772:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789131146.758378:0:17772:0:(import.c:65:import_set_state_nolock()) ffff91dcc5f31800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789131146.758470:0:17772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7890000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3624:x1876039508899072:12345-0@lo:38:llog_process_th.0 Request processed in 1599us (1726us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131146.758486:0:17772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1789131146.759750:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91dcc7893840 x1876039508899072/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789131156 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789131146.759764:0:3624:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789131146.759773:0:3624:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:2.0:1789131146.759781:0:3624:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1789131146.759785:0:3624:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789131146.759788:0:3624:0:(import.c:65:import_set_state_nolock()) ffff91dcc5f33800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789131146.759795:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7893840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3624:1876039508899072:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1789131146.759819:0:20112:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1789131146.759880:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789131146.759885:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789131146.759887:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789131146.759890:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789131146.759933:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789131146.759936:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789131146.759938:0:8:0:(import.c:65:import_set_state_nolock()) ffff91ddff618800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789131146.759942:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 500 00000100:00080000:2.0:1789131146.759947:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1789131146.759951:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff91ddff618800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:2.0:1789131146.759969:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91ddca0c43c0 x1876039508899712/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789131146.760688:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7893840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1876039508899200:0@lo:400:kworker.0 00000100:00100000:2.0:1789131146.760753:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131146.760782:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddca0c61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3627:1876039508899840:0@lo:400:kworker.0 00000100:00100000:2.0:1789131146.760804:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131146.760826:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789131146.760832:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7892580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3627:1876039508899328:0@lo:400:kworker.0 00000100:00100000:2.0:1789131146.760853:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131146.760867:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddca0c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3627:1876039508899968:0@lo:400:kworker.0 00000100:00100000:2.0:1789131146.760887:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131146.760924:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7891e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508899456:0@lo:400:kworker.0 00000100:00100000:2.0:1789131146.760949:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131146.760966:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddca0c6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3625:1876039508900096:0@lo:400:kworker.0 00000100:00100000:2.0:1789131146.760987:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131146.762540:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789131146.762561:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7ffcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508899584:0@lo:400:kworker.0 00000100:00100000:2.0:1789131146.762758:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131146.762835:0:17776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508899200 00000100:00100000:2.0:1789131146.762843:0:17776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508899200 00000100:00100000:2.0:1789131146.762893:0:17776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508899456 00000100:00100000:2.0:1789131146.762896:0:17776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508899456 00000100:00100000:2.0:1789131146.762943:0:17776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789131146.762951:0:17776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddca0c5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1876039508899200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789131146.763213:0:19981:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508899584 00000100:00100000:1.0:1789131146.763217:0:19981:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508899584 00000100:00080000:0.0:1789131146.763251:0:17767:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789131146.763272:0:19981:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789131146.763281:0:19981:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd286d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508899584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131146.763323:0:17776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddca0c5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1876039508899200:12345-0@lo:400:kworker.0 Request processed in 371us (2568us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131146.763331:0:17776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789131146.763348:0:17776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789131146.763354:0:17776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd286e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508899456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789131146.763424:0:19981:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd286d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508899584:12345-0@lo:400:kworker.0 Request processed in 145us (666us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131146.763431:0:19981:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789131146.767287:0:17776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd286e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508899456:12345-0@lo:400:kworker.0 Request processed in 3925us (6328us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131146.767301:0:17776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789131146.767348:0:17773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508899840 00000100:00100000:2.0:1789131146.767356:0:17773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508899840 00000100:00100000:2.0:1789131146.767384:0:17773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508899328 00000100:00100000:2.0:1789131146.767387:0:17773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508899328 00000100:00100000:2.0:1789131146.767399:0:17773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508899968 00000100:00100000:2.0:1789131146.767401:0:17773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508899968 00000100:00100000:2.0:1789131146.767430:0:17773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508900096 00000100:00100000:2.0:1789131146.767433:0:17773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508900096 00000100:00100000:2.0:1789131146.767449:0:17773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789131146.767472:0:17773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddca0c6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1876039508899840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131146.768831:0:17773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddca0c6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1876039508899840:12345-0@lo:400:kworker.0 Request processed in 1370us (8021us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131146.768841:0:17773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789131146.768863:0:17773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789131146.768871:0:17773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddca0c4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1876039508899328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131146.768904:0:17773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddca0c4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1876039508899328:12345-0@lo:400:kworker.0 Request processed in 34us (8049us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131146.768910:0:17773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789131146.768936:0:17773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789131146.768943:0:17773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddca0c7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1876039508899968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131146.768970:0:17773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddca0c7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1876039508899968:12345-0@lo:400:kworker.0 Request processed in 28us (8082us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131146.768975:0:17773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789131146.768986:0:17773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789131146.769204:0:17773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd286da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1876039508900096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131146.769253:0:17773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd286da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1876039508900096:12345-0@lo:400:kworker.0 Request processed in 253us (8264us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131146.769259:0:17773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:2.0:1789131146.769300:0:17767:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789131146.769305:0:17767:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789131146.769342:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddca0c43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3624:1876039508899712:0@lo:8:kworker.0 00000100:00100000:2.0:1789131146.769379:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131146.769423:0:19283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508899712 00000100:00100000:2.0:1789131146.769429:0:19283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508899712 00000100:00100000:2.0:1789131146.769455:0:19283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789131146.771120:0:19283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd286cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3624:x1876039508899712:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1789131146.771210:0:19283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd286cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3624:x1876039508899712:12345-0@lo:8:kworker.0 Request processed in 95us (1829us total) trans 0 rc -11/-11 00000100:00100000:2.0:1789131146.771217:0:19283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1789131146.771279:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91dcc7892580 x1876039508899328/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789131162 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789131146.771294:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7892580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3627:1876039508899328:0@lo:400:kworker.0 00010000:00080000:2.0:1789131146.771306:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91ddca0c4000 x1876039508899968/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789131162 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789131146.771314:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddca0c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3627:1876039508899968:0@lo:400:kworker.0 00000100:00100000:2.0:1789131146.771325:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7893840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1876039508899200:0@lo:400:kworker.0 00010000:00080000:2.0:1789131146.771335:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91ddca0c61c0 x1876039508899840/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789131162 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789131146.771343:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddca0c61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3627:1876039508899840:0@lo:400:kworker.0 00010000:00080000:2.0:1789131146.771389:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91dcc7ffcf00 x1876039508899584/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789131162 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789131146.771398:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7ffcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508899584:0@lo:400:kworker.0 00000100:00100000:2.0:1789131146.771408:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7891e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508899456:0@lo:400:kworker.0 00010000:00080000:2.0:1789131146.771417:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91ddca0c6940 x1876039508900096/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789131162 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789131146.771424:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddca0c6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3625:1876039508900096:0@lo:400:kworker.0 00000100:00100000:0.0:1789131146.771564:0:3624:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789131146.771572:0:3624:0:(import.c:65:import_set_state_nolock()) ffff91ddff618800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789131146.771576:0:3624:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1789131146.771579:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddca0c43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3624:1876039508899712:0@lo:8:kworker.0 00000020:01000004:2.0:1789131146.772684:0:20112:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1789131146.772700:0:20112:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff91ddfcdfb490) 00000020:00000080:2.0:1789131146.772722:0:20112:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:2.0:1789131146.772798:0:20112:0:(tgt_mount.c:153:server_get_mount()) get mount ffff91de01a79000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789131146.772803:0:20112:0:(tgt_mount.c:187:server_put_mount()) put mount ffff91de01a79000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789131146.772805:0:20112:0:(obd_mount.c:710:lustre_put_lsi()) put ffff91de01a79000 3 00010000:00080000:2.0:1789131146.772834:0:20112:0:(ldlm_lib.c:102:import_set_conn()) imp ffff91dcc5f32800@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.111@tcp at head 00010000:00010000:1.0:1789131146.781888:0:20112:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:1.0:1789131146.782107:0:20112:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:1.0:1789131146.782172:0:20112:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789131146.782185:0:20112:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xf3fe2838e1fc3671 00000100:00080000:1.0:1789131146.782195:0:20112:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789131146.782201:0:20112:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff91dcc5f32800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:1.0:1789131146.782239:0:20112:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91ddca228f00 x1876039508900224/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789131146.782483:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddca228f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3624:1876039508900224:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789131146.782556:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131146.782788:0:17773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508900224 00000100:00100000:2.0:1789131146.782796:0:17773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508900224 00000100:00100000:2.0:1789131146.782833:0:17773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789131146.782841:0:17773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd1dad680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3624:x1876039508900224:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1789131146.782873:0:17773:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 502 last 0 00000020:00000080:2.0:1789131146.782913:0:17773:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xf3fe2838e1fc3678 00000004:00100000:2.0:1789131146.782939:0:17773:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789131146.782976:0:17773:0:(import.c:65:import_set_state_nolock()) ffff91dcc5f37000 : changing import state from RECOVER to FULL 00000100:00080000:1.0:1789131146.786140:0:20112:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1789131146.786143:0:17773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd1dad680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1876039508900224:12345-0@lo:38:llog_process_th.0 Request processed in 3282us (3568us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131146.786155:0:17773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:2.0:1789131146.786202:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789131146.786208:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789131146.786210:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789131146.786213:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:1.0:1789131146.786741:0:20112:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:1.0:1789131146.786797:0:20099:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1789131146.786826:0:20099:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789131146.786848:0:20099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff91dcc85ca200/0xf3fe2838e1fc3647 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc364e expref: -99 pid: 20099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131146.786859:0:20099:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff91dcc85ca200/0xf3fe2838e1fc3647 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc364e expref: -99 pid: 20099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789131146.786909:0:20099:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789131146.786912:0:20099:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789131146.786922:0:20099:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789131146.786924:0:20099:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789131146.786925:0:20099:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789131146.786927:0:20099:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789131146.786928:0:20099:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789131146.786930:0:20099:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789131146.786931:0:20099:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789131146.786935:0:20099:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:1.0:1789131146.786938:0:20099:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789131146.786939:0:20099:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789131146.786940:0:20099:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789131146.786941:0:20099:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789131146.786942:0:20099:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789131146.786943:0:20099:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789131146.786944:0:20099:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789131146.786945:0:20099:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789131146.786946:0:20099:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789131146.786971:0:20099:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1789131146.786988:0:20099:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddca228000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:20099:1876039508900352:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789131146.787066:0:20099:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131146.787113:0:20099:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddd029a780 going to sleep for 11 seconds 00000100:00100000:3.0:1789131146.788062:0:17765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508900352 00000100:00100000:3.0:1789131146.788071:0:17765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508900352 00000100:00100000:3.0:1789131146.788157:0:17765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1789131146.788167:0:17765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dde1d3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+24:20099:x1876039508900352:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789131146.788193:0:17765:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1789131146.788206:0:17765:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:3.0:1789131146.788327:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91ddca228f00 x1876039508900224/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789131156 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789131146.788338:0:3624:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789131146.788348:0:3624:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 2 00000100:00080000:3.0:1789131146.788354:0:3624:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789131146.788358:0:3624:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1789131146.788361:0:3624:0:(import.c:65:import_set_state_nolock()) ffff91dcc5f32800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789131146.788368:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddca228f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3624:1876039508900224:0@lo:38:llog_process_th.0 20000000:01000000:2.0:1789131146.805551:0:17765:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789131146.805580:0:17765:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1789131146.805609:0:17787:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789131146.805615:0:17787:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789131146.805637:0:17787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91ddfd0b5a00/0xf3fe2838e1fc367f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131146.805655:0:17787:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91dcc85cac00/0xf3fe2838e1fc35f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc35ec expref: 24 pid: 17764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131146.805663:0:17787:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91ddfd0b5400/0xf3fe2838e1fc3601 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc35fa expref: 24 pid: 17766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131146.805683:0:17787:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91ddfd0b5a00/0xf3fe2838e1fc367f lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131146.805720:0:17787:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91ddfd0b5400/0xf3fe2838e1fc3601 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf3fe2838e1fc35fa expref: 24 pid: 17766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131146.805733:0:17787:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91ddfd0b5400/0xf3fe2838e1fc3601 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf3fe2838e1fc35fa expref: 24 pid: 17766 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131146.805747:0:17787:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd1daed00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17787:1876039508900480:0@lo:104: 00000100:00100000:3.0:1789131146.805809:0:17787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789131146.805862:0:17787:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91dcc85cac00/0xf3fe2838e1fc35f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf3fe2838e1fc35ec expref: 24 pid: 17764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131146.805869:0:17787:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91dcc85cac00/0xf3fe2838e1fc35f3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf3fe2838e1fc35ec expref: 24 pid: 17764 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131146.805877:0:17787:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd1dac780 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17787:1876039508900608:0@lo:104: 00000100:00100000:3.0:1789131146.805898:0:17787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131146.805930:0:17787:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddf5cb49c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789131146.807019:0:17755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508900480 00000100:00100000:2.0:1789131146.807027:0:17755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508900480 00000100:00100000:2.0:1789131146.807062:0:17755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508900608 00000100:00100000:2.0:1789131146.807064:0:17755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508900608 00000100:00100000:2.0:1789131146.807078:0:17755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789131146.807086:0:17755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd1dafc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+4:17787:x1876039508900480:12345-0@lo:104: 00010000:00010000:2.0:1789131146.807100:0:17755:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff91de01ad7a00/0xf3fe2838e1fc35fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3fe2838e1fc3601 expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131146.807164:0:17755:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789131146.807169:0:17755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd1dafc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+4:17787:x1876039508900480:12345-0@lo:104: Request processed in 85us (1361us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131146.807176:0:17755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789131146.807191:0:17755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789131146.807196:0:17755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd1dac3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+3:17787:x1876039508900608:12345-0@lo:104: 00010000:00010000:2.0:1789131146.807203:0:17755:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff91de01ad6600/0xf3fe2838e1fc35ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3fe2838e1fc35f3 expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131146.807230:0:17755:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789131146.807235:0:17755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd1dac3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+3:17787:x1876039508900608:12345-0@lo:104: Request processed in 39us (1337us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131146.807253:0:17755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:2.0:1789131146.807269:0:19311:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789131146.807276:0:19311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff91de01ad7a00/0xf3fe2838e1fc35fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3fe2838e1fc3601 expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131146.807283:0:19311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91de01ad7a00 already unused, calling callback (ffffffffc124bc20) 10000000:00010000:2.0:1789131146.807288:0:19311:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff91de01ad7a00/0xf3fe2838e1fc35fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf3fe2838e1fc3601 expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131146.807297:0:19311:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff91de01ad7a00/0xf3fe2838e1fc35fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf3fe2838e1fc3601 expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789131146.807304:0:19311:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff91de01ad7a00/0xf3fe2838e1fc35fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf3fe2838e1fc3601 expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789131146.807310:0:19311:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789131146.807337:0:19311:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff91de01ad7a00/0xf3fe2838e1fc35fa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc3601 expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131146.807342:0:19311:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789131146.807369:0:19311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff91de01ad7a00/0xf3fe2838e1fc35fa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc3601 expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131146.807377:0:19311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff91de01ad7a00/0xf3fe2838e1fc35fa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc3601 expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131146.807391:0:19311:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789131146.807394:0:19311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff91de01ad6600/0xf3fe2838e1fc35ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3fe2838e1fc35f3 expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131146.807409:0:19311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91de01ad6600 already unused, calling callback (ffffffffc124bc20) 10000000:00010000:2.0:1789131146.807412:0:19311:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff91de01ad6600/0xf3fe2838e1fc35ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf3fe2838e1fc35f3 expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131146.807419:0:19311:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff91de01ad6600/0xf3fe2838e1fc35ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf3fe2838e1fc35f3 expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789131146.807425:0:19311:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff91de01ad6600/0xf3fe2838e1fc35ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf3fe2838e1fc35f3 expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789131146.807430:0:19311:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789131146.807444:0:19311:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff91de01ad6600/0xf3fe2838e1fc35ec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc35f3 expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131146.807449:0:19311:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789131146.807480:0:19311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff91de01ad6600/0xf3fe2838e1fc35ec lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc35f3 expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131146.807487:0:19311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff91de01ad6600/0xf3fe2838e1fc35ec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc35f3 expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131146.807500:0:19311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131146.807502:0:19311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131146.807503:0:19311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131146.807509:0:17759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789131146.807526:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd286c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:3626:1876039508900736:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789131146.807562:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131146.807599:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd286d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:3627:1876039508900864:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789131146.807630:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131146.807664:0:18530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508900736 00000100:00100000:2.0:1789131146.807668:0:18530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508900736 00010000:00010000:2.0:1789131146.807686:0:18530:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91ddfd0b5400/0xf3fe2838e1fc3601 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3fe2838e1fc35fa expref: 25 pid: 17766 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131146.807705:0:18530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508900864 00000100:00100000:2.0:1789131146.807708:0:18530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508900864 00010000:00010000:2.0:1789131146.807717:0:18530:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91dcc85cac00/0xf3fe2838e1fc35f3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3fe2838e1fc35ec expref: 26 pid: 17764 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131146.807733:0:18530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789131146.807738:0:18530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd286c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+26:3626:x1876039508900736:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789131146.807747:0:18530:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789131146.807751:0:18530:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91ddfd0b5400/0xf3fe2838e1fc3601 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3fe2838e1fc35fa expref: 26 pid: 17766 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131146.807761:0:18530:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91ddfd0b5400/0xf3fe2838e1fc3601 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf3fe2838e1fc35fa expref: 26 pid: 17766 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131146.807777:0:18530:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789131146.807799:0:18530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd286c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+26:3626:x1876039508900736:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131146.807805:0:18530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789131146.807817:0:18530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789131146.807823:0:18530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7ffcf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+25:3627:x1876039508900864:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789131146.807829:0:18530:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789131146.807833:0:18530:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91dcc85cac00/0xf3fe2838e1fc35f3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3fe2838e1fc35ec expref: 25 pid: 17764 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131146.807851:0:18530:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91dcc85cac00/0xf3fe2838e1fc35f3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf3fe2838e1fc35ec expref: 25 pid: 17764 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131146.807862:0:18530:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91ddfd0b5a00/0xf3fe2838e1fc367f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131146.807871:0:18530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91ddfd0b5a00/0xf3fe2838e1fc367f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789131146.807883:0:18530:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.013495106s 00010000:00010000:2.0:1789131146.807887:0:18530:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91ddfd0b5a00/0xf3fe2838e1fc367f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131146.807895:0:18530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91ddfd0b5a00/0xf3fe2838e1fc367f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131146.807902:0:18530:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91ddfd0b5a00/0xf3fe2838e1fc367f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131146.807909:0:18530:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91ddfd0b5a00/0xf3fe2838e1fc367f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131146.808086:0:18530:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddfd0b5a00 already unused, calling callback (ffffffffc0c4e550) 00010000:00010000:2.0:1789131146.808090:0:18530:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91ddfd0b5a00/0xf3fe2838e1fc367f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131146.808098:0:18530:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91ddfd0b5a00/0xf3fe2838e1fc367f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131146.808106:0:18530:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91ddfd0b5a00/0xf3fe2838e1fc367f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131146.808123:0:18530:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789131146.808151:0:18530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7ffcf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+25:3627:x1876039508900864:12345-0@lo:103:ldlm_bl.0 Request processed in 328us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131146.808157:0:18530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789131146.808198:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd286d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:3627:1876039508900864:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789131146.808221:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd286c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:3626:1876039508900736:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789131146.808241:0:17787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91ddfd0b5400/0xf3fe2838e1fc3601 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf3fe2838e1fc35fa expref: 24 pid: 17766 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131146.808252:0:17787:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd1daed00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17787:1876039508900480:0@lo:104: 00010000:00010000:2.0:1789131146.808261:0:17787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91dcc85cac00/0xf3fe2838e1fc35f3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf3fe2838e1fc35ec expref: 23 pid: 17764 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131146.808270:0:17787:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd1dac780 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17787:1876039508900608:0@lo:104: 00010000:00010000:2.0:1789131146.808284:0:17787:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91ddfd0b5a00/0xf3fe2838e1fc367f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131146.808291:0:17787:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91ddfd0b5a00/0xf3fe2838e1fc367f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131146.808297:0:17787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91ddfd0b5a00/0xf3fe2838e1fc367f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131146.808302:0:17787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91ddfd0b5a00/0xf3fe2838e1fc367f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131146.808532:0:17765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dde1d3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+22:20099:x1876039508900352:12345-0@lo:253:mount.lustre.0 Request processed in 20366us (21466us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131146.808542:0:17765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789131146.809498:0:20099:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddca228000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:20099:1876039508900352:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789131146.809521:0:20099:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1789131146.809524:0:20099:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789131146.809526:0:20099:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789131146.809527:0:20099:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789131146.809529:0:20099:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789131146.809530:0:20099:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789131146.809532:0:20099:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789131146.809533:0:20099:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789131146.809535:0:20099:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789131146.809536:0:20099:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789131146.809547:0:20099:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000001:00000004:1.0:1789131146.829976:0:20099:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1789131146.834048:0:20099:0:(ofd_obd.c:543:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1789131146.834058:0:20099:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1789131146.834096:0:20099:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1789131146.834138:0:20099:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.111@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1789131146.834159:0:20099:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=50 00000080:00000004:1.0:1789131146.834178:0:20099:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:1.0:1789131146.835106:0:20099:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789131146.835331:0:20099:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789131147.289983:0:17760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789131147.708287:0:20168:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789131147.708626:0:20168:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:0.0:1789131148.243675:0:17768:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789131148.243682:0:17768:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff91ddf34a7800 from 10 10000000:01000000:0.0:1789131148.243687:0:17768:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789131148.243737:0:17768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff91de01ad6e00/0xf3fe2838e1fc3686 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131148.243756:0:17768:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff91de01ad6e00/0xf3fe2838e1fc3686 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131148.243767:0:17768:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff91de01ad6e00/0xf3fe2838e1fc3686 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131148.243793:0:17768:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8609e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:17768:1876039508900992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789131148.244685:0:17768:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131148.244735:0:17768:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddff84ce40 going to sleep for 11 seconds 00000100:00100000:1.0:1789131148.244947:0:17764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508900992 00000100:00100000:1.0:1789131148.244955:0:17764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508900992 00000100:00100000:1.0:1789131148.245053:0:17764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789131148.245062:0:17764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dde1d3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+22:17768:x1876039508900992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789131148.245077:0:17764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789131148.245092:0:17764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91dcc85cb200/0xf3fe2838e1fc368d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3fe2838e1fc3686 expref: -99 pid: 17764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131148.245125:0:17764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91dcc85cb200/0xf3fe2838e1fc368d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3fe2838e1fc3686 expref: 23 pid: 17764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131148.245136:0:17764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91dcc85cb200/0xf3fe2838e1fc368d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc3686 expref: 23 pid: 17764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131148.245145:0:17764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dcc85cb200, rc 0) 00000100:00100000:1.0:1789131148.245199:0:17764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dde1d3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+23:17768:x1876039508900992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 138us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131148.245206:0:17764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789131148.245277:0:17768:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8609e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:17768:1876039508900992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789131148.245292:0:17768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff91de01ad6e00/0xf3fe2838e1fc3686 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc368d expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131148.245301:0:17768:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff91de01ad6e00/0xf3fe2838e1fc3686 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3fe2838e1fc368d expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131148.245359:0:17768:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8609e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:17768:1876039508901120:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1789131148.245393:0:17768:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131148.247656:0:17768:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddff84ce40 going to sleep for 11 seconds 00000100:00100000:3.0:1789131148.247774:0:17766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508901120 00000100:00100000:3.0:1789131148.247783:0:17766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508901120 00000100:00100000:3.0:1789131148.247826:0:17766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1789131148.247834:0:17766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc7057c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+23:17768:x1876039508901120:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1789131148.247934:0:17766:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789131148.247950:0:17766:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789131148.247953:0:17766:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:3.0:1789131148.248270:0:17766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc7057c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+23:17768:x1876039508901120:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 435us (2875us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131148.248279:0:17766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789131148.251960:0:17768:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8609e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:17768:1876039508901120:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1789131148.252097:0:17768:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789131148.252108:0:17768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff91de01ad6e00/0xf3fe2838e1fc3686 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc368d expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131148.252192:0:17768:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff91de01ad6e00/0xf3fe2838e1fc3686 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc368d expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789131148.252217:0:17768:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789131148.252219:0:17768:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff91dcc78a7000 from 10 10000000:01000000:0.0:1789131148.252222:0:17768:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789131148.252255:0:17768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff91de01ad7400/0xf3fe2838e1fc3694 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131148.252263:0:17768:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff91de01ad7400/0xf3fe2838e1fc3694 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131148.252272:0:17768:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff91de01ad7400/0xf3fe2838e1fc3694 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131148.252292:0:17768:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8609e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:17768:1876039508901248:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789131148.252350:0:17768:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131148.252445:0:17768:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddff84ce40 going to sleep for 11 seconds 00000100:00100000:3.0:1789131148.254329:0:17766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508901248 00000100:00100000:3.0:1789131148.254339:0:17766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508901248 00000100:00100000:3.0:1789131148.254392:0:17766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1789131148.254402:0:17766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc7054450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+23:17768:x1876039508901248:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789131148.254418:0:17766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789131148.254434:0:17766:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91ddfd0b5a00/0xf3fe2838e1fc369b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3fe2838e1fc3694 expref: -99 pid: 17766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131148.254524:0:17766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91ddfd0b5a00/0xf3fe2838e1fc369b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3fe2838e1fc3694 expref: 24 pid: 17766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131148.254537:0:17766:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91ddfd0b5a00/0xf3fe2838e1fc369b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc3694 expref: 24 pid: 17766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131148.254547:0:17766:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ddfd0b5a00, rc 0) 00000100:00100000:3.0:1789131148.254746:0:17766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc7054450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+24:17768:x1876039508901248:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 345us (2395us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131148.254753:0:17766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789131148.259391:0:17768:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8609e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:17768:1876039508901248:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789131148.259423:0:17768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff91de01ad7400/0xf3fe2838e1fc3694 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc369b expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131148.259435:0:17768:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff91de01ad7400/0xf3fe2838e1fc3694 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3fe2838e1fc369b expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131148.259526:0:17768:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8609e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:17768:1876039508901376:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1789131148.259955:0:17768:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131148.260004:0:17768:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddff84ce40 going to sleep for 11 seconds 00000100:00100000:1.0:1789131148.260065:0:17765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508901376 00000100:00100000:1.0:1789131148.260074:0:17765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508901376 00000100:00100000:1.0:1789131148.260142:0:17765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1789131148.260151:0:17765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd2c8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+24:17768:x1876039508901376:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1789131148.260171:0:17765:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789131148.260186:0:17765:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789131148.260189:0:17765:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:1.0:1789131148.260281:0:17765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd2c8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+24:17768:x1876039508901376:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 130us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131148.260289:0:17765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1789131148.260331:0:17768:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8609e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:17768:1876039508901376:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1789131148.260391:0:17768:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789131148.260399:0:17768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff91de01ad7400/0xf3fe2838e1fc3694 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc369b expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131148.260408:0:17768:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff91de01ad7400/0xf3fe2838e1fc3694 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc369b expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131148.306690:0:19311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789131148.702685:0:17805:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789131149.329713:0:17759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789131149.907135:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd1daf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1876039508901504:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789131149.907206:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131149.907393:0:19286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508901504 00000100:00100000:3.0:1789131149.907401:0:19286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508901504 00000100:00080000:0.0:1789131149.907478:0:17767:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789131149.909100:0:19286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789131149.909186:0:19286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddca228f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1876039508901504:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789131149.909237:0:19286:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1789131149.909328:0:19286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddca228f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1876039508901504:12345-0@lo:13:osp-pre-0-1.0 Request processed in 154us (2121us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131149.909336:0:19286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789131149.909473:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91ddd1daf480 x1876039508901504/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789131165 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789131149.909495:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd1daf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1876039508901504:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1789131150.355338:0:17760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789131150.418548:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789131150.418807:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd1daf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1876039508901632:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789131150.418877:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131150.419687:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789131150.419701:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddca229680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508901760:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789131150.419751:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131150.419795:0:17777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508901632 00000100:00100000:1.0:1789131150.419801:0:17777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508901632 00000100:00100000:1.0:1789131150.419838:0:17777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508901760 00000100:00100000:1.0:1789131150.419841:0:17777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508901760 00000100:00100000:1.0:1789131150.419855:0:17777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789131150.419863:0:17777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd1dac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1876039508901632:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789131150.419905:0:17777:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1789131150.420047:0:17776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789131150.420056:0:17776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddca228000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1876039508901760:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789131150.420074:0:17776:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789131150.420435:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd1daf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1876039508901632:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789131150.421102:0:17777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd1dac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1876039508901632:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1236us (2222us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131150.421111:0:17777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789131150.425676:0:17776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddca228000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1876039508901760:12345-0@lo:41:osp-pre-1-0.0 Request processed in 5611us (5914us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131150.425691:0:17776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789131150.425823:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddca229680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508901760:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789131151.378297:0:19311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789131151.379073:0:18526:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789131151.890962:0:3624:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789131131/real 1789131131] req@ffff91dcc7893480 x1876039508887552/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789131151 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789131151.891564:0:3624:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff91dcc7893480 x1876039508887552/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789131151 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789131151.891759:0:3624:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789131131/real 1789131131] req@ffff91dcc78903c0 x1876039508887680/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789131151 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789131151.891776:0:3624:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff91dcc78903c0 x1876039508887680/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789131151 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789131151.891795:0:3624:0:(import.c:65:import_set_state_nolock()) ffff91dcc85e4800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789131151.891817:0:3624:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789131151.891821:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7893480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3624:1876039508887552:0@lo:8:kworker.0 00000100:00080000:0.0:1789131151.891826:0:3624:0:(import.c:65:import_set_state_nolock()) ffff91dcc85e2000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789131151.891831:0:3624:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789131151.891833:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc78903c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3624:1876039508887680:0@lo:8:kworker.0 00000100:00100000:2.0:1789131151.893558:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789131151.893578:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd286c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:3628:1876039508901888:0@lo:400:kworker.0 00000100:00100000:2.0:1789131151.893642:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789131151.893729:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789131151.893734:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1789131151.893737:0:38:0:(import.c:65:import_set_state_nolock()) ffff91dcc85e4800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789131151.893743:0:38:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 487 00000100:00080000:0.0:1789131151.893747:0:38:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1789131151.893754:0:38:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff91dcc85e4800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:0.0:1789131151.893775:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91dcc860bc00 x1876039508902144/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789131151.893792:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789131151.893795:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789131151.893797:0:38:0:(import.c:65:import_set_state_nolock()) ffff91dcc85e2000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789131151.893800:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 487 00000100:00080000:0.0:1789131151.893802:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1789131151.893818:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff91dcc85e2000 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:0.0:1789131151.893831:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91dcc860a580 x1876039508902272/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789131151.893868:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789131151.893871:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789131151.893873:0:38:0:(import.c:65:import_set_state_nolock()) ffff91ddff618800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789131151.893877:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff91ddff618800 using connection 192.168.203.111@tcp/0@lo 00000100:00100000:0.0:1789131151.893898:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91dcc8609e00 x1876039508902784/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789131151.893946:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8609680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508902656:0@lo:400:kworker.0 00000100:00100000:0.0:1789131151.893980:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131151.894007:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7d9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3627:1876039508903296:0@lo:400:kworker.0 00000100:00100000:0.0:1789131151.894034:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131151.894054:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789131151.894060:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc86092c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1876039508902016:0@lo:400:kworker.0 00000100:00100000:0.0:1789131151.894082:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131151.894114:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8608f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3627:1876039508902912:0@lo:400:kworker.0 00000100:00100000:0.0:1789131151.894136:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131151.894151:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7d99e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3627:1876039508903424:0@lo:400:kworker.0 00000100:00100000:0.0:1789131151.894173:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131151.894195:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc860b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3625:1876039508902400:0@lo:400:kworker.0 00000100:00100000:0.0:1789131151.894219:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131151.894237:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc860b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3625:1876039508903040:0@lo:400:kworker.0 00000100:00100000:0.0:1789131151.894260:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131151.894282:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789131151.894289:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8608b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508902528:0@lo:400:kworker.0 00000100:00100000:0.0:1789131151.894313:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131151.894333:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc860ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3625:1876039508903168:0@lo:400:kworker.0 00000100:00100000:0.0:1789131151.894357:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131151.894389:0:19981:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508902656 00000100:00100000:0.0:1789131151.894395:0:19981:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508902656 00000100:00100000:0.0:1789131151.894452:0:19981:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789131151.894493:0:19981:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7d9ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508902656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789131151.894544:0:19981:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7d9ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508902656:12345-0@lo:400:kworker.0 Request processed in 54us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131151.894551:0:19981:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789131151.894980:0:17777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508902016 00000100:00100000:0.0:1789131151.894986:0:17777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508902016 00000100:00100000:0.0:1789131151.895023:0:17777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508902528 00000100:00100000:0.0:1789131151.895027:0:17777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508902528 00000100:00100000:0.0:1789131151.895042:0:17777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789131151.895048:0:17777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7d992c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3627:x1876039508902016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789131151.895089:0:17777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7d992c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3627:x1876039508902016:12345-0@lo:400:kworker.0 Request processed in 40us (1005us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131151.895095:0:17777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789131151.895107:0:17777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789131151.895113:0:17777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7d99680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508902528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789131151.895145:0:17777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7d99680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508902528:12345-0@lo:400:kworker.0 Request processed in 33us (832us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131151.895151:0:17777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:0.0:1789131151.895170:0:17767:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789131151.895212:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8608b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508902528:0@lo:400:kworker.0 00000100:00100000:0.0:1789131151.895239:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc86092c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1876039508902016:0@lo:400:kworker.0 00010000:00080000:0.0:1789131151.895251:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc8609680 x1876039508902656/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789131167 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789131151.895261:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8609680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508902656:0@lo:400:kworker.0 00000100:00100000:0.0:1789131151.895281:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc860bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3624:1876039508902144:0@lo:8:kworker.0 00000100:00100000:0.0:1789131151.895315:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131151.895334:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc860a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3624:1876039508902272:0@lo:8:kworker.0 00000100:00100000:0.0:1789131151.895354:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131151.895368:0:3624:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8609e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3624:1876039508902784:0@lo:8:kworker.0 00000100:00100000:0.0:1789131151.895388:0:3624:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131151.895414:0:19981:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508902144 00000100:00100000:0.0:1789131151.895418:0:19981:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508902144 00000100:00100000:0.0:1789131151.895434:0:19981:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508902272 00000100:00100000:0.0:1789131151.895437:0:19981:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508902272 00000100:00100000:2.0:1789131151.895517:0:17771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508903296 00000100:00100000:2.0:1789131151.895523:0:17771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508903296 00000100:00100000:2.0:1789131151.895554:0:17771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508902912 00000100:00100000:2.0:1789131151.895557:0:17771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508902912 00000100:00100000:2.0:1789131151.895568:0:17771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508903424 00000100:00100000:2.0:1789131151.895571:0:17771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508903424 00000100:00100000:2.0:1789131151.895582:0:17771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508902400 00000100:00100000:2.0:1789131151.895584:0:17771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508902400 00000100:00100000:2.0:1789131151.895592:0:17771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508903040 00000100:00100000:2.0:1789131151.895594:0:17771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508903040 00000100:00100000:2.0:1789131151.895607:0:17771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508903168 00000100:00100000:2.0:1789131151.895610:0:17771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508903168 00000100:00100000:2.0:1789131151.895638:0:17771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789131151.895645:0:17771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7d9b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3627:x1876039508903296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131151.895711:0:17771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7d9b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3627:x1876039508903296:12345-0@lo:400:kworker.0 Request processed in 66us (1674us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131151.895718:0:17771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789131151.895730:0:17771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789131151.895736:0:17771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7d99a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1876039508902912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131151.895764:0:17771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7d99a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1876039508902912:12345-0@lo:400:kworker.0 Request processed in 29us (1627us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131151.895770:0:17771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789131151.895781:0:17771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789131151.895788:0:17771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7d98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3627:x1876039508903424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131151.895813:0:17771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7d98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3627:x1876039508903424:12345-0@lo:400:kworker.0 Request processed in 27us (1639us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131151.895819:0:17771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789131151.895830:0:17771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789131151.895835:0:17771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7d9a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1876039508902400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131151.895867:0:17771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7d9a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1876039508902400:12345-0@lo:400:kworker.0 Request processed in 31us (1646us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131151.895873:0:17771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789131151.895898:0:17771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789131151.895905:0:17771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7d98f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1876039508903040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789131151.895927:0:17766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508901888 00000100:00100000:3.0:1789131151.895934:0:17766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508901888 00000100:00100000:2.0:1789131151.895938:0:17771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7d98f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1876039508903040:12345-0@lo:400:kworker.0 Request processed in 32us (1676us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131151.895945:0:17771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789131151.895971:0:17771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789131151.895975:0:17766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789131151.895986:0:17766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd2c8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+24:3628:x1876039508901888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131151.895993:0:17771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7d9a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1876039508903168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789131151.896034:0:17766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd2c8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+24:3628:x1876039508901888:12345-0@lo:400:kworker.0 Request processed in 50us (2391us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131151.896041:0:17771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7d9a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1876039508903168:12345-0@lo:400:kworker.0 Request processed in 62us (1681us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131151.896046:0:17766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1789131151.896054:0:17771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789131151.896100:0:19283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508902784 00000100:00100000:2.0:1789131151.896105:0:19283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508902784 00000100:00100000:3.0:1789131151.896108:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd286c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:3628:1876039508901888:0@lo:400:kworker.0 00000100:00100000:2.0:1789131151.896124:0:19283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789131151.896132:0:19283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7d9bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3624:x1876039508902144:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1789131151.896157:0:19283:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 507 last 0 00000020:00000080:2.0:1789131151.896403:0:19283:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf3fe2838e1fc36a2 00002000:00100000:2.0:1789131151.896419:0:19283:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff91dcc5f30000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113984 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1789131151.896424:0:19283:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1789131151.896426:0:19283:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1789131151.896532:0:19283:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789131151.896557:0:19283:0:(import.c:65:import_set_state_nolock()) ffff91dcc5f30800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789131151.896568:0:19285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789131151.896575:0:19285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7d9b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3624:x1876039508902784:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1789131151.896608:0:19285:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 507 last 0 00000100:00100000:2.0:1789131151.896608:0:19283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7d9bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3624:x1876039508902144:12345-0@lo:8:kworker.0 Request processed in 474us (1290us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131151.896621:0:19283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000020:00000080:3.0:1789131151.896632:0:19285:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf3fe2838e1fc36a9 00002000:00100000:3.0:1789131151.896648:0:19285:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff91dcc8d09000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113984 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:3.0:1789131151.896652:0:19285:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:3.0:1789131151.896654:0:19285:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00010000:00080000:2.0:1789131151.896659:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc860ad00 x1876039508903168/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789131167 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789131151.896673:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc860ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3625:1876039508903168:0@lo:400:kworker.0 00010000:00080000:2.0:1789131151.896824:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc860b840 x1876039508902400/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789131167 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789131151.896834:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc860b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3625:1876039508902400:0@lo:400:kworker.0 00010000:00080000:2.0:1789131151.896859:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc860b480 x1876039508903040/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789131167 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789131151.896868:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc860b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3625:1876039508903040:0@lo:400:kworker.0 00010000:00080000:2.0:1789131151.896919:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc8608f00 x1876039508902912/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789131167 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789131151.896930:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8608f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3627:1876039508902912:0@lo:400:kworker.0 00010000:00080000:2.0:1789131151.896949:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc7d99e00 x1876039508903424/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789131167 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789131151.896960:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7d99e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3627:1876039508903424:0@lo:400:kworker.0 00010000:00080000:2.0:1789131151.896975:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc7d9b480 x1876039508903296/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789131167 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00002000:00080000:3.0:1789131151.896986:0:19285:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00100000:2.0:1789131151.896998:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7d9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3627:1876039508903296:0@lo:400:kworker.0 00000100:00080000:3.0:1789131151.897005:0:19285:0:(import.c:65:import_set_state_nolock()) ffff91dcc8d0e800 : changing import state from RECOVER to FULL 00010000:00080000:2.0:1789131151.897037:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc860bc00 x1876039508902144/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789131176 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789131151.897045:0:3624:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00100000:3.0:1789131151.897050:0:19285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7d9b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3624:x1876039508902784:12345-0@lo:8:kworker.0 Request processed in 473us (1659us total) trans 0 rc 0/0 00000100:00080000:2.0:1789131151.897052:0:3624:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00100000:3.0:1789131151.897062:0:19285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:2.0:1789131151.897063:0:3624:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1789131151.897069:0:3624:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1789131151.897072:0:3624:0:(import.c:65:import_set_state_nolock()) ffff91dcc85e4800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000100:00080000:3.0:1789131151.897084:0:17767:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:2.0:1789131151.897088:0:3624:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00080000:3.0:1789131151.897090:0:17767:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789131151.897095:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc860bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3624:1876039508902144:0@lo:8:kworker.0 00010000:00080000:2.0:1789131151.897110:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc8609e00 x1876039508902784/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789131176 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789131151.897130:0:3624:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 2 00000100:00080000:2.0:1789131151.897135:0:3624:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1789131151.897138:0:3624:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1789131151.897139:0:3624:0:(import.c:65:import_set_state_nolock()) ffff91ddff618800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1789131151.897161:0:3624:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1789131151.897165:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8609e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3624:1876039508902784:0@lo:8:kworker.0 00000004:00080000:2.0:1789131151.897222:0:17796:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x5:0x0] 00000100:00100000:2.0:1789131151.897240:0:17796:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd286c780 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17796:1876039508903808:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1789131151.897278:0:19981:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789131151.897284:0:19981:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7d98780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3624:x1876039508902272:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1789131151.897303:0:19981:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 507 last 0 00000020:00000080:0.0:1789131151.897319:0:19981:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf3fe2838e1fc36b0 00002000:00100000:0.0:1789131151.897325:0:19981:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff91ddff4f8000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113984 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1789131151.897328:0:19981:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1789131151.897330:0:19981:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1789131151.897359:0:19981:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789131151.897371:0:19981:0:(import.c:65:import_set_state_nolock()) ffff91ddff4ff000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789131151.898131:0:19981:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7d98780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3624:x1876039508902272:12345-0@lo:8:kworker.0 Request processed in 841us (2772us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131151.898149:0:19981:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000004:00080000:0.0:1789131151.898199:0:18517:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1789131151.898264:0:18517:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 507815805228ns, next at 0ns, rc = 0 00080000:00080000:0.0:1789131151.898271:0:18517:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:0.0:1789131151.898294:0:17795:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1789131151.898331:0:17795:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 507815871948ns, next at 0ns, rc = 0 00080000:00080000:0.0:1789131151.898336:0:17795:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:0.0:1789131151.898358:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd286d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508903680:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789131151.898670:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1789131151.898790:0:18518:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1789131151.898851:0:18518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd1dade00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:18518:1876039508903936:0@lo:7:osp-pre-1-1.0 00000100:00100000:3.0:1789131151.898893:0:18518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131151.898910:0:18518:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddc3049b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789131151.899004:0:17796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131151.899026:0:17796:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddd85edd80 going to sleep for 11 seconds 00000100:00100000:2.0:1789131151.899047:0:19283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508903936 00000100:00100000:2.0:1789131151.899053:0:19283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508903936 00000100:00100000:2.0:1789131151.899099:0:19283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508903808 00000100:00100000:2.0:1789131151.899103:0:19283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508903808 00000100:00100000:2.0:1789131151.899125:0:19283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789131151.899133:0:19283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd1daf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:18518:x1876039508903936:12345-0@lo:7:osp-pre-1-1.0 00000100:00100000:3.0:1789131151.899169:0:19286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508903680 00000100:00100000:3.0:1789131151.899175:0:19286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508903680 00000100:00100000:3.0:1789131151.899208:0:19286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789131151.899215:0:19286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7d9a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3626:x1876039508903680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789131151.899237:0:19286:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1789131151.899275:0:19286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7d9a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3626:x1876039508903680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 61us (605us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131151.899283:0:19286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1789131151.899316:0:17767:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789131151.899320:0:17767:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789131151.899330:0:19285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789131151.899338:0:19285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddca0c43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17796:x1876039508903808:12345-0@lo:5:osp-pre-0-0.0 00010000:00080000:2.0:1789131151.899720:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc860a580 x1876039508902272/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789131176 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789131151.899731:0:3624:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789131151.899739:0:3624:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1789131151.899746:0:3624:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1789131151.899751:0:3624:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1789131151.899754:0:3624:0:(import.c:65:import_set_state_nolock()) ffff91dcc85e2000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1789131151.899767:0:3624:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1789131151.899772:0:3624:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc860a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3624:1876039508902272:0@lo:8:kworker.0 00000004:00080000:2.0:1789131151.899833:0:17798:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x6:0x0] 00000100:00100000:2.0:1789131151.899851:0:17798:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddca0c61c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17798:1876039508904192:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1789131151.899895:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd1daf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508903552:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789131151.899901:0:17798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131151.899921:0:17798:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddd8052cc0 going to sleep for 11 seconds 00000004:00080000:2.0:1789131151.899937:0:17797:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:3.0:1789131151.899941:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131151.899977:0:19286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508903552 00000100:00100000:3.0:1789131151.899982:0:19286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508903552 00000100:00100000:3.0:1789131151.900006:0:19286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789131151.900012:0:19286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd1daf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3625:x1876039508903552:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789131151.900028:0:19286:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923501056 avail 3691978752 00000100:00100000:3.0:1789131151.900064:0:19286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd1daf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3625:x1876039508903552:12345-0@lo:13:osp-pre-1-1.0 Request processed in 51us (124us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131151.900072:0:19286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1789131151.900101:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91ddd1daf840 x1876039508903552/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789131167 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789131151.900117:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd1daf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508903552:0@lo:13:osp-pre-1-1.0 00000004:00080000:2.0:1789131151.900622:0:17797:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 507818161839ns, next at 0ns, rc = 0 00080000:00080000:2.0:1789131151.900628:0:17797:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:2.0:1789131151.900670:0:19284:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:2.0:1789131151.901054:0:19284:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:2.0:1789131151.901146:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789131151.901161:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddca0c6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1876039508904064:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789131151.901803:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131151.901859:0:19284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508904192 00000100:00100000:2.0:1789131151.901866:0:19284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508904192 00000100:00100000:3.0:1789131151.902032:0:19286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508904064 00000100:00100000:3.0:1789131151.902037:0:19286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508904064 00000100:00100000:3.0:1789131151.902064:0:19286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789131151.902073:0:19286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc78903c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3628:x1876039508904064:12345-0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1789131151.902346:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91ddd286d2c0 x1876039508903680/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789131167 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789131151.902364:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd286d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508903680:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789131151.902777:0:20403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789131151.902787:0:20403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddca0c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:17798:x1876039508904192:12345-0@lo:5:osp-pre-1-0.0 00002000:00000024:3.0:1789131151.903317:0:19286:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923501056 avail 3691978752 00000100:00100000:3.0:1789131151.903600:0:19286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc78903c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3628:x1876039508904064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1526us (1796us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131151.903609:0:19286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1789131151.903951:0:17767:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1789131151.905045:0:18506:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000004:00080000:3.0:1789131151.905076:0:17751:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:3.0:1789131151.906160:0:17751:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00080000:0.0:1789131151.907664:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91ddca0c6940 x1876039508904064/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789131167 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789131151.907704:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddca0c6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1876039508904064:0@lo:13:osp-pre-1-0.0 00002000:00080000:3.0:1789131151.909246:0:19283:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:3.0:1789131151.909256:0:19283:0:(ofd_dev.c:1222:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x21:0x0] 00000100:00100000:3.0:1789131151.909339:0:19283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd1daf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:18518:x1876039508903936:12345-0@lo:7:osp-pre-1-1.0 Request processed in 10203us (10442us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131151.909360:0:19283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1789131151.909417:0:18518:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91ddd1dade00 x1876039508903936/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789131167 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789131151.909430:0:18518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd1dade00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:18518:1876039508903936:0@lo:7:osp-pre-1-1.0 00000004:00080000:3.0:1789131151.911167:0:18518:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x21:0x0] 00000100:00100000:3.0:1789131151.911227:0:18518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd1dade00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:18518:1876039508904320:0@lo:5:osp-pre-1-1.0 00000100:00100000:3.0:1789131151.911289:0:18518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131151.911320:0:18518:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddc3049b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789131151.911346:0:19284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508904320 00000100:00100000:3.0:1789131151.911353:0:19284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508904320 00000100:00100000:3.0:1789131151.911409:0:19284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789131151.911418:0:19284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd1daf840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:18518:x1876039508904320:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:3.0:1789131151.911442:0:19284:0:(ofd_dev.c:1654:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:3.0:1789131151.911838:0:19284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd1daf840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:18518:x1876039508904320:12345-0@lo:5:osp-pre-1-1.0 Request processed in 421us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131151.911847:0:19284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1789131151.911900:0:18518:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91ddd1dade00 x1876039508904320/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789131167 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789131151.911912:0:18518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd1dade00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:18518:1876039508904320:0@lo:5:osp-pre-1-1.0 00000004:00080000:3.0:1789131151.911922:0:18518:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x21:0x0] from OST, last_created [0x2c0000400:0x21:0x0]last_used is [0x2c0000400:0x21:0x0] 00000100:00100000:3.0:1789131151.911948:0:18518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd1dade00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:18518:1876039508904448:0@lo:5:osp-pre-1-1.0 00000100:00100000:3.0:1789131151.911976:0:18518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131151.911996:0:18518:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddc3049b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789131151.912011:0:19283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508904448 00000100:00100000:3.0:1789131151.912021:0:19283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508904448 00000100:00100000:3.0:1789131151.912052:0:19283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789131151.912061:0:19283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd1dac780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:18518:x1876039508904448:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:3.0:1789131151.912102:0:19283:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 34 00002000:00080000:0.0:1789131151.912780:0:20403:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:0.0:1789131151.912788:0:20403:0:(ofd_dev.c:1654:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:0.0:1789131151.912794:0:20403:0:(ofd_dev.c:1505:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:7 to 0x2c0000401:33) 00002000:00080000:3.0:1789131151.914340:0:19285:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:3.0:1789131151.914351:0:19285:0:(ofd_dev.c:1654:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:3.0:1789131151.914358:0:19285:0:(ofd_dev.c:1505:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:6 to 0x280000401:33) 00002000:00010000:0.0:1789131151.929256:0:20403:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789131151.929267:0:20403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac7d66f9/0xf3fe2838e1fc36b7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131151.929284:0:20403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=507s v=(0 0) 00010000:00010000:0.0:1789131151.929289:0:20403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789131151.929296:0:20403:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac7d66f9/0xf3fe2838e1fc36b7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131151.929333:0:20403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ac7d66f9/0xf3fe2838e1fc36b7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131151.929345:0:20403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac7d66f9/0xf3fe2838e1fc36b7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131151.929354:0:20403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ac7d66f9/0xf3fe2838e1fc36b7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131151.929374:0:20403:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789131151.929386:0:17759:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789131151.929401:0:17759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ac7d66f9/0xf3fe2838e1fc36b7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131151.929409:0:17759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91de01ad6200 already unused, calling callback (ffffffffc0c4e550) 00010000:00010000:0.0:1789131151.929414:0:17759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac7d66f9/0xf3fe2838e1fc36b7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131151.929423:0:17759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac7d66f9/0xf3fe2838e1fc36b7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131151.929438:0:17759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ac7d66f9/0xf3fe2838e1fc36b7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131151.929445:0:17759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ac7d66f9/0xf3fe2838e1fc36b7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131151.929491:0:17759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789131151.929493:0:17759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789131151.929495:0:17759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789131151.931300:0:20403:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789131151.931313:0:20403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000786a2989/0xf3fe2838e1fc36be lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131151.931328:0:20403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=507s v=(0 0) 00010000:00010000:0.0:1789131151.931332:0:20403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789131151.931337:0:20403:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000786a2989/0xf3fe2838e1fc36be lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131151.931350:0:20403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000786a2989/0xf3fe2838e1fc36be lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131151.931359:0:20403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000786a2989/0xf3fe2838e1fc36be lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131151.931366:0:20403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000786a2989/0xf3fe2838e1fc36be lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131151.931387:0:20403:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789131151.931398:0:17760:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789131151.931403:0:17760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000786a2989/0xf3fe2838e1fc36be lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131151.931423:0:17760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91de01ad7e00 already unused, calling callback (ffffffffc0c4e550) 00010000:00010000:0.0:1789131151.931427:0:17760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000786a2989/0xf3fe2838e1fc36be lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131151.931437:0:17760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000786a2989/0xf3fe2838e1fc36be lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131151.931454:0:17760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000786a2989/0xf3fe2838e1fc36be lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131151.931476:0:17760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000786a2989/0xf3fe2838e1fc36be lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131151.931493:0:17760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789131151.931495:0:17760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789131151.931496:0:17760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789131151.933628:0:20403:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789131151.933639:0:20403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba16950d/0xf3fe2838e1fc36c5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.933654:0:20403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=507s v=(0 0) 00010000:00010000:2.0:1789131151.933658:0:20403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789131151.933664:0:20403:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ba16950d/0xf3fe2838e1fc36c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.934071:0:20403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ba16950d/0xf3fe2838e1fc36c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.934094:0:20403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba16950d/0xf3fe2838e1fc36c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.934102:0:20403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ba16950d/0xf3fe2838e1fc36c5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.934117:0:20403:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789131151.934127:0:19311:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789131151.934133:0:19311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ba16950d/0xf3fe2838e1fc36c5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.934140:0:19311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc7f7fe00 already unused, calling callback (ffffffffc0c4e550) 00010000:00010000:2.0:1789131151.934144:0:19311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba16950d/0xf3fe2838e1fc36c5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.934153:0:19311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba16950d/0xf3fe2838e1fc36c5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.934167:0:19311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ba16950d/0xf3fe2838e1fc36c5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.934175:0:19311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ba16950d/0xf3fe2838e1fc36c5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.935299:0:19311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131151.935309:0:19311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131151.935311:0:19311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789131151.938198:0:20403:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789131151.938224:0:20403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f8a483ec/0xf3fe2838e1fc36cc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.938241:0:20403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=507s v=(0 0) 00010000:00010000:2.0:1789131151.938246:0:20403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789131151.938252:0:20403:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f8a483ec/0xf3fe2838e1fc36cc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.938426:0:20403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f8a483ec/0xf3fe2838e1fc36cc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.938438:0:20403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f8a483ec/0xf3fe2838e1fc36cc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.938446:0:20403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f8a483ec/0xf3fe2838e1fc36cc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.938557:0:20403:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789131151.940560:0:20403:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789131151.940571:0:20403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005dbe3b40/0xf3fe2838e1fc36d3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.940586:0:20403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=507s v=(0 0) 00010000:00010000:2.0:1789131151.940591:0:20403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789131151.940596:0:20403:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005dbe3b40/0xf3fe2838e1fc36d3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.940618:0:20403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005dbe3b40/0xf3fe2838e1fc36d3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.940628:0:20403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005dbe3b40/0xf3fe2838e1fc36d3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.940636:0:20403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005dbe3b40/0xf3fe2838e1fc36d3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.940654:0:20403:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1789131151.942077:0:20403:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789131151.942087:0:20403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000c5e8325/0xf3fe2838e1fc36da lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.942098:0:20403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=507s v=(0 0) 00010000:00010000:2.0:1789131151.942102:0:20403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789131151.942107:0:20403:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000c5e8325/0xf3fe2838e1fc36da lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.942118:0:20403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000c5e8325/0xf3fe2838e1fc36da lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.942126:0:20403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000c5e8325/0xf3fe2838e1fc36da lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.942145:0:20403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000c5e8325/0xf3fe2838e1fc36da lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.942162:0:20403:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1789131151.942173:0:19311:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789131151.942178:0:19311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f8a483ec/0xf3fe2838e1fc36cc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.942185:0:19311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc7f7ee00 already unused, calling callback (ffffffffc0c4e550) 00010000:00010000:2.0:1789131151.942189:0:19311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f8a483ec/0xf3fe2838e1fc36cc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.942198:0:19311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f8a483ec/0xf3fe2838e1fc36cc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.942215:0:19311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f8a483ec/0xf3fe2838e1fc36cc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.942221:0:19311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f8a483ec/0xf3fe2838e1fc36cc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.942237:0:19311:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789131151.942240:0:19311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005dbe3b40/0xf3fe2838e1fc36d3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.942257:0:19311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc7f7e000 already unused, calling callback (ffffffffc0c4e550) 00010000:00010000:2.0:1789131151.942260:0:19311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005dbe3b40/0xf3fe2838e1fc36d3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.942268:0:19311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005dbe3b40/0xf3fe2838e1fc36d3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.942277:0:19311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005dbe3b40/0xf3fe2838e1fc36d3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.942284:0:19311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005dbe3b40/0xf3fe2838e1fc36d3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.942294:0:19311:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789131151.942297:0:19311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000c5e8325/0xf3fe2838e1fc36da lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.942303:0:19311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc7f7e200 already unused, calling callback (ffffffffc0c4e550) 00010000:00010000:2.0:1789131151.942307:0:19311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000c5e8325/0xf3fe2838e1fc36da lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.942319:0:19311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000c5e8325/0xf3fe2838e1fc36da lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.942327:0:19311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000c5e8325/0xf3fe2838e1fc36da lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.942340:0:19311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000c5e8325/0xf3fe2838e1fc36da lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.942352:0:19311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131151.942354:0:19311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131151.942355:0:19311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789131151.942599:0:17759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789131151.942607:0:17760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789131151.943039:0:19285:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789131151.943047:0:19285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002174657e/0xf3fe2838e1fc36e1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131151.943058:0:19285:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=507s v=(0 0) 00010000:00010000:3.0:1789131151.943061:0:19285:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789131151.943065:0:19285:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002174657e/0xf3fe2838e1fc36e1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131151.943079:0:19285:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002174657e/0xf3fe2838e1fc36e1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131151.943086:0:19285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002174657e/0xf3fe2838e1fc36e1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131151.943100:0:19285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002174657e/0xf3fe2838e1fc36e1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131151.943155:0:19285:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789131151.943671:0:19285:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789131151.943678:0:19285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb3f6c73/0xf3fe2838e1fc36e8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131151.943687:0:19285:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=507s v=(0 0) 00010000:00010000:1.0:1789131151.943690:0:19285:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789131151.943695:0:19285:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eb3f6c73/0xf3fe2838e1fc36e8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131151.943705:0:19285:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eb3f6c73/0xf3fe2838e1fc36e8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131151.943712:0:19285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb3f6c73/0xf3fe2838e1fc36e8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131151.943732:0:19285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eb3f6c73/0xf3fe2838e1fc36e8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131151.945262:0:19285:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789131151.945333:0:19311:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789131151.945342:0:19311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002174657e/0xf3fe2838e1fc36e1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.945354:0:19311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddfd0b4a00 already unused, calling callback (ffffffffc0c4e550) 00010000:00010000:2.0:1789131151.945361:0:19311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002174657e/0xf3fe2838e1fc36e1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.945370:0:19311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002174657e/0xf3fe2838e1fc36e1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789131151.946222:0:19285:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789131151.946231:0:19285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089826788/0xf3fe2838e1fc36ef lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131151.946244:0:19285:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=507s v=(0 0) 00010000:00010000:1.0:1789131151.946248:0:19285:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789131151.946254:0:19285:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089826788/0xf3fe2838e1fc36ef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131151.946267:0:19285:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089826788/0xf3fe2838e1fc36ef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131151.946277:0:19285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089826788/0xf3fe2838e1fc36ef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131151.946285:0:19285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000089826788/0xf3fe2838e1fc36ef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131151.946307:0:19285:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789131151.946576:0:17760:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789131151.946588:0:17760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eb3f6c73/0xf3fe2838e1fc36e8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131151.946596:0:17760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc85cbc00 already unused, calling callback (ffffffffc0c4e550) 00010000:00010000:3.0:1789131151.946599:0:17760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb3f6c73/0xf3fe2838e1fc36e8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131151.946607:0:17760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb3f6c73/0xf3fe2838e1fc36e8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131151.946623:0:17760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eb3f6c73/0xf3fe2838e1fc36e8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131151.946631:0:17760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eb3f6c73/0xf3fe2838e1fc36e8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131151.946646:0:17760:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789131151.946649:0:17760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000089826788/0xf3fe2838e1fc36ef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131151.946654:0:17760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc85caa00 already unused, calling callback (ffffffffc0c4e550) 00010000:00010000:3.0:1789131151.946657:0:17760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000089826788/0xf3fe2838e1fc36ef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131151.946664:0:17760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000089826788/0xf3fe2838e1fc36ef lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131151.946685:0:17760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000089826788/0xf3fe2838e1fc36ef lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131151.946692:0:17760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089826788/0xf3fe2838e1fc36ef lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789131151.946854:0:19285:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789131151.946860:0:19285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e39a4ce9/0xf3fe2838e1fc36f6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131151.946873:0:19285:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=507s v=(0 0) 00010000:00010000:1.0:1789131151.946887:0:19285:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789131151.946893:0:19285:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e39a4ce9/0xf3fe2838e1fc36f6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131151.946903:0:19285:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e39a4ce9/0xf3fe2838e1fc36f6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131151.946910:0:19285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e39a4ce9/0xf3fe2838e1fc36f6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131151.946916:0:19285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e39a4ce9/0xf3fe2838e1fc36f6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131151.946924:0:19285:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789131151.947185:0:19311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002174657e/0xf3fe2838e1fc36e1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.947193:0:19311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002174657e/0xf3fe2838e1fc36e1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.947208:0:19311:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789131151.947211:0:19311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e39a4ce9/0xf3fe2838e1fc36f6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.947224:0:19311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc85cac00 already unused, calling callback (ffffffffc0c4e550) 00010000:00010000:2.0:1789131151.947227:0:19311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e39a4ce9/0xf3fe2838e1fc36f6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.947235:0:19311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e39a4ce9/0xf3fe2838e1fc36f6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.947246:0:19311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e39a4ce9/0xf3fe2838e1fc36f6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.947253:0:19311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e39a4ce9/0xf3fe2838e1fc36f6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789131151.947520:0:19285:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789131151.947526:0:19285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df96b4fa/0xf3fe2838e1fc36fd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131151.947534:0:19285:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=507s v=(0 0) 00010000:00010000:1.0:1789131151.947537:0:19285:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789131151.947541:0:19285:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df96b4fa/0xf3fe2838e1fc36fd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131151.947551:0:19285:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df96b4fa/0xf3fe2838e1fc36fd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131151.947573:0:19285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df96b4fa/0xf3fe2838e1fc36fd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131151.947579:0:19285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000df96b4fa/0xf3fe2838e1fc36fd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131151.947587:0:19285:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789131151.947758:0:19311:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789131151.947763:0:19311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000df96b4fa/0xf3fe2838e1fc36fd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.947770:0:19311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc85ca600 already unused, calling callback (ffffffffc0c4e550) 00010000:00010000:2.0:1789131151.947773:0:19311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000df96b4fa/0xf3fe2838e1fc36fd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.947780:0:19311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000df96b4fa/0xf3fe2838e1fc36fd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.947791:0:19311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000df96b4fa/0xf3fe2838e1fc36fd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.947803:0:19311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df96b4fa/0xf3fe2838e1fc36fd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.947817:0:19311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131151.947819:0:19311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131151.947821:0:19311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789131151.947868:0:20403:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789131151.947873:0:20403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009d0325f4/0xf3fe2838e1fc3704 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.947893:0:20403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=507s v=(0 0) 00010000:00010000:2.0:1789131151.947896:0:20403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789131151.947899:0:20403:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009d0325f4/0xf3fe2838e1fc3704 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.947908:0:20403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009d0325f4/0xf3fe2838e1fc3704 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.947916:0:20403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009d0325f4/0xf3fe2838e1fc3704 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.947922:0:20403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009d0325f4/0xf3fe2838e1fc3704 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.947938:0:20403:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789131151.947946:0:19311:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789131151.947955:0:19311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009d0325f4/0xf3fe2838e1fc3704 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.947963:0:19311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc7f7f800 already unused, calling callback (ffffffffc0c4e550) 00010000:00010000:2.0:1789131151.947966:0:19311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009d0325f4/0xf3fe2838e1fc3704 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.947974:0:19311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009d0325f4/0xf3fe2838e1fc3704 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.947986:0:19311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009d0325f4/0xf3fe2838e1fc3704 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.947992:0:19311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009d0325f4/0xf3fe2838e1fc3704 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.948008:0:19311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131151.948009:0:19311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131151.948011:0:19311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789131151.948622:0:19285:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789131151.948629:0:19285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007df34cb8/0xf3fe2838e1fc370b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131151.948636:0:19285:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=507s v=(0 0) 00010000:00010000:1.0:1789131151.948639:0:19285:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789131151.948643:0:19285:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007df34cb8/0xf3fe2838e1fc370b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131151.948651:0:19285:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007df34cb8/0xf3fe2838e1fc370b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131151.948658:0:19285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007df34cb8/0xf3fe2838e1fc370b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131151.948665:0:19285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007df34cb8/0xf3fe2838e1fc370b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131151.948691:0:19285:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789131151.948960:0:19311:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789131151.948965:0:19311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007df34cb8/0xf3fe2838e1fc370b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.948972:0:19311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc85ca400 already unused, calling callback (ffffffffc0c4e550) 00010000:00010000:2.0:1789131151.948975:0:19311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007df34cb8/0xf3fe2838e1fc370b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.948995:0:19311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007df34cb8/0xf3fe2838e1fc370b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.949007:0:19311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007df34cb8/0xf3fe2838e1fc370b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.949015:0:19311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007df34cb8/0xf3fe2838e1fc370b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.949031:0:19311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131151.949033:0:19311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131151.949034:0:19311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789131151.949095:0:20403:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789131151.949101:0:20403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000015311b95/0xf3fe2838e1fc3712 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.949109:0:20403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=507s v=(0 0) 00010000:00010000:2.0:1789131151.949112:0:20403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789131151.949116:0:20403:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000015311b95/0xf3fe2838e1fc3712 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.949126:0:20403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000015311b95/0xf3fe2838e1fc3712 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.949133:0:20403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000015311b95/0xf3fe2838e1fc3712 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.949146:0:20403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000015311b95/0xf3fe2838e1fc3712 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.949159:0:20403:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789131151.949166:0:19311:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789131151.949169:0:19311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000015311b95/0xf3fe2838e1fc3712 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.949175:0:19311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc78dfa00 already unused, calling callback (ffffffffc0c4e550) 00010000:00010000:2.0:1789131151.949178:0:19311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000015311b95/0xf3fe2838e1fc3712 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.949184:0:19311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000015311b95/0xf3fe2838e1fc3712 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.949194:0:19311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000015311b95/0xf3fe2838e1fc3712 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.949200:0:19311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000015311b95/0xf3fe2838e1fc3712 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.949212:0:19311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131151.949213:0:19311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131151.949214:0:19311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789131151.949306:0:17759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789131151.950060:0:19285:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789131151.950075:0:19285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000940afcb2/0xf3fe2838e1fc3719 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.950084:0:19285:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=507s v=(0 0) 00010000:00010000:2.0:1789131151.950087:0:19285:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789131151.950092:0:19285:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000940afcb2/0xf3fe2838e1fc3719 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.950102:0:19285:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000940afcb2/0xf3fe2838e1fc3719 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.950110:0:19285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000940afcb2/0xf3fe2838e1fc3719 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.950116:0:19285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000940afcb2/0xf3fe2838e1fc3719 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.950129:0:19285:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789131151.950137:0:19311:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789131151.950141:0:19311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000940afcb2/0xf3fe2838e1fc3719 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.950148:0:19311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc78dee00 already unused, calling callback (ffffffffc0c4e550) 00010000:00010000:2.0:1789131151.950150:0:19311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000940afcb2/0xf3fe2838e1fc3719 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.950157:0:19311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000940afcb2/0xf3fe2838e1fc3719 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.950176:0:19311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000940afcb2/0xf3fe2838e1fc3719 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.950184:0:19311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000940afcb2/0xf3fe2838e1fc3719 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.950208:0:19311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131151.950211:0:19311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131151.950213:0:19311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789131151.951371:0:20403:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789131151.951523:0:20403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b13f9c84/0xf3fe2838e1fc3720 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.951533:0:20403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=507s v=(0 0) 00010000:00010000:2.0:1789131151.951537:0:20403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789131151.951541:0:20403:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b13f9c84/0xf3fe2838e1fc3720 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.951552:0:20403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b13f9c84/0xf3fe2838e1fc3720 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.951560:0:20403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b13f9c84/0xf3fe2838e1fc3720 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.951566:0:20403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b13f9c84/0xf3fe2838e1fc3720 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.951596:0:20403:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789131151.951800:0:17759:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789131151.951807:0:17759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b13f9c84/0xf3fe2838e1fc3720 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131151.951817:0:17759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc78de800 already unused, calling callback (ffffffffc0c4e550) 00010000:00010000:0.0:1789131151.951821:0:17759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b13f9c84/0xf3fe2838e1fc3720 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131151.951844:0:17759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b13f9c84/0xf3fe2838e1fc3720 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131151.951869:0:17759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b13f9c84/0xf3fe2838e1fc3720 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131151.951887:0:17759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b13f9c84/0xf3fe2838e1fc3720 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131151.951908:0:17759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789131151.951911:0:17759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789131151.951913:0:17759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789131151.953088:0:19285:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789131151.953097:0:19285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b8a6718/0xf3fe2838e1fc3727 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.953109:0:19285:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=507s v=(0 0) 00010000:00010000:2.0:1789131151.953112:0:19285:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789131151.953117:0:19285:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b8a6718/0xf3fe2838e1fc3727 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.953127:0:19285:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b8a6718/0xf3fe2838e1fc3727 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.953135:0:19285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b8a6718/0xf3fe2838e1fc3727 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.953142:0:19285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008b8a6718/0xf3fe2838e1fc3727 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.953157:0:19285:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789131151.953167:0:19311:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789131151.953172:0:19311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008b8a6718/0xf3fe2838e1fc3727 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.953179:0:19311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc78de200 already unused, calling callback (ffffffffc0c4e550) 00010000:00010000:2.0:1789131151.953190:0:19311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008b8a6718/0xf3fe2838e1fc3727 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.953199:0:19311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008b8a6718/0xf3fe2838e1fc3727 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.953211:0:19311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008b8a6718/0xf3fe2838e1fc3727 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.953217:0:19311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b8a6718/0xf3fe2838e1fc3727 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.953233:0:19311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131151.953235:0:19311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131151.953236:0:19311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789131151.953278:0:20403:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789131151.953284:0:20403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048e5bf12/0xf3fe2838e1fc372e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.953291:0:20403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=507s v=(0 0) 00010000:00010000:2.0:1789131151.953294:0:20403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789131151.953298:0:20403:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048e5bf12/0xf3fe2838e1fc372e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.953313:0:20403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000048e5bf12/0xf3fe2838e1fc372e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.953321:0:20403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048e5bf12/0xf3fe2838e1fc372e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.953335:0:20403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000048e5bf12/0xf3fe2838e1fc372e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131151.953345:0:17760:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789131151.953350:0:17760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000048e5bf12/0xf3fe2838e1fc372e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.953357:0:20403:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789131151.953358:0:17760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc78df600 already unused, calling callback (ffffffffc0c4e550) 00010000:00010000:3.0:1789131151.953362:0:17760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000048e5bf12/0xf3fe2838e1fc372e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131151.953367:0:17759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789131151.953371:0:17760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000048e5bf12/0xf3fe2838e1fc372e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131151.953382:0:17760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000048e5bf12/0xf3fe2838e1fc372e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131151.953387:0:17760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000048e5bf12/0xf3fe2838e1fc372e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131151.953397:0:17760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789131151.953399:0:17760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789131151.953405:0:17760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789131151.954252:0:19285:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789131151.954260:0:19285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4c05e0e/0xf3fe2838e1fc3735 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131151.954272:0:19285:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=507s v=(0 0) 00010000:00010000:3.0:1789131151.954276:0:19285:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789131151.954281:0:19285:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b4c05e0e/0xf3fe2838e1fc3735 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131151.954292:0:19285:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b4c05e0e/0xf3fe2838e1fc3735 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131151.954301:0:19285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4c05e0e/0xf3fe2838e1fc3735 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131151.954309:0:19285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b4c05e0e/0xf3fe2838e1fc3735 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131151.954336:0:19285:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789131151.954346:0:19311:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789131151.954350:0:19311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b4c05e0e/0xf3fe2838e1fc3735 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131151.954357:0:19311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddfd0b5400 already unused, calling callback (ffffffffc0c4e550) 00010000:00010000:3.0:1789131151.954361:0:19311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4c05e0e/0xf3fe2838e1fc3735 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131151.954381:0:19311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4c05e0e/0xf3fe2838e1fc3735 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131151.954394:0:19311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b4c05e0e/0xf3fe2838e1fc3735 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131151.954414:0:19311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b4c05e0e/0xf3fe2838e1fc3735 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131151.954429:0:19311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789131151.954431:0:19311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789131151.954432:0:19311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789131151.957028:0:19285:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789131151.957039:0:19285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000051d36583/0xf3fe2838e1fc373c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131151.957053:0:19285:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=507s v=(0 0) 00010000:00010000:3.0:1789131151.957057:0:19285:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789131151.957063:0:19285:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000051d36583/0xf3fe2838e1fc373c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131151.957076:0:19285:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000051d36583/0xf3fe2838e1fc373c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131151.957085:0:19285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000051d36583/0xf3fe2838e1fc373c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131151.957098:0:19285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000051d36583/0xf3fe2838e1fc373c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131151.957118:0:19285:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789131151.957161:0:17759:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789131151.957169:0:17759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000051d36583/0xf3fe2838e1fc373c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131151.957180:0:17759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddfd0b4800 already unused, calling callback (ffffffffc0c4e550) 00010000:00010000:0.0:1789131151.957185:0:17759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000051d36583/0xf3fe2838e1fc373c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131151.957195:0:17759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000051d36583/0xf3fe2838e1fc373c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131151.957215:0:17759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000051d36583/0xf3fe2838e1fc373c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131151.957229:0:17759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000051d36583/0xf3fe2838e1fc373c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131151.957248:0:17759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789131151.957250:0:17759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789131151.957252:0:17759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789131151.957787:0:20403:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789131151.957795:0:20403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000015311b95/0xf3fe2838e1fc3743 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.957805:0:20403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=507s v=(0 0) 00010000:00010000:2.0:1789131151.957808:0:20403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789131151.957812:0:20403:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000015311b95/0xf3fe2838e1fc3743 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.957823:0:20403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000015311b95/0xf3fe2838e1fc3743 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.957830:0:20403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000015311b95/0xf3fe2838e1fc3743 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.957837:0:20403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000015311b95/0xf3fe2838e1fc3743 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.957856:0:20403:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789131151.958020:0:17760:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789131151.958027:0:17760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000015311b95/0xf3fe2838e1fc3743 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131151.958035:0:17760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc78dfa00 already unused, calling callback (ffffffffc0c4e550) 00010000:00010000:3.0:1789131151.958038:0:17760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000015311b95/0xf3fe2838e1fc3743 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131151.958046:0:17760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000015311b95/0xf3fe2838e1fc3743 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131151.958058:0:17760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000015311b95/0xf3fe2838e1fc3743 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131151.958064:0:17760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000015311b95/0xf3fe2838e1fc3743 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131151.958077:0:17760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789131151.958079:0:17760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789131151.958080:0:17760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789131151.958611:0:19285:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789131151.958618:0:19285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000074dd2b8/0xf3fe2838e1fc374a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131151.958627:0:19285:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=507s v=(0 0) 00010000:00010000:1.0:1789131151.958631:0:19285:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789131151.958635:0:19285:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000074dd2b8/0xf3fe2838e1fc374a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131151.958645:0:19285:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000074dd2b8/0xf3fe2838e1fc374a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131151.958652:0:19285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000074dd2b8/0xf3fe2838e1fc374a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131151.958658:0:19285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000074dd2b8/0xf3fe2838e1fc374a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131151.958680:0:19285:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789131151.958822:0:19311:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789131151.958834:0:19311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000074dd2b8/0xf3fe2838e1fc374a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131151.958841:0:19311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc85cb400 already unused, calling callback (ffffffffc0c4e550) 00010000:00010000:3.0:1789131151.958844:0:19311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000074dd2b8/0xf3fe2838e1fc374a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131151.958851:0:19311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000074dd2b8/0xf3fe2838e1fc374a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131151.958861:0:19311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000074dd2b8/0xf3fe2838e1fc374a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131151.958867:0:19311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000074dd2b8/0xf3fe2838e1fc374a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131151.958894:0:19311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789131151.958896:0:19311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789131151.958898:0:19311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789131151.959227:0:19285:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789131151.959234:0:19285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae8ad666/0xf3fe2838e1fc3751 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131151.959242:0:19285:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=507s v=(0 0) 00010000:00010000:1.0:1789131151.959252:0:19285:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=0s v=(0 0) 00002000:00010000:2.0:1789131151.959253:0:20403:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789131151.959257:0:19285:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ae8ad666/0xf3fe2838e1fc3751 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.959261:0:20403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a45f6c7d/0xf3fe2838e1fc3758 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131151.959269:0:19285:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ae8ad666/0xf3fe2838e1fc3751 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.959291:0:20403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=507s v=(0 0) 00010000:00010000:1.0:1789131151.959291:0:19285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae8ad666/0xf3fe2838e1fc3751 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.959300:0:20403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789131151.959307:0:19285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ae8ad666/0xf3fe2838e1fc3751 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.959310:0:20403:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a45f6c7d/0xf3fe2838e1fc3758 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.959329:0:20403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a45f6c7d/0xf3fe2838e1fc3758 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131151.959333:0:19285:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789131151.959339:0:20403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a45f6c7d/0xf3fe2838e1fc3758 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131151.959343:0:17759:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789131151.959351:0:17759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ae8ad666/0xf3fe2838e1fc3751 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.959352:0:20403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a45f6c7d/0xf3fe2838e1fc3758 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131151.959371:0:17759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc85ca800 already unused, calling callback (ffffffffc0c4e550) 00010000:00010000:1.0:1789131151.959376:0:17759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae8ad666/0xf3fe2838e1fc3751 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131151.959384:0:17759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae8ad666/0xf3fe2838e1fc3751 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131151.959396:0:17759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ae8ad666/0xf3fe2838e1fc3751 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131151.959414:0:17759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ae8ad666/0xf3fe2838e1fc3751 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131151.959432:0:17759:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789131151.959435:0:17759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a45f6c7d/0xf3fe2838e1fc3758 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131151.959441:0:17759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc78de400 already unused, calling callback (ffffffffc0c4e550) 00010000:00010000:2.0:1789131151.959444:0:20403:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789131151.959446:0:17759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a45f6c7d/0xf3fe2838e1fc3758 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131151.959663:0:17760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789131151.959738:0:17759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a45f6c7d/0xf3fe2838e1fc3758 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131151.959753:0:17759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a45f6c7d/0xf3fe2838e1fc3758 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131151.959761:0:17759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a45f6c7d/0xf3fe2838e1fc3758 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131151.959777:0:17759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789131151.959779:0:17759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789131151.959781:0:17759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789131151.959886:0:20403:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789131151.959894:0:20403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005efc07a2/0xf3fe2838e1fc375f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.959902:0:20403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=507s v=(0 0) 00010000:00010000:2.0:1789131151.959905:0:20403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789131151.959909:0:20403:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005efc07a2/0xf3fe2838e1fc375f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.959918:0:20403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005efc07a2/0xf3fe2838e1fc375f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.959938:0:20403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005efc07a2/0xf3fe2838e1fc375f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.959945:0:20403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005efc07a2/0xf3fe2838e1fc375f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.959958:0:20403:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789131151.960077:0:19285:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789131151.960083:0:19285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007df34cb8/0xf3fe2838e1fc3766 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131151.960098:0:19285:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=507s v=(0 0) 00010000:00010000:1.0:1789131151.960101:0:19285:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789131151.960105:0:19285:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007df34cb8/0xf3fe2838e1fc3766 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131151.960115:0:19285:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007df34cb8/0xf3fe2838e1fc3766 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131151.960179:0:19311:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789131151.960184:0:19311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005efc07a2/0xf3fe2838e1fc375f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131151.960191:0:19311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc78dfe00 already unused, calling callback (ffffffffc0c4e550) 00010000:00010000:1.0:1789131151.960193:0:19285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007df34cb8/0xf3fe2838e1fc3766 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131151.960195:0:19311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005efc07a2/0xf3fe2838e1fc375f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131151.960201:0:19285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007df34cb8/0xf3fe2838e1fc3766 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131151.960214:0:19311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005efc07a2/0xf3fe2838e1fc375f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131151.960219:0:19285:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789131151.960226:0:19311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005efc07a2/0xf3fe2838e1fc375f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131151.960233:0:19311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005efc07a2/0xf3fe2838e1fc375f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131151.960247:0:19311:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789131151.960250:0:19311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007df34cb8/0xf3fe2838e1fc3766 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131151.960257:0:19311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc85ca400 already unused, calling callback (ffffffffc0c4e550) 00010000:00010000:3.0:1789131151.960260:0:19311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007df34cb8/0xf3fe2838e1fc3766 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131151.960268:0:19311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007df34cb8/0xf3fe2838e1fc3766 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131151.960278:0:19311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007df34cb8/0xf3fe2838e1fc3766 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131151.960285:0:19311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007df34cb8/0xf3fe2838e1fc3766 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131151.960309:0:19311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789131151.960311:0:19311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789131151.960313:0:19311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789131151.960318:0:17760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789131151.960748:0:19285:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789131151.960754:0:19285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089826788/0xf3fe2838e1fc376d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131151.960763:0:19285:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=507s v=(0 0) 00010000:00010000:1.0:1789131151.960766:0:19285:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789131151.960771:0:19285:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089826788/0xf3fe2838e1fc376d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131151.960780:0:19285:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089826788/0xf3fe2838e1fc376d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131151.960797:0:19285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089826788/0xf3fe2838e1fc376d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131151.960805:0:19285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000089826788/0xf3fe2838e1fc376d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131151.960818:0:19285:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789131151.960826:0:17759:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789131151.960830:0:17759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000089826788/0xf3fe2838e1fc376d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131151.960837:0:17759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc85caa00 already unused, calling callback (ffffffffc0c4e550) 00010000:00010000:1.0:1789131151.960840:0:17759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000089826788/0xf3fe2838e1fc376d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131151.960847:0:17759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000089826788/0xf3fe2838e1fc376d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131151.960859:0:17759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000089826788/0xf3fe2838e1fc376d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131151.960867:0:17759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089826788/0xf3fe2838e1fc376d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131151.960892:0:17759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789131151.960898:0:17759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789131151.960900:0:17759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789131151.961664:0:20403:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789131151.961672:0:20403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008b8a6718/0xf3fe2838e1fc3774 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.961682:0:20403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=507s v=(0 0) 00010000:00010000:2.0:1789131151.961686:0:20403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789131151.961691:0:20403:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008b8a6718/0xf3fe2838e1fc3774 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789131151.962056:0:19285:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789131151.962063:0:19285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb3f6c73/0xf3fe2838e1fc377b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131151.962071:0:19285:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=507s v=(0 0) 00010000:00010000:1.0:1789131151.962074:0:19285:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789131151.962078:0:19285:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eb3f6c73/0xf3fe2838e1fc377b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131151.962088:0:19285:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eb3f6c73/0xf3fe2838e1fc377b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131151.962096:0:19285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb3f6c73/0xf3fe2838e1fc377b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131151.962102:0:19285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eb3f6c73/0xf3fe2838e1fc377b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131151.962121:0:19285:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789131151.962192:0:19311:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789131151.962197:0:19311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eb3f6c73/0xf3fe2838e1fc377b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131151.962205:0:19311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc85cbc00 already unused, calling callback (ffffffffc0c4e550) 00010000:00010000:3.0:1789131151.962209:0:19311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb3f6c73/0xf3fe2838e1fc377b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131151.962218:0:19311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb3f6c73/0xf3fe2838e1fc377b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.962232:0:20403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008b8a6718/0xf3fe2838e1fc3774 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131151.962233:0:19311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eb3f6c73/0xf3fe2838e1fc377b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131151.962257:0:19311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eb3f6c73/0xf3fe2838e1fc377b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.962260:0:20403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008b8a6718/0xf3fe2838e1fc3774 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.962275:0:20403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008b8a6718/0xf3fe2838e1fc3774 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131151.962278:0:19311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789131151.962282:0:19311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789131151.962284:0:19311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131151.962374:0:20403:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789131151.962677:0:17760:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789131151.962682:0:17760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008b8a6718/0xf3fe2838e1fc3774 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131151.962695:0:17760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc78de200 already unused, calling callback (ffffffffc0c4e550) 00010000:00010000:3.0:1789131151.962699:0:17760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008b8a6718/0xf3fe2838e1fc3774 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131151.962706:0:17760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008b8a6718/0xf3fe2838e1fc3774 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131151.962718:0:17760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008b8a6718/0xf3fe2838e1fc3774 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131151.962725:0:17760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789131151.962726:0:17760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789131151.962728:0:17760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131151.962805:0:20403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008b8a6718/0xf3fe2838e1fc3774 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789131151.963071:0:20403:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789131151.963077:0:20403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4c05e0e/0xf3fe2838e1fc3782 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131151.963085:0:20403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=507s v=(0 0) 00010000:00010000:3.0:1789131151.963089:0:20403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789131151.963095:0:20403:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4c05e0e/0xf3fe2838e1fc3782 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131151.963103:0:20403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b4c05e0e/0xf3fe2838e1fc3782 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131151.963109:0:20403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4c05e0e/0xf3fe2838e1fc3782 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131151.963123:0:20403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b4c05e0e/0xf3fe2838e1fc3782 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131151.963143:0:20403:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789131151.963651:0:19285:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789131151.963657:0:19285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008051552f/0xf3fe2838e1fc3789 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131151.963665:0:19285:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=507s v=(0 0) 00010000:00010000:3.0:1789131151.963668:0:19285:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789131151.963673:0:19285:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008051552f/0xf3fe2838e1fc3789 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131151.963682:0:19285:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008051552f/0xf3fe2838e1fc3789 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131151.963690:0:19285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008051552f/0xf3fe2838e1fc3789 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131151.963697:0:19285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008051552f/0xf3fe2838e1fc3789 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789131151.963820:0:20403:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789131151.963826:0:20403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ae8ad666/0xf3fe2838e1fc3790 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131151.963834:0:20403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=507s v=(0 0) 00010000:00010000:1.0:1789131151.963837:0:20403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789131151.963841:0:20403:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ae8ad666/0xf3fe2838e1fc3790 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131151.963857:0:20403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ae8ad666/0xf3fe2838e1fc3790 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131151.963865:0:20403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ae8ad666/0xf3fe2838e1fc3790 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131151.963871:0:20403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ae8ad666/0xf3fe2838e1fc3790 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131151.963900:0:20403:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789131151.964969:0:17759:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789131151.964979:0:17759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b4c05e0e/0xf3fe2838e1fc3782 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.964989:0:17759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddfd0b5400 already unused, calling callback (ffffffffc0c4e550) 00010000:00010000:2.0:1789131151.964994:0:17759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4c05e0e/0xf3fe2838e1fc3782 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.965004:0:17759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4c05e0e/0xf3fe2838e1fc3782 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.965022:0:17759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b4c05e0e/0xf3fe2838e1fc3782 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.965029:0:17759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4c05e0e/0xf3fe2838e1fc3782 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.965048:0:17759:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789131151.965051:0:17759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ae8ad666/0xf3fe2838e1fc3790 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.965069:0:17759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc85ca800 already unused, calling callback (ffffffffc0c4e550) 00010000:00010000:2.0:1789131151.965072:0:17759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae8ad666/0xf3fe2838e1fc3790 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.965079:0:17759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae8ad666/0xf3fe2838e1fc3790 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.965089:0:17759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ae8ad666/0xf3fe2838e1fc3790 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.965095:0:17759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ae8ad666/0xf3fe2838e1fc3790 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.965110:0:17759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131151.965112:0:17759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131151.965114:0:17759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789131151.965974:0:19285:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789131151.965991:0:19311:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789131151.965998:0:19311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008051552f/0xf3fe2838e1fc3789 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131151.966015:0:19311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddfd0b4400 already unused, calling callback (ffffffffc0c4e550) 00010000:00010000:3.0:1789131151.966019:0:19311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008051552f/0xf3fe2838e1fc3789 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131151.966027:0:19311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008051552f/0xf3fe2838e1fc3789 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131151.966040:0:19311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008051552f/0xf3fe2838e1fc3789 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131151.966046:0:19311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008051552f/0xf3fe2838e1fc3789 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131151.966064:0:19311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789131151.966066:0:19311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789131151.966068:0:19311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131151.966989:0:17760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789131151.970274:0:20403:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789131151.970286:0:20403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000089826788/0xf3fe2838e1fc3797 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131151.970302:0:20403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=507s v=(0 0) 00010000:00010000:1.0:1789131151.970306:0:20403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789131151.970313:0:20403:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000089826788/0xf3fe2838e1fc3797 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131151.970326:0:20403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000089826788/0xf3fe2838e1fc3797 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131151.970336:0:20403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000089826788/0xf3fe2838e1fc3797 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131151.970355:0:20403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000089826788/0xf3fe2838e1fc3797 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131151.970568:0:20403:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789131151.970812:0:17759:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789131151.970820:0:17759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000089826788/0xf3fe2838e1fc3797 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.970828:0:17759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc85caa00 already unused, calling callback (ffffffffc0c4e550) 00010000:00010000:2.0:1789131151.970832:0:17759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000089826788/0xf3fe2838e1fc3797 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.970853:0:17759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000089826788/0xf3fe2838e1fc3797 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.970869:0:17759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000089826788/0xf3fe2838e1fc3797 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.970876:0:17759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000089826788/0xf3fe2838e1fc3797 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.970906:0:17759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131151.970908:0:17759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131151.970910:0:17759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789131151.972984:0:19285:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789131151.972996:0:19285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df96b4fa/0xf3fe2838e1fc379e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131151.973012:0:19285:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=507s v=(0 0) 00010000:00010000:1.0:1789131151.973017:0:19285:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789131151.973023:0:19285:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df96b4fa/0xf3fe2838e1fc379e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131151.973036:0:19285:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df96b4fa/0xf3fe2838e1fc379e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131151.973047:0:19285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df96b4fa/0xf3fe2838e1fc379e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131151.973055:0:19285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000df96b4fa/0xf3fe2838e1fc379e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131151.973079:0:19285:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789131151.973772:0:19311:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789131151.973781:0:19311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000df96b4fa/0xf3fe2838e1fc379e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131151.973791:0:19311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc85ca600 already unused, calling callback (ffffffffc0c4e550) 00010000:00010000:3.0:1789131151.973796:0:19311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000df96b4fa/0xf3fe2838e1fc379e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131151.973806:0:19311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000df96b4fa/0xf3fe2838e1fc379e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131151.973831:0:19311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000df96b4fa/0xf3fe2838e1fc379e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131151.973840:0:19311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df96b4fa/0xf3fe2838e1fc379e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131151.973859:0:19311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789131151.973861:0:19311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789131151.973863:0:19311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789131151.976514:0:20100:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:2.0:1789131151.976555:0:20100:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00002000:00010000:1.0:1789131151.976561:0:20403:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000001:00100000:2.0:1789131151.976562:0:20100:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00010000:00010000:1.0:1789131151.976571:0:20403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e39a4ce9/0xf3fe2838e1fc37a5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131151.976591:0:20403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=507s v=(0 0) 00010000:00010000:1.0:1789131151.976595:0:20403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789131151.976599:0:20403:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e39a4ce9/0xf3fe2838e1fc37a5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131151.976610:0:20403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e39a4ce9/0xf3fe2838e1fc37a5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131151.976618:0:20403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e39a4ce9/0xf3fe2838e1fc37a5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131151.976622:0:20403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e39a4ce9/0xf3fe2838e1fc37a5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131151.976640:0:20403:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789131151.976682:0:17760:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789131151.976690:0:17760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e39a4ce9/0xf3fe2838e1fc37a5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.976701:0:17760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc85cac00 already unused, calling callback (ffffffffc0c4e550) 00010000:00010000:2.0:1789131151.976706:0:17760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e39a4ce9/0xf3fe2838e1fc37a5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.976716:0:17760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e39a4ce9/0xf3fe2838e1fc37a5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.976747:0:17760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e39a4ce9/0xf3fe2838e1fc37a5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.976770:0:17760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e39a4ce9/0xf3fe2838e1fc37a5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.976794:0:17760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131151.976797:0:17760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131151.976800:0:17760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789131151.976871:0:19285:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:2.0:1789131151.976873:0:19283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd1dac780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:18518:x1876039508904448:12345-0@lo:5:osp-pre-1-1.0 Request processed in 64811us (64894us total) trans 8589934593 rc 0/0 00010000:00010000:3.0:1789131151.976888:0:19285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4c05e0e/0xf3fe2838e1fc37ac lrc: 3/0,1 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131151.976900:0:19283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:3.0:1789131151.976901:0:19285:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=507s v=(0 0) 00010000:00010000:3.0:1789131151.976907:0:19285:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789131151.976912:0:19285:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b4c05e0e/0xf3fe2838e1fc37ac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131151.976926:0:19285:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b4c05e0e/0xf3fe2838e1fc37ac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131151.976935:0:19285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4c05e0e/0xf3fe2838e1fc37ac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131151.976944:0:19285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b4c05e0e/0xf3fe2838e1fc37ac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131151.976969:0:19285:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789131151.977038:0:18518:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1789131151.977046:0:18518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd1dade00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:18518:1876039508904448:0@lo:5:osp-pre-1-1.0 00000004:00080000:2.0:1789131151.977063:0:18518:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x21:0x0]-[0x2c0000400:0x41:0x0] 00000100:00100000:2.0:1789131151.977124:0:18518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7893480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:18518:1876039508904576:0@lo:900:osp-pre-1-1.0 00000100:00100000:2.0:1789131151.977163:0:18518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131151.977192:0:18518:0:(client.c:2715:ptlrpc_set_wait()) set ffff91dcc6aadd80 going to sleep for 11 seconds 00010000:00010000:2.0:1789131151.977204:0:17759:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789131151.977208:0:17759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b4c05e0e/0xf3fe2838e1fc37ac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.977216:0:17759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddfd0b5400 already unused, calling callback (ffffffffc0c4e550) 00010000:00010000:2.0:1789131151.977220:0:17759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4c05e0e/0xf3fe2838e1fc37ac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.977235:0:17759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4c05e0e/0xf3fe2838e1fc37ac lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.977247:0:17759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b4c05e0e/0xf3fe2838e1fc37ac lrc: 1/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.977255:0:17759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b4c05e0e/0xf3fe2838e1fc37ac lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.977271:0:17759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131151.977273:0:17759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131151.977274:0:17759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789131151.978105:0:17782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508904576 00000100:00100000:3.0:1789131151.978113:0:17782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508904576 00000100:00100000:3.0:1789131151.978188:0:17782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789131151.978199:0:17782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7891e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:18518:x1876039508904576:12345-0@lo:900:osp-pre-1-1.0 00002000:00010000:1.0:1789131151.978213:0:20403:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:2.0:1789131151.978214:0:19285:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789131151.978228:0:19285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b8a6718/0xf3fe2838e1fc37ba lrc: 3/0,1 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131151.978229:0:20403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000089826788/0xf3fe2838e1fc37b3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.978249:0:19285:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=507s v=(0 0) 00010000:00010000:1.0:1789131151.978251:0:20403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=507s v=(0 0) 00010000:00010000:2.0:1789131151.978255:0:19285:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789131151.978257:0:20403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789131151.978262:0:19285:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b8a6718/0xf3fe2838e1fc37ba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131151.978264:0:20403:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000089826788/0xf3fe2838e1fc37b3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131151.978267:0:17782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7891e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:18518:x1876039508904576:12345-0@lo:900:osp-pre-1-1.0 Request processed in 69us (1104us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131151.978284:0:17782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1789131151.978287:0:19285:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b8a6718/0xf3fe2838e1fc37ba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.978305:0:19285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b8a6718/0xf3fe2838e1fc37ba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131151.978306:0:20403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000089826788/0xf3fe2838e1fc37b3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.978323:0:19285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008b8a6718/0xf3fe2838e1fc37ba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:3.0:1789131151.978335:0:18518:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc7893480 x1876039508904576/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789131167 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1789131151.978346:0:20403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000089826788/0xf3fe2838e1fc37b3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131151.978355:0:18518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7893480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:18518:1876039508904576:0@lo:900:osp-pre-1-1.0 00010000:00010000:2.0:1789131151.978355:0:19285:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789131151.978358:0:20403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000089826788/0xf3fe2838e1fc37b3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131151.978386:0:20403:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789131151.978390:0:19311:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789131151.978397:0:17760:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789131151.978398:0:19311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008b8a6718/0xf3fe2838e1fc37ba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.978404:0:17760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000089826788/0xf3fe2838e1fc37b3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.978417:0:17760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc85caa00 already unused, calling callback (ffffffffc0c4e550) 00010000:00010000:2.0:1789131151.978423:0:17760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000089826788/0xf3fe2838e1fc37b3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131151.978425:0:19311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc78de200 already unused, calling callback (ffffffffc0c4e550) 00010000:00010000:3.0:1789131151.978432:0:19311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008b8a6718/0xf3fe2838e1fc37ba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.978436:0:17760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000089826788/0xf3fe2838e1fc37b3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131151.978448:0:19311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008b8a6718/0xf3fe2838e1fc37ba lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.979031:0:17760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000089826788/0xf3fe2838e1fc37b3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.979042:0:17760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000089826788/0xf3fe2838e1fc37b3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.979060:0:17760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131151.979061:0:17760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131151.979063:0:17760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789131151.979489:0:19311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008b8a6718/0xf3fe2838e1fc37ba lrc: 1/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131151.979510:0:19311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b8a6718/0xf3fe2838e1fc37ba lrc: 0/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131151.979531:0:19311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789131151.979534:0:19311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789131151.979536:0:19311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789131151.979891:0:19285:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789131151.979908:0:19285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000940afcb2/0xf3fe2838e1fc37c1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.979917:0:19285:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=507s v=(0 0) 00010000:00010000:2.0:1789131151.979921:0:19285:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789131151.979927:0:19285:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000940afcb2/0xf3fe2838e1fc37c1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.979937:0:19285:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000940afcb2/0xf3fe2838e1fc37c1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789131151.979991:0:20403:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789131151.979998:0:20403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008051552f/0xf3fe2838e1fc37c8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131151.980006:0:20403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=507s v=(0 0) 00010000:00010000:3.0:1789131151.980010:0:20403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789131151.980013:0:20403:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008051552f/0xf3fe2838e1fc37c8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131151.980023:0:20403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008051552f/0xf3fe2838e1fc37c8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131151.980031:0:20403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008051552f/0xf3fe2838e1fc37c8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131151.980039:0:20403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008051552f/0xf3fe2838e1fc37c8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.980063:0:19285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000940afcb2/0xf3fe2838e1fc37c1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131151.980076:0:20403:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789131151.980076:0:19285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000940afcb2/0xf3fe2838e1fc37c1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.980160:0:17759:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789131151.980167:0:17759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008051552f/0xf3fe2838e1fc37c8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.980175:0:17759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddfd0b4400 already unused, calling callback (ffffffffc0c4e550) 00010000:00010000:2.0:1789131151.980179:0:17759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008051552f/0xf3fe2838e1fc37c8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.980187:0:17759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008051552f/0xf3fe2838e1fc37c8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131151.980562:0:19285:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789131151.980670:0:17759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008051552f/0xf3fe2838e1fc37c8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.980678:0:17759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008051552f/0xf3fe2838e1fc37c8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131151.980686:0:17760:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789131151.980694:0:17760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000940afcb2/0xf3fe2838e1fc37c1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.980695:0:17759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131151.980698:0:17759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131151.980701:0:17759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789131151.980709:0:17760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc78dee00 already unused, calling callback (ffffffffc0c4e550) 00010000:00010000:0.0:1789131151.980714:0:17760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000940afcb2/0xf3fe2838e1fc37c1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131151.980723:0:17760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000940afcb2/0xf3fe2838e1fc37c1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131151.980736:0:17760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000940afcb2/0xf3fe2838e1fc37c1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131151.980743:0:17760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000940afcb2/0xf3fe2838e1fc37c1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131151.980759:0:17760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789131151.980760:0:17760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789131151.980762:0:17760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789131151.982659:0:20403:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789131151.982672:0:20403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000051d36583/0xf3fe2838e1fc37cf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131151.982687:0:20403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=507s v=(0 0) 00010000:00010000:3.0:1789131151.982690:0:20403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789131151.982697:0:20403:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000051d36583/0xf3fe2838e1fc37cf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131151.982710:0:20403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000051d36583/0xf3fe2838e1fc37cf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131151.982720:0:20403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000051d36583/0xf3fe2838e1fc37cf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131151.982728:0:20403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000051d36583/0xf3fe2838e1fc37cf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131151.982751:0:20403:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789131151.982790:0:19311:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789131151.982798:0:19311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000051d36583/0xf3fe2838e1fc37cf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.982808:0:19311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddfd0b4800 already unused, calling callback (ffffffffc0c4e550) 00010000:00010000:2.0:1789131151.982812:0:19311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000051d36583/0xf3fe2838e1fc37cf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.982822:0:19311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000051d36583/0xf3fe2838e1fc37cf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.982837:0:19311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000051d36583/0xf3fe2838e1fc37cf lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.982846:0:19311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000051d36583/0xf3fe2838e1fc37cf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.982887:0:19311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131151.982890:0:19311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131151.982893:0:19311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789131151.982968:0:19285:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789131151.982976:0:19285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000786a2989/0xf3fe2838e1fc37d6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131151.982984:0:19285:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=507s v=(0 0) 00010000:00010000:0.0:1789131151.982988:0:19285:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789131151.982992:0:19285:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000786a2989/0xf3fe2838e1fc37d6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131151.983001:0:19285:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000786a2989/0xf3fe2838e1fc37d6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131151.983010:0:19285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000786a2989/0xf3fe2838e1fc37d6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131151.983018:0:19285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000786a2989/0xf3fe2838e1fc37d6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131151.983034:0:19285:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789131151.983057:0:17759:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789131151.983063:0:17759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000786a2989/0xf3fe2838e1fc37d6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.983071:0:17759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91de01ad7e00 already unused, calling callback (ffffffffc0c4e550) 00010000:00010000:2.0:1789131151.983074:0:17759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000786a2989/0xf3fe2838e1fc37d6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.983084:0:17759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000786a2989/0xf3fe2838e1fc37d6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.983097:0:17759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000786a2989/0xf3fe2838e1fc37d6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.983105:0:17759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000786a2989/0xf3fe2838e1fc37d6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.983122:0:17759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131151.983125:0:17759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131151.983128:0:17759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789131151.983311:0:19285:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789131151.983318:0:19285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac7d66f9/0xf3fe2838e1fc37dd lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131151.983327:0:19285:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=507s v=(0 0) 00010000:00010000:0.0:1789131151.983331:0:19285:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789131151.983335:0:19285:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ac7d66f9/0xf3fe2838e1fc37dd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131151.983357:0:19285:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ac7d66f9/0xf3fe2838e1fc37dd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131151.983365:0:19285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac7d66f9/0xf3fe2838e1fc37dd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131151.983372:0:19285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ac7d66f9/0xf3fe2838e1fc37dd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131151.983394:0:19285:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789131151.983836:0:19285:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789131151.983849:0:19285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000511880b5/0xf3fe2838e1fc37e4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131151.983865:0:19285:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=507s v=(0 0) 00010000:00010000:0.0:1789131151.983870:0:19285:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789131151.983887:0:19285:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000511880b5/0xf3fe2838e1fc37e4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131151.983904:0:19285:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000511880b5/0xf3fe2838e1fc37e4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131151.983914:0:19285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000511880b5/0xf3fe2838e1fc37e4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131151.983942:0:19285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000511880b5/0xf3fe2838e1fc37e4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.983946:0:17760:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789131151.983959:0:17760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ac7d66f9/0xf3fe2838e1fc37dd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131151.983973:0:19285:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789131151.983989:0:17760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91de01ad6200 already unused, calling callback (ffffffffc0c4e550) 00010000:00010000:2.0:1789131151.983993:0:17760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac7d66f9/0xf3fe2838e1fc37dd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.984003:0:17760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac7d66f9/0xf3fe2838e1fc37dd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.984017:0:17760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ac7d66f9/0xf3fe2838e1fc37dd lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.984026:0:17760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ac7d66f9/0xf3fe2838e1fc37dd lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.984045:0:17760:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789131151.984049:0:17760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000511880b5/0xf3fe2838e1fc37e4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.984055:0:17760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91de01ad7600 already unused, calling callback (ffffffffc0c4e550) 00010000:00010000:2.0:1789131151.984059:0:17760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000511880b5/0xf3fe2838e1fc37e4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.984067:0:17760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000511880b5/0xf3fe2838e1fc37e4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.984079:0:17760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000511880b5/0xf3fe2838e1fc37e4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.984094:0:17760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000511880b5/0xf3fe2838e1fc37e4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.984109:0:17760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131151.984111:0:17760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131151.984113:0:17760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789131151.984387:0:19311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789131151.984764:0:20403:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789131151.984772:0:20403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000941e4fe1/0xf3fe2838e1fc37eb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.984783:0:20403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=507s v=(0 0) 00010000:00010000:2.0:1789131151.984787:0:20403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789131151.984792:0:20403:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000941e4fe1/0xf3fe2838e1fc37eb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.984803:0:20403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000941e4fe1/0xf3fe2838e1fc37eb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.984812:0:20403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000941e4fe1/0xf3fe2838e1fc37eb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.984820:0:20403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000941e4fe1/0xf3fe2838e1fc37eb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.984834:0:20403:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789131151.984841:0:17759:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789131151.984852:0:17759:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000941e4fe1/0xf3fe2838e1fc37eb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.984871:0:17759:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc78dec00 already unused, calling callback (ffffffffc0c4e550) 00010000:00010000:2.0:1789131151.984875:0:17759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000941e4fe1/0xf3fe2838e1fc37eb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.984891:0:17759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000941e4fe1/0xf3fe2838e1fc37eb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.984903:0:17759:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000941e4fe1/0xf3fe2838e1fc37eb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.984910:0:17759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000941e4fe1/0xf3fe2838e1fc37eb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.984925:0:17759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131151.984927:0:17759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131151.984928:0:17759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789131151.985492:0:20403:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789131151.985499:0:20403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab1da9e3/0xf3fe2838e1fc37f2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.985510:0:20403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=507s v=(0 0) 00010000:00010000:2.0:1789131151.985513:0:20403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789131151.985518:0:20403:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ab1da9e3/0xf3fe2838e1fc37f2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.985540:0:20403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ab1da9e3/0xf3fe2838e1fc37f2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.985549:0:20403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab1da9e3/0xf3fe2838e1fc37f2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.985557:0:20403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ab1da9e3/0xf3fe2838e1fc37f2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.985572:0:20403:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789131151.985581:0:17760:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789131151.985585:0:17760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ab1da9e3/0xf3fe2838e1fc37f2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.985593:0:17760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc78df200 already unused, calling callback (ffffffffc0c4e550) 00010000:00010000:2.0:1789131151.985596:0:17760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab1da9e3/0xf3fe2838e1fc37f2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.985604:0:17760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab1da9e3/0xf3fe2838e1fc37f2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.985616:0:17760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ab1da9e3/0xf3fe2838e1fc37f2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.985624:0:17760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ab1da9e3/0xf3fe2838e1fc37f2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.985646:0:17760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131151.985648:0:17760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131151.985650:0:17760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789131151.986204:0:19285:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789131151.986212:0:19285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae8ad666/0xf3fe2838e1fc37f9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131151.986221:0:19285:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=507s v=(0 0) 00010000:00010000:1.0:1789131151.986224:0:19285:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789131151.986228:0:19285:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ae8ad666/0xf3fe2838e1fc37f9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131151.986238:0:19285:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ae8ad666/0xf3fe2838e1fc37f9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131151.986246:0:19285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae8ad666/0xf3fe2838e1fc37f9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131151.986254:0:19285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ae8ad666/0xf3fe2838e1fc37f9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131151.986288:0:19285:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789131151.986295:0:19311:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789131151.986302:0:19311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ae8ad666/0xf3fe2838e1fc37f9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131151.986312:0:19311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc85ca800 already unused, calling callback (ffffffffc0c4e550) 00010000:00010000:3.0:1789131151.986317:0:19311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae8ad666/0xf3fe2838e1fc37f9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131151.986337:0:19311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae8ad666/0xf3fe2838e1fc37f9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131151.986352:0:19311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ae8ad666/0xf3fe2838e1fc37f9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131151.986360:0:19311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ae8ad666/0xf3fe2838e1fc37f9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131151.986376:0:19311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789131151.986378:0:19311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789131151.986380:0:19311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789131151.989017:0:19285:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789131151.989029:0:19285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000064e094ae/0xf3fe2838e1fc3800 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.989043:0:19285:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=507s v=(0 0) 00010000:00010000:2.0:1789131151.989046:0:19285:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789131151.989051:0:19285:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000064e094ae/0xf3fe2838e1fc3800 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.989063:0:19285:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000064e094ae/0xf3fe2838e1fc3800 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.989072:0:19285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000064e094ae/0xf3fe2838e1fc3800 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.989079:0:19285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000064e094ae/0xf3fe2838e1fc3800 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.989101:0:19285:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789131151.989307:0:20403:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789131151.989313:0:20403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004047e222/0xf3fe2838e1fc3807 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.989332:0:20403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=507s v=(0 0) 00010000:00010000:2.0:1789131151.989335:0:20403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789131151.989340:0:20403:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004047e222/0xf3fe2838e1fc3807 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.989350:0:20403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004047e222/0xf3fe2838e1fc3807 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.989358:0:20403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004047e222/0xf3fe2838e1fc3807 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.989365:0:20403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004047e222/0xf3fe2838e1fc3807 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.989380:0:20403:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789131151.989389:0:17760:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789131151.989395:0:17760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000064e094ae/0xf3fe2838e1fc3800 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.989415:0:17760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc78df000 already unused, calling callback (ffffffffc0c4e550) 00010000:00010000:2.0:1789131151.989419:0:17760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000064e094ae/0xf3fe2838e1fc3800 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.989428:0:17760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000064e094ae/0xf3fe2838e1fc3800 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.989454:0:17760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000064e094ae/0xf3fe2838e1fc3800 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.989486:0:17760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000064e094ae/0xf3fe2838e1fc3800 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.989503:0:17760:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789131151.989507:0:17760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004047e222/0xf3fe2838e1fc3807 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.989513:0:17760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc78df400 already unused, calling callback (ffffffffc0c4e550) 00010000:00010000:2.0:1789131151.989517:0:17760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004047e222/0xf3fe2838e1fc3807 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.989524:0:17760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004047e222/0xf3fe2838e1fc3807 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.989533:0:17760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004047e222/0xf3fe2838e1fc3807 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.989540:0:17760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004047e222/0xf3fe2838e1fc3807 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.989551:0:17760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131151.989552:0:17760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131151.989559:0:17760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789131151.990700:0:20403:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:1.0:1789131151.990710:0:19285:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789131151.990711:0:20403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eb668281/0xf3fe2838e1fc380e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131151.990721:0:19285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb3f6c73/0xf3fe2838e1fc3815 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.990725:0:20403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=507s v=(0 0) 00010000:00010000:2.0:1789131151.990734:0:20403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789131151.990737:0:19285:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=507s v=(0 0) 00010000:00010000:2.0:1789131151.990741:0:20403:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eb668281/0xf3fe2838e1fc380e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131151.990742:0:19285:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789131151.990750:0:19285:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eb3f6c73/0xf3fe2838e1fc3815 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.990760:0:20403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eb668281/0xf3fe2838e1fc380e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131151.990764:0:19285:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eb3f6c73/0xf3fe2838e1fc3815 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.990779:0:20403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eb668281/0xf3fe2838e1fc380e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131151.990782:0:19285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb3f6c73/0xf3fe2838e1fc3815 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.990799:0:20403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eb668281/0xf3fe2838e1fc380e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131151.990801:0:19285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eb3f6c73/0xf3fe2838e1fc3815 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.990827:0:20403:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789131151.991192:0:19285:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789131151.991242:0:19311:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789131151.991250:0:19311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eb668281/0xf3fe2838e1fc380e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131151.991259:0:19311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc78df800 already unused, calling callback (ffffffffc0c4e550) 00010000:00010000:3.0:1789131151.991264:0:19311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eb668281/0xf3fe2838e1fc380e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131151.991274:0:19311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eb668281/0xf3fe2838e1fc380e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131151.991290:0:19311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eb668281/0xf3fe2838e1fc380e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131151.991312:0:19311:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789131151.991316:0:19311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eb3f6c73/0xf3fe2838e1fc3815 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131151.991323:0:19311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc85cbc00 already unused, calling callback (ffffffffc0c4e550) 00010000:00010000:3.0:1789131151.991326:0:19311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb3f6c73/0xf3fe2838e1fc3815 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131151.991335:0:19311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb3f6c73/0xf3fe2838e1fc3815 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131151.991346:0:19311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eb3f6c73/0xf3fe2838e1fc3815 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131151.991352:0:19311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eb3f6c73/0xf3fe2838e1fc3815 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131151.991366:0:19311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789131151.991367:0:19311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789131151.991369:0:19311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789131151.991376:0:17759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131151.991498:0:20403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eb668281/0xf3fe2838e1fc380e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789131151.991976:0:19285:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789131151.991983:0:19285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007df34cb8/0xf3fe2838e1fc381c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131151.991992:0:19285:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=507s v=(0 0) 00010000:00010000:1.0:1789131151.992002:0:19285:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789131151.992007:0:19285:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007df34cb8/0xf3fe2838e1fc381c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789131151.992010:0:20403:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789131151.992021:0:20403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b36e7b15/0xf3fe2838e1fc3823 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131151.992025:0:19285:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007df34cb8/0xf3fe2838e1fc381c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.992037:0:20403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=507s v=(0 0) 00010000:00010000:1.0:1789131151.992042:0:19285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007df34cb8/0xf3fe2838e1fc381c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.992052:0:20403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789131151.992055:0:19285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007df34cb8/0xf3fe2838e1fc381c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.992059:0:20403:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b36e7b15/0xf3fe2838e1fc3823 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.992077:0:20403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b36e7b15/0xf3fe2838e1fc3823 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.992086:0:20403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b36e7b15/0xf3fe2838e1fc3823 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131151.992088:0:19285:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789131151.992095:0:20403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b36e7b15/0xf3fe2838e1fc3823 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.992112:0:20403:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789131151.992199:0:17760:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789131151.992205:0:17760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007df34cb8/0xf3fe2838e1fc381c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131151.992212:0:17760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc85ca400 already unused, calling callback (ffffffffc0c4e550) 00010000:00010000:1.0:1789131151.992215:0:17760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007df34cb8/0xf3fe2838e1fc381c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131151.992223:0:17760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007df34cb8/0xf3fe2838e1fc381c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131151.992234:0:17760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007df34cb8/0xf3fe2838e1fc381c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131151.992253:0:17760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007df34cb8/0xf3fe2838e1fc381c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131151.992268:0:17760:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789131151.992272:0:17760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b36e7b15/0xf3fe2838e1fc3823 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131151.992278:0:17760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc78dfc00 already unused, calling callback (ffffffffc0c4e550) 00010000:00010000:1.0:1789131151.992281:0:17760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b36e7b15/0xf3fe2838e1fc3823 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131151.992289:0:17760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b36e7b15/0xf3fe2838e1fc3823 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131151.992300:0:17760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b36e7b15/0xf3fe2838e1fc3823 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131151.992306:0:17760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b36e7b15/0xf3fe2838e1fc3823 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131151.992316:0:17760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789131151.992317:0:17760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789131151.992319:0:17760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789131151.992560:0:19285:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789131151.992566:0:19285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000074dd2b8/0xf3fe2838e1fc382a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131151.992591:0:19285:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=507s v=(0 0) 00010000:00010000:1.0:1789131151.992595:0:19285:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789131151.992600:0:19285:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000074dd2b8/0xf3fe2838e1fc382a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131151.992608:0:19285:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000074dd2b8/0xf3fe2838e1fc382a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131151.992615:0:19285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000074dd2b8/0xf3fe2838e1fc382a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131151.992622:0:19285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000074dd2b8/0xf3fe2838e1fc382a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131151.992634:0:19285:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:1.0:1789131151.992668:0:19285:0:(ofd_dev.c:1532:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:5 00000100:00100000:1.0:1789131151.992767:0:19285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddca0c43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17796:x1876039508903808:12345-0@lo:5:osp-pre-0-0.0 Request processed in 93426us (93760us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131151.992777:0:19285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789131151.992836:0:17796:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd286c780 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17796:1876039508903808:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1789131151.992851:0:17796:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x21:0x0] from OST, last_created [0x280000401:0x21:0x0]last_used is [0x280000401:0x5:0x0] 00000100:00100000:1.0:1789131151.992905:0:17796:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddca0fa940 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17796:1876039508904704:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1789131151.992940:0:17796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131151.992963:0:17796:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddd85edd80 going to sleep for 11 seconds 00000100:00100000:1.0:1789131151.992986:0:19981:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508904704 00000100:00100000:1.0:1789131151.992991:0:19981:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508904704 00000100:00100000:1.0:1789131151.993024:0:19981:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789131151.993031:0:19981:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddca0fad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17796:x1876039508904704:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1789131151.993061:0:19981:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 34 00002000:00010000:2.0:1789131151.994598:0:20403:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789131151.994609:0:20403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000071e2e880/0xf3fe2838e1fc3831 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.994621:0:20403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=507s v=(0 0) 00010000:00010000:2.0:1789131151.994625:0:20403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789131151.994630:0:20403:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000071e2e880/0xf3fe2838e1fc3831 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.994643:0:20403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000071e2e880/0xf3fe2838e1fc3831 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.994652:0:20403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000071e2e880/0xf3fe2838e1fc3831 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.994666:0:20403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000071e2e880/0xf3fe2838e1fc3831 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131151.994677:0:20403:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00080000:2.0:1789131151.994725:0:20403:0:(ofd_dev.c:1532:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:6 00000100:00100000:2.0:1789131151.994796:0:20403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddca0c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:17798:x1876039508904192:12345-0@lo:5:osp-pre-1-0.0 Request processed in 92010us (94894us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131151.994806:0:20403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789131151.994853:0:17798:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddca0c61c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17798:1876039508904192:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1789131151.994866:0:17798:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x21:0x0] from OST, last_created [0x2c0000401:0x21:0x0]last_used is [0x2c0000401:0x6:0x0] 00000100:00100000:2.0:1789131151.994928:0:17798:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7893840 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17798:1876039508904832:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1789131151.994976:0:17798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131151.995000:0:17798:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddc5190f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789131151.995019:0:19283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508904832 00000100:00100000:2.0:1789131151.995024:0:19283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508904832 00000100:00100000:2.0:1789131151.995062:0:19283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789131151.995072:0:19283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7892580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:17798:x1876039508904832:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1789131151.995101:0:19283:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 34 00010000:00010000:1.0:1789131151.995447:0:17760:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789131151.995455:0:17760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000074dd2b8/0xf3fe2838e1fc382a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131151.995477:0:17760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc85cb400 already unused, calling callback (ffffffffc0c4e550) 00010000:00010000:1.0:1789131151.995481:0:17760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000074dd2b8/0xf3fe2838e1fc382a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131151.995492:0:17760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000074dd2b8/0xf3fe2838e1fc382a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131151.995508:0:17760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000074dd2b8/0xf3fe2838e1fc382a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131151.995516:0:17760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000074dd2b8/0xf3fe2838e1fc382a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131151.995536:0:17760:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789131151.995539:0:17760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000071e2e880/0xf3fe2838e1fc3831 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131151.995545:0:17760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc78dea00 already unused, calling callback (ffffffffc0c4e550) 00010000:00010000:1.0:1789131151.995554:0:17760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000071e2e880/0xf3fe2838e1fc3831 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131151.995562:0:17760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000071e2e880/0xf3fe2838e1fc3831 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131151.995572:0:17760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000071e2e880/0xf3fe2838e1fc3831 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131151.995579:0:17760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000071e2e880/0xf3fe2838e1fc3831 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131151.995592:0:17760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789131151.995594:0:17760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789131151.995595:0:17760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789131151.996315:0:19311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789131151.996324:0:17759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789131152.001437:0:19279:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00100000:3.0:1789131152.001502:0:19279:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1789131152.003706:0:19981:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddca0fad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:17796:x1876039508904704:12345-0@lo:5:osp-pre-0-0.0 Request processed in 10666us (10758us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1789131152.003727:0:19981:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789131152.003789:0:17796:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:3.0:1789131152.003798:0:17796:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddca0fa940 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17796:1876039508904704:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1789131152.003815:0:17796:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x21:0x0]-[0x280000401:0x41:0x0] 00000100:00100000:2.0:1789131152.005972:0:19283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7892580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:17798:x1876039508904832:12345-0@lo:5:osp-pre-1-0.0 Request processed in 10894us (10989us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1789131152.005986:0:19283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789131152.006013:0:17798:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7893840 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17798:1876039508904832:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1789131152.006030:0:17798:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x21:0x0]-[0x2c0000401:0x41:0x0] 00010000:00010000:3.0:1789131152.403482:0:17760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789131152.571147:0:20459:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg311-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000020:00000004:0.0:1789131153.369877:0:20511:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789131153.370108:0:20511:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789131153.425645:0:19311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789131154.313140:0:20561:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789131154.313403:0:20561:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789131154.451952:0:17759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789131154.564450:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131154.564655:0:17764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498324608 00000100:00100000:0.0:1789131154.564665:0:17764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498324608 00000100:00100000:1.0:1789131154.564849:0:17764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 114 00000100:00100000:1.0:1789131154.564858:0:17764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd2c88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2384:x1876039498324608:12345-192.168.203.11@tcp:250:mount.lustre.0 00010000:00080000:1.0:1789131154.564897:0:17764:0:(ldlm_lib.c:1482:target_handle_connect()) MGS: connection from 22edf929-4c0f-42f3-973d-fe4d92543efa@192.168.203.11@tcp t0 exp 0000000000000000 cur 510 last 0 00000020:00000080:1.0:1789131154.564923:0:17764:0:(genops.c:1385:class_connect()) connect: client 22edf929-4c0f-42f3-973d-fe4d92543efa, cookie 0xf3fe2838e1fc3838 00000100:00080000:1.0:1789131154.565070:0:17764:0:(import.c:65:import_set_state_nolock()) ffff91dde6d1e800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789131154.565150:0:17764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd2c88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22edf929-4c0f-42f3-973d-fe4d92543efa+5:2384:x1876039498324608:12345-192.168.203.11@tcp:250:mount.lustre.0 Request processed in 291us (708us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131154.565158:0:17764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 114 00000100:00100000:1.0:1789131154.577785:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131154.577921:0:17765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498324736 00000100:00100000:3.0:1789131154.577931:0:17765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498324736 00000100:00100000:3.0:1789131154.577994:0:17765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 115 00000100:00100000:3.0:1789131154.578004:0:17765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd2c8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22edf929-4c0f-42f3-973d-fe4d92543efa+5:15148:x1876039498324736:12345-192.168.203.11@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789131154.578021:0:17765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789131154.578038:0:17765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91ddfd0b4a00/0xf3fe2838e1fc383f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269d3f expref: -99 pid: 17765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131154.578065:0:17765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91ddfd0b4a00/0xf3fe2838e1fc383f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269d3f expref: 6 pid: 17765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131154.578088:0:17765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91ddfd0b4a00/0xf3fe2838e1fc383f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269d3f expref: 6 pid: 17765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131154.578097:0:17765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ddfd0b4a00, rc 0) 00000100:00100000:3.0:1789131154.578158:0:17765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd2c8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22edf929-4c0f-42f3-973d-fe4d92543efa+6:15148:x1876039498324736:12345-192.168.203.11@tcp:101:mount.lustre.0 Request processed in 155us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131154.578177:0:17765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 115 00000100:00100000:2.0:1789131154.584151:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789131154.584431:0:17764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498324864 00000100:00100000:1.0:1789131154.584501:0:17764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498324864 00000100:00100000:1.0:1789131154.584654:0:17764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 116 00000100:00100000:1.0:1789131154.584677:0:17764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd2c89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22edf929-4c0f-42f3-973d-fe4d92543efa+6:15148:x1876039498324864:12345-192.168.203.11@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789131154.584835:0:17764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd2c89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22edf929-4c0f-42f3-973d-fe4d92543efa+6:15148:x1876039498324864:12345-192.168.203.11@tcp:501:mount.lustre.0 Request processed in 171us (694us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789131154.584845:0:17764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 116 00000100:00100000:1.0:1789131154.589639:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131154.591678:0:17766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498324992 00000100:00100000:0.0:1789131154.591697:0:17766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498324992 00000100:00100000:0.0:1789131154.591852:0:17766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 117 00000100:00100000:0.0:1789131154.591874:0:17766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd2c8a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22edf929-4c0f-42f3-973d-fe4d92543efa+6:15148:x1876039498324992:12345-192.168.203.11@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789131154.591899:0:17766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789131154.591923:0:17766:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91de01ad6600/0xf3fe2838e1fc3846 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269d46 expref: -99 pid: 17766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131154.591960:0:17766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91de01ad6600/0xf3fe2838e1fc3846 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269d46 expref: 7 pid: 17766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131154.591972:0:17766:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91de01ad6600/0xf3fe2838e1fc3846 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269d46 expref: 7 pid: 17766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131154.591982:0:17766:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91de01ad6600, rc 0) 00000100:00100000:0.0:1789131154.592068:0:17766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd2c8a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22edf929-4c0f-42f3-973d-fe4d92543efa+7:15148:x1876039498324992:12345-192.168.203.11@tcp:101:mount.lustre.0 Request processed in 205us (2442us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131154.592107:0:17766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 117 00000100:00100000:3.0:1789131154.595376:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789131154.595509:0:17765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498325120 00000100:00100000:1.0:1789131154.595523:0:17765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498325120 00000100:00100000:1.0:1789131154.595628:0:17765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 118 00000100:00100000:1.0:1789131154.595640:0:17765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd2c89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22edf929-4c0f-42f3-973d-fe4d92543efa+7:15148:x1876039498325120:12345-192.168.203.11@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789131154.595876:0:17765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd2c89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22edf929-4c0f-42f3-973d-fe4d92543efa+8:15148:x1876039498325120:12345-192.168.203.11@tcp:501:mount.lustre.0 Request processed in 238us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131154.595886:0:17765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 118 00000100:00100000:2.0:1789131154.597985:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789131154.598569:0:17765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498325248 00000100:00100000:1.0:1789131154.598582:0:17765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498325248 00000100:00100000:1.0:1789131154.598649:0:17765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 119 00000100:00100000:1.0:1789131154.598661:0:17765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd2c8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22edf929-4c0f-42f3-973d-fe4d92543efa+8:15148:x1876039498325248:12345-192.168.203.11@tcp:503:mount.lustre.0 00000100:00100000:1.0:1789131154.598857:0:17765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd2c8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22edf929-4c0f-42f3-973d-fe4d92543efa+8:15148:x1876039498325248:12345-192.168.203.11@tcp:503:mount.lustre.0 Request processed in 197us (884us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131154.598874:0:17765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 119 00000100:00100000:3.0:1789131154.603206:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131154.603697:0:17766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498325376 00000100:00100000:0.0:1789131154.603710:0:17766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498325376 00000100:00100000:0.0:1789131154.603837:0:17766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 120 00000100:00100000:0.0:1789131154.603850:0:17766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd2c89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22edf929-4c0f-42f3-973d-fe4d92543efa+8:15166:x1876039498325376:12345-192.168.203.11@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789131154.604098:0:17766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd2c89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22edf929-4c0f-42f3-973d-fe4d92543efa+8:15166:x1876039498325376:12345-192.168.203.11@tcp:502:llog_process_th.0 Request processed in 249us (907us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131154.604106:0:17766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 120 00000100:00100000:3.0:1789131154.627964:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789131154.628241:0:17765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498325504 00000100:00100000:1.0:1789131154.628254:0:17765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498325504 00000100:00100000:1.0:1789131154.628339:0:17765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 121 00000100:00100000:1.0:1789131154.628350:0:17765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd2c8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22edf929-4c0f-42f3-973d-fe4d92543efa+8:15166:x1876039498325504:12345-192.168.203.11@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789131154.628607:0:17765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd2c8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22edf929-4c0f-42f3-973d-fe4d92543efa+8:15166:x1876039498325504:12345-192.168.203.11@tcp:502:llog_process_th.0 Request processed in 257us (657us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131154.628616:0:17765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 121 00000100:00100000:1.0:1789131154.635250:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131154.635503:0:17766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498325632 00000100:00100000:0.0:1789131154.635516:0:17766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498325632 00000100:00100000:0.0:1789131154.635591:0:17766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 122 00000100:00100000:0.0:1789131154.635602:0:17766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd2c88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22edf929-4c0f-42f3-973d-fe4d92543efa+8:15166:x1876039498325632:12345-192.168.203.11@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789131154.635813:0:17766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd2c88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22edf929-4c0f-42f3-973d-fe4d92543efa+8:15166:x1876039498325632:12345-192.168.203.11@tcp:502:llog_process_th.0 Request processed in 212us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131154.635823:0:17766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 122 00000100:00100000:2.0:1789131154.644899:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131154.645267:0:17764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498325760 00000100:00100000:3.0:1789131154.645280:0:17764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498325760 00000100:00100000:3.0:1789131154.645416:0:17764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 123 00000100:00100000:3.0:1789131154.645429:0:17764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd2c8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22edf929-4c0f-42f3-973d-fe4d92543efa+8:15148:x1876039498325760:12345-192.168.203.11@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789131154.645451:0:17764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789131154.645528:0:17764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91ddfd0b4800/0xf3fe2838e1fc384d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269d77 expref: -99 pid: 17764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131154.645571:0:17764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91ddfd0b4800/0xf3fe2838e1fc384d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269d77 expref: 9 pid: 17764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131154.645584:0:17764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91ddfd0b4800/0xf3fe2838e1fc384d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269d77 expref: 9 pid: 17764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131154.645595:0:17764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ddfd0b4800, rc 0) 00000100:00100000:3.0:1789131154.645666:0:17764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd2c8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22edf929-4c0f-42f3-973d-fe4d92543efa+9:15148:x1876039498325760:12345-192.168.203.11@tcp:101:mount.lustre.0 Request processed in 240us (782us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131154.645675:0:17764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 123 00000100:00100000:3.0:1789131154.653374:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789131154.653537:0:17765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498325888 00000100:00100000:1.0:1789131154.653551:0:17765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498325888 00000100:00100000:1.0:1789131154.653633:0:17765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 124 00000100:00100000:1.0:1789131154.653647:0:17765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd2c8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22edf929-4c0f-42f3-973d-fe4d92543efa+9:15148:x1876039498325888:12345-192.168.203.11@tcp:256:mount.lustre.0 20000000:01000000:1.0:1789131154.653683:0:17765:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1789131154.653841:0:17765:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1789131154.653847:0:17765:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1789131154.653850:0:17765:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1789131154.653853:0:17765:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1789131154.653856:0:17765:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:3.0:1789131154.658114:0:17765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd2c8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22edf929-4c0f-42f3-973d-fe4d92543efa+9:15148:x1876039498325888:12345-192.168.203.11@tcp:256:mount.lustre.0 Request processed in 4454us (4742us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131154.658133:0:17765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 124 00000100:00100000:2.0:1789131154.666572:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131154.668005:0:17764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498326016 00000100:00100000:3.0:1789131154.668043:0:17764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498326016 00000100:00100000:3.0:1789131154.668184:0:17764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 125 00000100:00100000:3.0:1789131154.668197:0:17764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd2c89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22edf929-4c0f-42f3-973d-fe4d92543efa+9:15148:x1876039498326016:12345-192.168.203.11@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789131154.668218:0:17764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789131154.668242:0:17764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91ddfd0b4400/0xf3fe2838e1fc3854 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269d7e expref: -99 pid: 17764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131154.668276:0:17764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91ddfd0b4400/0xf3fe2838e1fc3854 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269d7e expref: 10 pid: 17764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131154.668290:0:17764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91ddfd0b4400/0xf3fe2838e1fc3854 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269d7e expref: 10 pid: 17764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131154.668301:0:17764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ddfd0b4400, rc 0) 00000100:00100000:3.0:1789131154.668392:0:17764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd2c89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22edf929-4c0f-42f3-973d-fe4d92543efa+10:15148:x1876039498326016:12345-192.168.203.11@tcp:101:mount.lustre.0 Request processed in 197us (1835us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131154.668560:0:17764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 125 00000100:00100000:1.0:1789131154.671715:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131154.672948:0:17765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498326144 00000100:00100000:3.0:1789131154.672964:0:17765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498326144 00000100:00100000:3.0:1789131154.673036:0:17765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 126 00000100:00100000:3.0:1789131154.673050:0:17765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddfce54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22edf929-4c0f-42f3-973d-fe4d92543efa+10:15148:x1876039498326144:12345-192.168.203.11@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789131154.673392:0:17765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddfce54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22edf929-4c0f-42f3-973d-fe4d92543efa+10:15148:x1876039498326144:12345-192.168.203.11@tcp:501:mount.lustre.0 Request processed in 344us (1687us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131154.673412:0:17765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 126 00000100:00100000:1.0:1789131154.676356:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131154.676453:0:17764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498326272 00000100:00100000:3.0:1789131154.676504:0:17764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498326272 00000100:00100000:3.0:1789131154.676572:0:17764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 127 00000100:00100000:3.0:1789131154.676585:0:17764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddfce57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22edf929-4c0f-42f3-973d-fe4d92543efa+10:15148:x1876039498326272:12345-192.168.203.11@tcp:503:mount.lustre.0 00000100:00100000:3.0:1789131154.676794:0:17764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddfce57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22edf929-4c0f-42f3-973d-fe4d92543efa+10:15148:x1876039498326272:12345-192.168.203.11@tcp:503:mount.lustre.0 Request processed in 212us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131154.676804:0:17764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 127 00000100:00100000:2.0:1789131154.681799:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131154.681937:0:17766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498326400 00000100:00100000:0.0:1789131154.681958:0:17766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498326400 00000100:00100000:0.0:1789131154.682014:0:17766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 128 00000100:00100000:0.0:1789131154.682025:0:17766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc1ed5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22edf929-4c0f-42f3-973d-fe4d92543efa+10:15171:x1876039498326400:12345-192.168.203.11@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789131154.682213:0:17766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc1ed5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22edf929-4c0f-42f3-973d-fe4d92543efa+10:15171:x1876039498326400:12345-192.168.203.11@tcp:502:llog_process_th.0 Request processed in 189us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131154.682222:0:17766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 128 00000100:00100000:2.0:1789131154.686065:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789131154.686297:0:17765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498326528 00000100:00100000:1.0:1789131154.686310:0:17765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498326528 00000100:00100000:1.0:1789131154.686383:0:17765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 129 00000100:00100000:1.0:1789131154.686396:0:17765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc1ed4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22edf929-4c0f-42f3-973d-fe4d92543efa+10:15171:x1876039498326528:12345-192.168.203.11@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789131154.687013:0:17765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc1ed4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22edf929-4c0f-42f3-973d-fe4d92543efa+10:15171:x1876039498326528:12345-192.168.203.11@tcp:502:llog_process_th.0 Request processed in 616us (958us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131154.687023:0:17765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 129 00000100:00100000:1.0:1789131154.698894:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789131154.698960:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131154.701132:0:17772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498326656 00000100:00100000:3.0:1789131154.701159:0:17772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498326656 00000100:00100000:3.0:1789131154.701234:0:17772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498326912 00000100:00100000:3.0:1789131154.701238:0:17772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498326912 00000100:00100000:3.0:1789131154.701272:0:17772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 7 00000100:00100000:3.0:1789131154.701282:0:17772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddca0f9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2384:x1876039498326656:12345-192.168.203.11@tcp:38:mount.lustre.0 00000100:00100000:1.0:1789131154.701440:0:19096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 8 00000100:00100000:1.0:1789131154.701500:0:19096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddca0f8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2384:x1876039498326912:12345-192.168.203.11@tcp:38:mount.lustre.0 00010000:00080000:1.0:1789131154.701535:0:19096:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0001: connection from 10a3c9cb-0ead-44d0-a06d-1a07b352d8a9@192.168.203.11@tcp t0 exp 0000000000000000 cur 510 last 0 00000020:00000080:1.0:1789131154.701604:0:19096:0:(genops.c:1385:class_connect()) connect: client 10a3c9cb-0ead-44d0-a06d-1a07b352d8a9, cookie 0xf3fe2838e1fc385b 00000004:00100000:1.0:1789131154.701636:0:19096:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return 37 00000100:00080000:1.0:1789131154.701916:0:19096:0:(import.c:65:import_set_state_nolock()) ffff91dde6d19800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789131154.702015:0:19096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddca0f8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+6:2384:x1876039498326912:12345-192.168.203.11@tcp:38:mount.lustre.0 Request processed in 514us (3053us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131154.702024:0:19096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 8 00010000:00080000:3.0:1789131154.702106:0:17772:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from 10a3c9cb-0ead-44d0-a06d-1a07b352d8a9@192.168.203.11@tcp t0 exp 0000000000000000 cur 510 last 0 00000020:00000080:3.0:1789131154.702155:0:17772:0:(genops.c:1385:class_connect()) connect: client 10a3c9cb-0ead-44d0-a06d-1a07b352d8a9, cookie 0xf3fe2838e1fc3862 00000004:00100000:3.0:1789131154.702172:0:17772:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return 37 00000100:00080000:3.0:1789131154.702553:0:17772:0:(import.c:65:import_set_state_nolock()) ffff91ddff663000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789131154.702592:0:17772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddca0f9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+6:2384:x1876039498326656:12345-192.168.203.11@tcp:38:mount.lustre.0 Request processed in 1309us (3711us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131154.702600:0:17772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 7 00000100:00100000:1.0:1789131154.710052:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789131154.710121:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131154.710273:0:19096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498327040 00000100:00100000:2.0:1789131154.710286:0:19096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498327040 00000100:00100000:2.0:1789131154.710371:0:19096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498326784 00000100:00100000:2.0:1789131154.710374:0:19096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498326784 00000100:00100000:2.0:1789131154.710402:0:19096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 9 00000100:00100000:2.0:1789131154.710414:0:19096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddca0f92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+6:0:x1876039498327040:12345-192.168.203.11@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789131154.710548:0:19096:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789131154.710660:0:19096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddca0f92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+6:0:x1876039498327040:12345-192.168.203.11@tcp:41:mount.lustre.0 Request processed in 246us (620us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131154.710669:0:19096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 9 00000100:00100000:2.0:1789131154.710690:0:19096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 10 00000100:00100000:2.0:1789131154.710698:0:19096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddca0f83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+6:0:x1876039498326784:12345-192.168.203.11@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789131154.710716:0:19096:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1789131154.710756:0:19096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddca0f83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+6:0:x1876039498326784:12345-192.168.203.11@tcp:41:mount.lustre.0 Request processed in 58us (634us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131154.710763:0:19096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 10 00000100:00080000:3.0:1789131154.710985:0:17767:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789131154.710991:0:17767:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789131154.713297:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131154.716668:0:19096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498327168 00000100:00100000:2.0:1789131154.716689:0:19096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498327168 00000100:00100000:2.0:1789131154.716778:0:19096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 11 00000100:00100000:2.0:1789131154.716789:0:19096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7d983c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+6:15148:x1876039498327168:12345-192.168.203.11@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789131154.716842:0:19096:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1789131154.716953:0:19096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7d983c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+6:15148:x1876039498327168:12345-192.168.203.11@tcp:41:mount.lustre.0 Request processed in 165us (3669us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131154.716980:0:19096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 11 00000100:00100000:2.0:1789131154.719515:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131154.719615:0:17773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498327296 00000100:00100000:0.0:1789131154.719642:0:17773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498327296 00000100:00100000:0.0:1789131154.719711:0:17773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 12 00000100:00100000:0.0:1789131154.719722:0:17773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7893480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+6:15148:x1876039498327296:12345-192.168.203.11@tcp:40:mount.lustre.0 00000100:00100000:0.0:1789131154.719941:0:17773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7893480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+6:15148:x1876039498327296:12345-192.168.203.11@tcp:40:mount.lustre.0 Request processed in 221us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131154.719950:0:17773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 12 00000100:00100000:1.0:1789131154.730217:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789131154.730276:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789131154.730319:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131154.730506:0:17782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498327680 00000100:00100000:3.0:1789131154.730519:0:17782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498327680 00000100:00100000:3.0:1789131154.730581:0:17782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 3 00000100:00100000:3.0:1789131154.730592:0:17782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddca0fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+6:15148:x1876039498327680:12345-192.168.203.11@tcp:900:mount.lustre.0 00000100:00100000:3.0:1789131154.730693:0:17782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddca0fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+6:15148:x1876039498327680:12345-192.168.203.11@tcp:900:mount.lustre.0 Request processed in 101us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131154.730702:0:17782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 3 00000100:00100000:2.0:1789131154.730983:0:19284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498327424 00000100:00100000:2.0:1789131154.730987:0:19284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498327424 00000100:00100000:2.0:1789131154.731009:0:19284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498327552 00000100:00100000:2.0:1789131154.731012:0:19284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498327552 00000100:00100000:2.0:1789131154.731028:0:19284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 16 00000100:00100000:2.0:1789131154.731033:0:19284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddca0f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2384:x1876039498327424:12345-192.168.203.11@tcp:8:mount.lustre.0 00010000:00080000:2.0:1789131154.731063:0:19284:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from 10a3c9cb-0ead-44d0-a06d-1a07b352d8a9@192.168.203.11@tcp t0 exp 0000000000000000 cur 510 last 0 00000020:00000080:2.0:1789131154.731103:0:19284:0:(genops.c:1385:class_connect()) connect: client 10a3c9cb-0ead-44d0-a06d-1a07b352d8a9, cookie 0xf3fe2838e1fc3869 00002000:00100000:2.0:1789131154.731117:0:19284:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 10a3c9cb-0ead-44d0-a06d-1a07b352d8a9/ffff91dddf34e000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113984 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789131154.731149:0:19284:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return 37 00002000:00080000:2.0:1789131154.731351:0:19284:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789131154.731389:0:19284:0:(import.c:65:import_set_state_nolock()) ffff91dddf34b800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789131154.731433:0:19284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddca0f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+6:2384:x1876039498327424:12345-192.168.203.11@tcp:8:mount.lustre.0 Request processed in 399us (1157us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131154.731443:0:19284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 16 00000100:00100000:2.0:1789131154.731485:0:19284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 17 00000100:00100000:2.0:1789131154.731491:0:19284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddca0fb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2384:x1876039498327552:12345-192.168.203.11@tcp:8:mount.lustre.0 00010000:00080000:2.0:1789131154.731509:0:19284:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from 10a3c9cb-0ead-44d0-a06d-1a07b352d8a9@192.168.203.11@tcp t0 exp 0000000000000000 cur 510 last 0 00000020:00000080:2.0:1789131154.731525:0:19284:0:(genops.c:1385:class_connect()) connect: client 10a3c9cb-0ead-44d0-a06d-1a07b352d8a9, cookie 0xf3fe2838e1fc3870 00002000:00100000:2.0:1789131154.731531:0:19284:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 10a3c9cb-0ead-44d0-a06d-1a07b352d8a9/ffff91dddf34f800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113984 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789131154.731544:0:19284:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return 37 00002000:00080000:2.0:1789131154.731695:0:19284:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789131154.731713:0:19284:0:(import.c:65:import_set_state_nolock()) ffff91dddf348000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789131154.731738:0:19284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddca0fb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+6:2384:x1876039498327552:12345-192.168.203.11@tcp:8:mount.lustre.0 Request processed in 245us (1418us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131154.731745:0:19284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 17 00000100:00100000:1.0:1789131154.732663:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131154.736158:0:17774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498327808 00000100:00100000:3.0:1789131154.736197:0:17774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498327808 00000100:00100000:3.0:1789131154.736284:0:17774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 0 00000100:00100000:3.0:1789131154.736296:0:17774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddca0f8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+6:15148:x1876039498327808:12345-192.168.203.11@tcp:33:mount.lustre.0 00000004:00080000:1.0:1789131154.738233:0:17774:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 1796us 00000004:00200000:3.0:1789131154.755007:0:17774:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1789131154.755184:0:17774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddca0f8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+6:15148:x1876039498327808:12345-192.168.203.11@tcp:33:mount.lustre.0 Request processed in 18881us (22518us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131154.755198:0:17774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 0 00000100:00100000:2.0:1789131154.903104:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789131154.903247:0:19096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498327936 00000100:00100000:1.0:1789131154.903257:0:19096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498327936 00000100:00100000:0.0:1789131154.903577:0:17771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 13 00000100:00100000:0.0:1789131154.903590:0:17771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8496580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+6:15197:x1876039498327936:12345-192.168.203.11@tcp:101:mkdir.0 00010000:00010000:0.0:1789131154.903610:0:17771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789131154.903661:0:17771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6200/0xf3fe2838e1fc3877 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269daf expref: -99 pid: 17771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131154.905519:0:17771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc387e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131154.905541:0:17771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc387e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131154.905556:0:17771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc387e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789131154.905633:0:17771:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789131154.905639:0:17771:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789131154.905691:0:17771:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc387e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131154.905721:0:17771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad6200/0xf3fe2838e1fc3877 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269daf expref: 8 pid: 17771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131154.905758:0:17771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc387e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269daf expref: 7 pid: 17771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131154.905766:0:17771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91ddc4c81200) 00010000:00010000:0.0:1789131154.905769:0:17771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789131154.905773:0:17771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91de01ad7600, rc 0) 00000100:00100000:0.0:1789131154.905896:0:17771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8496580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+7:15197:x1876039498327936:12345-192.168.203.11@tcp:101:mkdir.0 Request processed in 2309us (2800us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131154.905905:0:17771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 13 00000100:00100000:0.0:1789131155.025755:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd1daed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1876039508904960:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789131155.025841:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131155.028117:0:19287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508904960 00000100:00100000:1.0:1789131155.028130:0:19287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508904960 00000100:00080000:3.0:1789131155.028207:0:17767:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789131155.028216:0:19287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789131155.028230:0:19287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7d98b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1876039508904960:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789131155.028255:0:19287:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1789131155.029386:0:19287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7d98b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1876039508904960:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1154us (3539us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131155.029397:0:19287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789131155.030106:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd1daed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1876039508904960:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1789131155.474505:0:17760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789131155.537731:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddca0fbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508905088:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789131155.537842:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131155.538254:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd1dade00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1876039508905216:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789131155.538286:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131155.542525:0:17777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508905088 00000100:00100000:1.0:1789131155.542567:0:17777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508905088 00000100:00100000:1.0:1789131155.542704:0:17777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508905216 00000100:00100000:1.0:1789131155.542708:0:17777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508905216 00000100:00100000:3.0:1789131155.543306:0:17776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789131155.543320:0:17776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd1daed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1876039508905088:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789131155.543355:0:17776:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789131155.543619:0:17776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd1daed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1876039508905088:12345-0@lo:41:osp-pre-1-0.0 Request processed in 303us (5776us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131155.543626:0:17776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789131155.543646:0:17776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789131155.543652:0:17776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7d9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1876039508905216:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789131155.543666:0:17776:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1789131155.544245:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddca0fbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508905088:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789131155.545212:0:17776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7d9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1876039508905216:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1555us (6920us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131155.545225:0:17776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789131155.545332:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd1dade00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1876039508905216:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1789131156.497987:0:19311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789131156.720392:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789131156.720991:0:17772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498328064 00000100:00100000:1.0:1789131156.721001:0:17772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498328064 00000100:00080000:3.0:1789131156.721082:0:17767:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789131156.721170:0:17772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 14 00000100:00100000:1.0:1789131156.721182:0:17772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7d99e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+7:15249:x1876039498328064:12345-192.168.203.11@tcp:41:lfs.0 00000004:00000024:1.0:1789131156.721219:0:17772:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1789131156.721323:0:17772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7d99e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+7:15249:x1876039498328064:12345-192.168.203.11@tcp:41:lfs.0 Request processed in 144us (939us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131156.721331:0:17772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 14 00000100:00100000:1.0:1789131156.731734:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131156.732253:0:19096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498328192 00000100:00100000:2.0:1789131156.732263:0:19096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498328192 00000100:00100000:2.0:1789131156.732384:0:19096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 15 00000100:00100000:2.0:1789131156.732395:0:19096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddca0fb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+6:15249:x1876039498328192:12345-192.168.203.11@tcp:41:lfs.0 00000004:00000024:2.0:1789131156.732432:0:19096:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789131156.732560:0:19096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddca0fb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+6:15249:x1876039498328192:12345-192.168.203.11@tcp:41:lfs.0 Request processed in 167us (835us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131156.732569:0:19096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 15 00000100:00080000:3.0:1789131156.734154:0:17767:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789131156.738404:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131156.738492:0:19286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498328320 00000100:00100000:3.0:1789131156.738501:0:19286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498328320 00000100:00100000:3.0:1789131156.738628:0:19286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 6 00000100:00100000:3.0:1789131156.738640:0:19286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8494b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+6:15249:x1876039498328320:12345-192.168.203.11@tcp:13:lfs.0 00002000:00000024:3.0:1789131156.738673:0:19286:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1789131156.738761:0:19286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8494b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+6:15249:x1876039498328320:12345-192.168.203.11@tcp:13:lfs.0 Request processed in 123us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131156.738769:0:19286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 6 00000100:00080000:2.0:1789131156.739738:0:17767:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789131156.751107:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131156.754245:0:19287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498328448 00000100:00100000:0.0:1789131156.754259:0:19287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498328448 00000100:00100000:0.0:1789131156.754337:0:19287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 7 00000100:00100000:0.0:1789131156.754348:0:19287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddca0fa1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+6:15249:x1876039498328448:12345-192.168.203.11@tcp:13:lfs.0 00002000:00000024:0.0:1789131156.754378:0:19287:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923501056 avail 3691978752 00000100:00100000:0.0:1789131156.754487:0:19287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddca0fa1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+6:15249:x1876039498328448:12345-192.168.203.11@tcp:13:lfs.0 Request processed in 141us (3388us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131156.754518:0:19287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 7 00000100:00080000:2.0:1789131156.754577:0:17767:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789131156.917592:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131156.917717:0:17764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498328576 00000100:00100000:3.0:1789131156.917727:0:17764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498328576 00000100:00100000:3.0:1789131156.917775:0:17764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 130 00000100:00100000:3.0:1789131156.917784:0:17764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc1ed6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22edf929-4c0f-42f3-973d-fe4d92543efa+10:15281:x1876039498328576:12345-192.168.203.11@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789131156.917799:0:17764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789131156.917815:0:17764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91ddfd0b5400/0xf3fe2838e1fc3885 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269db6 expref: -99 pid: 17764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131156.917840:0:17764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91ddfd0b5400/0xf3fe2838e1fc3885 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269db6 expref: 11 pid: 17764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131156.917862:0:17764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91ddfd0b5400/0xf3fe2838e1fc3885 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269db6 expref: 11 pid: 17764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131156.917872:0:17764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ddfd0b5400, rc 0) 00000100:00100000:3.0:1789131156.917979:0:17764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc1ed6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22edf929-4c0f-42f3-973d-fe4d92543efa+11:15281:x1876039498328576:12345-192.168.203.11@tcp:101:mount.lustre.0 Request processed in 194us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131156.917986:0:17764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 130 00000100:00100000:1.0:1789131156.930085:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131156.930292:0:17765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498328704 00000100:00100000:3.0:1789131156.930301:0:17765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498328704 00000100:00100000:3.0:1789131156.930375:0:17765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 131 00000100:00100000:3.0:1789131156.930386:0:17765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc1ed5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22edf929-4c0f-42f3-973d-fe4d92543efa+11:15281:x1876039498328704:12345-192.168.203.11@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789131156.930913:0:17765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc1ed5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22edf929-4c0f-42f3-973d-fe4d92543efa+11:15281:x1876039498328704:12345-192.168.203.11@tcp:501:mount.lustre.0 Request processed in 187us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131156.930923:0:17765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 131 00000100:00100000:1.0:1789131156.950821:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131156.951197:0:17766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498328832 00000100:00100000:0.0:1789131156.951207:0:17766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498328832 00000100:00100000:0.0:1789131156.951336:0:17766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 132 00000100:00100000:0.0:1789131156.951347:0:17766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc1ed7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22edf929-4c0f-42f3-973d-fe4d92543efa+11:15281:x1876039498328832:12345-192.168.203.11@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789131156.951512:0:17766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc1ed7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22edf929-4c0f-42f3-973d-fe4d92543efa+11:15281:x1876039498328832:12345-192.168.203.11@tcp:503:mount.lustre.0 Request processed in 166us (702us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131156.951520:0:17766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 132 00000100:00100000:0.0:1789131156.969836:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131156.970243:0:17765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498328960 00000100:00100000:3.0:1789131156.970256:0:17765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498328960 00000100:00100000:3.0:1789131156.970333:0:17765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 133 00000100:00100000:3.0:1789131156.970347:0:17765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc1ed6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22edf929-4c0f-42f3-973d-fe4d92543efa+11:15288:x1876039498328960:12345-192.168.203.11@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789131156.970619:0:17765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc1ed6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22edf929-4c0f-42f3-973d-fe4d92543efa+11:15288:x1876039498328960:12345-192.168.203.11@tcp:502:llog_process_th.0 Request processed in 274us (799us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131156.970629:0:17765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 133 00000100:00100000:1.0:1789131156.987342:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131156.987436:0:17766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498329088 00000100:00100000:0.0:1789131156.987452:0:17766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498329088 00000100:00100000:0.0:1789131156.987716:0:17766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 134 00000100:00100000:0.0:1789131156.987729:0:17766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc1ed6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22edf929-4c0f-42f3-973d-fe4d92543efa+11:15288:x1876039498329088:12345-192.168.203.11@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789131156.988345:0:17766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc1ed6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22edf929-4c0f-42f3-973d-fe4d92543efa+11:15288:x1876039498329088:12345-192.168.203.11@tcp:502:llog_process_th.0 Request processed in 616us (1009us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131156.988355:0:17766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 134 00000100:00100000:1.0:1789131156.991798:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131156.991888:0:17764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498329216 00000100:00100000:2.0:1789131156.991901:0:17764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498329216 00000100:00100000:2.0:1789131156.991968:0:17764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 135 00000100:00100000:2.0:1789131156.991980:0:17764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc1ed4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22edf929-4c0f-42f3-973d-fe4d92543efa+11:15288:x1876039498329216:12345-192.168.203.11@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789131156.992190:0:17764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc1ed4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22edf929-4c0f-42f3-973d-fe4d92543efa+11:15288:x1876039498329216:12345-192.168.203.11@tcp:502:llog_process_th.0 Request processed in 211us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131156.992199:0:17764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 135 00000100:00100000:1.0:1789131156.995792:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131156.995936:0:17766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498329344 00000100:00100000:0.0:1789131156.995958:0:17766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498329344 00000100:00100000:0.0:1789131156.996028:0:17766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 136 00000100:00100000:0.0:1789131156.996039:0:17766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc1ed4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22edf929-4c0f-42f3-973d-fe4d92543efa+11:15281:x1876039498329344:12345-192.168.203.11@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789131156.996071:0:17766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789131156.996097:0:17766:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91de01ad7000/0xf3fe2838e1fc388c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269de7 expref: -99 pid: 17766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131156.996157:0:17766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91de01ad7000/0xf3fe2838e1fc388c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269de7 expref: 12 pid: 17766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131156.996171:0:17766:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91de01ad7000/0xf3fe2838e1fc388c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269de7 expref: 12 pid: 17766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131156.996182:0:17766:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91de01ad7000, rc 0) 00000100:00100000:0.0:1789131156.996256:0:17766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc1ed4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22edf929-4c0f-42f3-973d-fe4d92543efa+12:15281:x1876039498329344:12345-192.168.203.11@tcp:101:mount.lustre.0 Request processed in 218us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131156.996264:0:17766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 136 00000100:00100000:1.0:1789131157.000023:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131157.000186:0:17765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498329472 00000100:00100000:3.0:1789131157.000198:0:17765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498329472 00000100:00100000:3.0:1789131157.000272:0:17765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 137 00000100:00100000:3.0:1789131157.000283:0:17765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc1ed5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22edf929-4c0f-42f3-973d-fe4d92543efa+12:15281:x1876039498329472:12345-192.168.203.11@tcp:256:mount.lustre.0 20000000:01000000:3.0:1789131157.000320:0:17765:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1789131157.000353:0:17765:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1789131157.000358:0:17765:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1789131157.000362:0:17765:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1789131157.000365:0:17765:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1789131157.000367:0:17765:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:3.0:1789131157.004214:0:17765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc1ed5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22edf929-4c0f-42f3-973d-fe4d92543efa+12:15281:x1876039498329472:12345-192.168.203.11@tcp:256:mount.lustre.0 Request processed in 3917us (4190us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131157.004231:0:17765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 137 00000100:00100000:1.0:1789131157.008404:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131157.008654:0:17766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498329600 00000100:00100000:0.0:1789131157.008666:0:17766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498329600 00000100:00100000:0.0:1789131157.008730:0:17766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 138 00000100:00100000:0.0:1789131157.008741:0:17766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc1ed7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22edf929-4c0f-42f3-973d-fe4d92543efa+12:15281:x1876039498329600:12345-192.168.203.11@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789131157.008899:0:17766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789131157.008936:0:17766:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91de01ad6200/0xf3fe2838e1fc3893 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269dee expref: -99 pid: 17766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131157.009109:0:17766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91de01ad6200/0xf3fe2838e1fc3893 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269dee expref: 13 pid: 17766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131157.009123:0:17766:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91de01ad6200/0xf3fe2838e1fc3893 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269dee expref: 13 pid: 17766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131157.009135:0:17766:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91de01ad6200, rc 0) 00000100:00100000:0.0:1789131157.009211:0:17766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc1ed7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22edf929-4c0f-42f3-973d-fe4d92543efa+13:15281:x1876039498329600:12345-192.168.203.11@tcp:101:mount.lustre.0 Request processed in 471us (822us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131157.009240:0:17766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 138 00000100:00100000:1.0:1789131157.013726:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131157.013804:0:17765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498329728 00000100:00100000:3.0:1789131157.013851:0:17765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498329728 00000100:00100000:3.0:1789131157.013923:0:17765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 139 00000100:00100000:3.0:1789131157.013937:0:17765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc1ed4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22edf929-4c0f-42f3-973d-fe4d92543efa+13:15281:x1876039498329728:12345-192.168.203.11@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789131157.014639:0:17765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc1ed4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22edf929-4c0f-42f3-973d-fe4d92543efa+13:15281:x1876039498329728:12345-192.168.203.11@tcp:501:mount.lustre.0 Request processed in 697us (919us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131157.014650:0:17765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 139 00000100:00100000:1.0:1789131157.021179:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131157.021348:0:17766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498329856 00000100:00100000:0.0:1789131157.021362:0:17766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498329856 00000100:00100000:0.0:1789131157.021431:0:17766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 140 00000100:00100000:0.0:1789131157.021444:0:17766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddfbfe3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22edf929-4c0f-42f3-973d-fe4d92543efa+13:15281:x1876039498329856:12345-192.168.203.11@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789131157.021756:0:17766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddfbfe3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22edf929-4c0f-42f3-973d-fe4d92543efa+13:15281:x1876039498329856:12345-192.168.203.11@tcp:503:mount.lustre.0 Request processed in 314us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131157.021766:0:17766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 140 00000100:00100000:1.0:1789131157.034387:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131157.034498:0:17764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498329984 00000100:00100000:2.0:1789131157.034511:0:17764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498329984 00000100:00100000:2.0:1789131157.034596:0:17764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 141 00000100:00100000:2.0:1789131157.034637:0:17764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddfbfe2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22edf929-4c0f-42f3-973d-fe4d92543efa+13:15292:x1876039498329984:12345-192.168.203.11@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789131157.034878:0:17764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddfbfe2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22edf929-4c0f-42f3-973d-fe4d92543efa+13:15292:x1876039498329984:12345-192.168.203.11@tcp:502:llog_process_th.0 Request processed in 245us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131157.034888:0:17764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 141 00000100:00100000:1.0:1789131157.041159:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131157.048077:0:17766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498330112 00000100:00100000:0.0:1789131157.048099:0:17766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498330112 00000100:00100000:0.0:1789131157.048314:0:17766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 142 00000100:00100000:0.0:1789131157.048328:0:17766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddfbfe0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22edf929-4c0f-42f3-973d-fe4d92543efa+13:15292:x1876039498330112:12345-192.168.203.11@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789131157.048735:0:17766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddfbfe0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22edf929-4c0f-42f3-973d-fe4d92543efa+13:15292:x1876039498330112:12345-192.168.203.11@tcp:502:llog_process_th.0 Request processed in 408us (7589us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131157.048744:0:17766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 142 00000100:00100000:0.0:1789131157.056067:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131157.056116:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131157.056143:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131157.056166:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131157.056560:0:17773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498330240 00000100:00100000:2.0:1789131157.056574:0:17773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498330240 00000100:00100000:2.0:1789131157.056641:0:17773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498330496 00000100:00100000:2.0:1789131157.056645:0:17773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498330496 00000100:00100000:2.0:1789131157.056655:0:17773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498330880 00000100:00100000:2.0:1789131157.056658:0:17773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498330880 00000100:00100000:2.0:1789131157.056688:0:17773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 32 00000100:00100000:2.0:1789131157.056697:0:17773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddca0c61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+7:2385:x1876039498330880:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1789131157.056781:0:17773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddca0c61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+7:2385:x1876039498330880:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 84us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131157.056788:0:17773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 32 00000100:00100000:2.0:1789131157.056806:0:17773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 16 00000100:00100000:2.0:1789131157.056811:0:17773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddca229a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2384:x1876039498330240:12345-192.168.203.11@tcp:38:mount.lustre.0 00010000:00080000:2.0:1789131157.056833:0:17773:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from 014f7d38-34be-4f2e-b715-3fbda0147a70@192.168.203.11@tcp t0 exp 0000000000000000 cur 512 last 0 00000020:00000080:2.0:1789131157.056884:0:17773:0:(genops.c:1385:class_connect()) connect: client 014f7d38-34be-4f2e-b715-3fbda0147a70, cookie 0xf3fe2838e1fc389a 00000004:00100000:2.0:1789131157.056913:0:17773:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return 37 00000100:00080000:2.0:1789131157.057027:0:17773:0:(import.c:65:import_set_state_nolock()) ffff91dcc7978800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789131157.057059:0:17773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddca229a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:014f7d38-34be-4f2e-b715-3fbda0147a70+6:2384:x1876039498330240:12345-192.168.203.11@tcp:38:mount.lustre.0 Request processed in 245us (1006us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131157.057067:0:17773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 16 00000100:00100000:2.0:1789131157.057081:0:17773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 17 00000100:00100000:2.0:1789131157.057093:0:17773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddca229680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2384:x1876039498330496:12345-192.168.203.11@tcp:38:mount.lustre.0 00010000:00080000:2.0:1789131157.057109:0:17773:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0001: connection from 014f7d38-34be-4f2e-b715-3fbda0147a70@192.168.203.11@tcp t0 exp 0000000000000000 cur 512 last 0 00000020:00000080:2.0:1789131157.057129:0:17773:0:(genops.c:1385:class_connect()) connect: client 014f7d38-34be-4f2e-b715-3fbda0147a70, cookie 0xf3fe2838e1fc38a1 00000004:00100000:2.0:1789131157.057141:0:17773:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return 37 00000100:00080000:2.0:1789131157.057180:0:17773:0:(import.c:65:import_set_state_nolock()) ffff91dcc797a000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789131157.057217:0:17773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddca229680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:014f7d38-34be-4f2e-b715-3fbda0147a70+6:2384:x1876039498330496:12345-192.168.203.11@tcp:38:mount.lustre.0 Request processed in 123us (1101us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131157.057225:0:17773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 17 00000100:00100000:0.0:1789131157.060023:0:19283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498331136 00000100:00100000:1.0:1789131157.060200:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789131157.060259:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131157.060336:0:19283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498331136 00000100:00100000:3.0:1789131157.060482:0:19284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498331264 00000100:00100000:3.0:1789131157.060487:0:19284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498331264 00000100:00100000:2.0:1789131157.060664:0:17773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498331008 00000100:00100000:2.0:1789131157.060678:0:17773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498331008 00000100:00100000:2.0:1789131157.060740:0:17773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 33 00000100:00100000:2.0:1789131157.060751:0:17773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddca0fbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+6:2385:x1876039498331008:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1789131157.060826:0:17773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddca0fbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+6:2385:x1876039498331008:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 76us (632us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131157.060834:0:17773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 33 00000100:00100000:3.0:1789131157.060998:0:19284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2 00000100:00100000:3.0:1789131157.061013:0:19284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddca0c6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+6:2385:x1876039498331136:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1789131157.061089:0:19284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddca0c6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+6:2385:x1876039498331136:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 81us (4921us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131157.061096:0:19284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2 00000100:00100000:3.0:1789131157.061115:0:19284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 3 00000100:00100000:3.0:1789131157.061122:0:19284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddca0fa580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+6:2385:x1876039498331264:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1789131157.061146:0:19284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddca0fa580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+6:2385:x1876039498331264:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 26us (888us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131157.061153:0:19284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 3 00000100:00100000:2.0:1789131157.068237:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131157.068292:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131157.068393:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789131157.068527:0:17773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498330368 00000100:00100000:1.0:1789131157.068540:0:17773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498330368 00000100:00100000:1.0:1789131157.068646:0:17773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498330624 00000100:00100000:1.0:1789131157.068650:0:17773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498330624 00000100:00100000:1.0:1789131157.068668:0:17773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498330752 00000100:00100000:1.0:1789131157.068670:0:17773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498330752 00000100:00100000:1.0:1789131157.068688:0:17773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 18 00000100:00100000:1.0:1789131157.068700:0:17773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8497840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:014f7d38-34be-4f2e-b715-3fbda0147a70+7:0:x1876039498330368:12345-192.168.203.11@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789131157.068743:0:17773:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1789131157.068863:0:17771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 19 00000100:00100000:0.0:1789131157.068874:0:17771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8494f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:014f7d38-34be-4f2e-b715-3fbda0147a70+6:0:x1876039498330624:12345-192.168.203.11@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789131157.068891:0:17771:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00080000:3.0:1789131157.069074:0:17767:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789131157.069079:0:17767:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789131157.073054:0:17773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8497840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:014f7d38-34be-4f2e-b715-3fbda0147a70+7:0:x1876039498330368:12345-192.168.203.11@tcp:41:mount.lustre.0 Request processed in 4327us (4814us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131157.073074:0:17773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 18 00000100:00100000:1.0:1789131157.073130:0:17773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 20 00000100:00100000:1.0:1789131157.073148:0:17773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8497c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:014f7d38-34be-4f2e-b715-3fbda0147a70+6:15281:x1876039498330752:12345-192.168.203.11@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789131157.073189:0:17773:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1789131157.073254:0:17773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8497c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:014f7d38-34be-4f2e-b715-3fbda0147a70+6:15281:x1876039498330752:12345-192.168.203.11@tcp:41:mount.lustre.0 Request processed in 115us (4860us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131157.073260:0:17773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 20 00000100:00100000:1.0:1789131157.076365:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789131157.076396:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddca0f9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1876039508905344:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789131157.076530:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131157.076608:0:19287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508905344 00000100:00100000:3.0:1789131157.076623:0:19287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508905344 00000100:00100000:3.0:1789131157.076707:0:19287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789131157.076720:0:19287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddca0fa940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1876039508905344:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789131157.076747:0:19287:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923501056 avail 3691978752 00000100:00080000:1.0:1789131157.077206:0:17767:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789131157.078003:0:17771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8494f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:014f7d38-34be-4f2e-b715-3fbda0147a70+6:0:x1876039498330624:12345-192.168.203.11@tcp:41:mount.lustre.0 Request processed in 9121us (9700us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131157.078139:0:17771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 19 00000100:00100000:3.0:1789131157.078435:0:19287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddca0fa940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1876039508905344:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1712us (1899us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131157.078489:0:19287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789131157.078700:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd1dade00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1876039508905472:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789131157.078762:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131157.078831:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddca0f9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1876039508905344:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789131157.079045:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01ad21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:3626:1876039508905728:0@lo:400:kworker.0 00000100:00100000:3.0:1789131157.079086:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131157.079110:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01ad3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1876039508906240:0@lo:400:kworker.0 00000100:00100000:3.0:1789131157.079137:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131157.079173:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01ad0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3626:1876039508906752:0@lo:400:kworker.0 00000100:00100000:0.0:1789131157.079182:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01ad2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1876039508905856:0@lo:400:kworker.0 00000100:00100000:3.0:1789131157.079205:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131157.079269:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01ad3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508905600:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789131157.079443:0:17777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508906240 00000100:00100000:3.0:1789131157.079450:0:17777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508906240 00000100:00100000:3.0:1789131157.079515:0:17777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789131157.079524:0:17777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01ad3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1876039508906240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789131157.079579:0:17777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01ad3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1876039508906240:12345-0@lo:400:kworker.0 Request processed in 55us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131157.079586:0:17777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789131157.079618:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01ad3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1876039508906240:0@lo:400:kworker.0 00000100:00100000:3.0:1789131157.079638:0:19286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508905472 00000100:00100000:3.0:1789131157.079642:0:19286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508905472 00000100:00100000:3.0:1789131157.079671:0:19286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789131157.079678:0:19286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7b79e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3628:x1876039508905472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789131157.079691:0:19286:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923501056 avail 3691978752 00000100:00100000:3.0:1789131157.079721:0:19286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7b79e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3628:x1876039508905472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 43us (959us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131157.079727:0:19286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789131157.079743:0:17772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508906752 00000100:00100000:3.0:1789131157.079746:0:17772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508906752 00000100:00100000:3.0:1789131157.079781:0:17772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789131157.079786:0:17772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01ad1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1876039508906752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789131157.079820:0:17772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01ad1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1876039508906752:12345-0@lo:400:kworker.0 Request processed in 34us (617us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131157.079826:0:17772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:3.0:1789131157.079869:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91de01ad0780 x1876039508906752/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789131173 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789131157.079880:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01ad0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3626:1876039508906752:0@lo:400:kworker.0 00000100:00100000:3.0:1789131157.079898:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01ad2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1876039508905984:0@lo:400:kworker.0 00000100:00100000:3.0:1789131157.079923:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131157.079939:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01ad0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3628:1876039508906496:0@lo:400:kworker.0 00000100:00100000:3.0:1789131157.079957:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131157.079972:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01ad0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3628:1876039508907008:0@lo:400:kworker.0 00000100:00100000:3.0:1789131157.079990:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131157.080017:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd1dade00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1876039508905472:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789131157.080126:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131157.080176:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01ad0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508906368:0@lo:400:kworker.0 00000100:00100000:0.0:1789131157.080210:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131157.080331:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01ad03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3627:1876039508906880:0@lo:400:kworker.0 00000100:00100000:0.0:1789131157.080362:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131157.080408:0:17772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508906496 00000100:00100000:0.0:1789131157.080561:0:17772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508906496 00000100:00100000:0.0:1789131157.080607:0:17772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508907008 00000100:00100000:0.0:1789131157.080610:0:17772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508907008 00000100:00100000:0.0:1789131157.080630:0:17772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508906880 00000100:00100000:0.0:1789131157.080633:0:17772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508906880 00000100:00100000:0.0:1789131157.080652:0:17772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789131157.080660:0:17772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01ad3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3628:x1876039508906496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789131157.080696:0:19981:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508905984 00000100:00100000:3.0:1789131157.080705:0:19981:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508905984 00000100:00100000:0.0:1789131157.080731:0:17772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01ad3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3628:x1876039508906496:12345-0@lo:400:kworker.0 Request processed in 71us (771us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131157.080740:0:17772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789131157.080761:0:19981:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508906368 00000100:00100000:3.0:1789131157.080768:0:19981:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508906368 00000100:00100000:0.0:1789131157.080768:0:17772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789131157.080789:0:17772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01ad30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3628:x1876039508907008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789131157.080819:0:19981:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789131157.080833:0:19981:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01ad0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3628:x1876039508905984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789131157.080856:0:17772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01ad30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3628:x1876039508907008:12345-0@lo:400:kworker.0 Request processed in 56us (846us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131157.080867:0:17772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789131157.080884:0:17772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789131157.080893:0:17772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc860a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3627:x1876039508906880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789131157.080929:0:19981:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01ad0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3628:x1876039508905984:12345-0@lo:400:kworker.0 Request processed in 99us (1002us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131157.080939:0:19981:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789131157.080966:0:17772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc860a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3627:x1876039508906880:12345-0@lo:400:kworker.0 Request processed in 73us (601us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131157.080975:0:17772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789131157.081016:0:19283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789131157.081028:0:19283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd286d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508906368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789131157.081064:0:19283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd286d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508906368:12345-0@lo:400:kworker.0 Request processed in 40us (853us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131157.081070:0:19283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789131157.081116:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01ad0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508906368:0@lo:400:kworker.0 00000100:00100000:0.0:1789131157.081129:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01ad03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3627:1876039508906880:0@lo:400:kworker.0 00000100:00100000:3.0:1789131157.081146:0:17776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508905856 00000100:00100000:3.0:1789131157.081161:0:17776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508905856 00000100:00100000:0.0:1789131157.081185:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01ad2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1876039508905984:0@lo:400:kworker.0 00000100:00100000:3.0:1789131157.081208:0:17776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789131157.081208:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01ad0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3628:1876039508906496:0@lo:400:kworker.0 00000100:00100000:3.0:1789131157.081227:0:17776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd286c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1876039508905856:12345-0@lo:400:kworker.0 00010000:00080000:0.0:1789131157.081717:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91de01ad0b40 x1876039508907008/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789131173 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789131157.081732:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01ad0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3628:1876039508907008:0@lo:400:kworker.0 00000100:00100000:3.0:1789131157.081765:0:17776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd286c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1876039508905856:12345-0@lo:400:kworker.0 Request processed in 538us (1637us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131157.081779:0:17776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789131157.081799:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01ad2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1876039508905856:0@lo:400:kworker.0 00000100:00100000:3.0:1789131157.081831:0:17765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508905728 00000100:00100000:3.0:1789131157.081838:0:17765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508905728 00000100:00080000:0.0:1789131157.081881:0:17767:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789131157.081890:0:17767:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789131157.081897:0:17767:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789131157.081904:0:17765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00080000:0.0:1789131157.081906:0:17767:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789131157.081917:0:17765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddfbfe3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+24:3626:x1876039508905728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789131157.082068:0:17765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddfbfe3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+24:3626:x1876039508905728:12345-0@lo:400:kworker.0 Request processed in 156us (2981us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131157.082075:0:17765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1789131157.082156:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01ad21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:3626:1876039508905728:0@lo:400:kworker.0 00000100:00100000:1.0:1789131157.082392:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131157.082529:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01ad2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3625:1876039508906112:0@lo:400:kworker.0 00000100:00100000:1.0:1789131157.082561:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131157.082577:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01ad1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3625:1876039508906624:0@lo:400:kworker.0 00000100:00100000:1.0:1789131157.082598:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131157.082708:0:17772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508906112 00000100:00100000:0.0:1789131157.082714:0:17772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508906112 00000100:00100000:0.0:1789131157.082752:0:17772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508906624 00000100:00100000:0.0:1789131157.082755:0:17772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508906624 00000100:00100000:0.0:1789131157.082799:0:17772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789131157.082806:0:17772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7b792c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1876039508906112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789131157.082866:0:17772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7b792c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1876039508906112:12345-0@lo:400:kworker.0 Request processed in 61us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131157.082873:0:17772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789131157.082888:0:17772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789131157.082895:0:17772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7b783c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1876039508906624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789131157.082922:0:17772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7b783c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1876039508906624:12345-0@lo:400:kworker.0 Request processed in 28us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131157.082928:0:17772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:0.0:1789131157.082955:0:17767:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789131157.083045:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01ad2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3625:1876039508906112:0@lo:400:kworker.0 00000100:00100000:1.0:1789131157.083065:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01ad1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3625:1876039508906624:0@lo:400:kworker.0 00000100:00100000:3.0:1789131157.083352:0:19286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508905600 00000100:00100000:3.0:1789131157.083357:0:19286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508905600 00000100:00100000:3.0:1789131157.083393:0:19286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789131157.083400:0:19286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7b7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1876039508905600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789131157.083415:0:19286:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1789131157.083526:0:19286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7b7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1876039508905600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 127us (1137us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131157.083532:0:19286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789131157.083706:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01ad3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508905600:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789131157.090125:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131157.093616:0:17772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498331392 00000100:00100000:3.0:1789131157.093630:0:17772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498331392 00000100:00100000:3.0:1789131157.093730:0:17772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 21 00000100:00100000:3.0:1789131157.093742:0:17772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8496d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:014f7d38-34be-4f2e-b715-3fbda0147a70+6:15281:x1876039498331392:12345-192.168.203.11@tcp:40:mount.lustre.0 00000100:00100000:3.0:1789131157.093839:0:17772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8496d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:014f7d38-34be-4f2e-b715-3fbda0147a70+6:15281:x1876039498331392:12345-192.168.203.11@tcp:40:mount.lustre.0 Request processed in 99us (3723us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131157.093872:0:17772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 21 00000100:00100000:2.0:1789131157.105193:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131157.105238:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131157.105282:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131157.105284:0:17782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498331776 00000100:00100000:3.0:1789131157.105299:0:17782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498331776 00000100:00100000:3.0:1789131157.105368:0:17782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 4 00000100:00100000:1.0:1789131157.105376:0:19981:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498331520 00000100:00100000:3.0:1789131157.105380:0:17782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8495a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:014f7d38-34be-4f2e-b715-3fbda0147a70+6:15281:x1876039498331776:12345-192.168.203.11@tcp:900:mount.lustre.0 00000100:00100000:1.0:1789131157.105383:0:19981:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498331520 00000100:00100000:1.0:1789131157.105414:0:19981:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498331648 00000100:00100000:1.0:1789131157.105418:0:19981:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498331648 00000100:00100000:1.0:1789131157.105436:0:19981:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 18 00000100:00100000:1.0:1789131157.105442:0:19981:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8497480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2384:x1876039498331520:12345-192.168.203.11@tcp:8:mount.lustre.0 00000100:00100000:3.0:1789131157.105500:0:17782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8495a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:014f7d38-34be-4f2e-b715-3fbda0147a70+6:15281:x1876039498331776:12345-192.168.203.11@tcp:900:mount.lustre.0 Request processed in 120us (314us total) trans 0 rc 0/0 00010000:00080000:1.0:1789131157.105500:0:19981:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from 014f7d38-34be-4f2e-b715-3fbda0147a70@192.168.203.11@tcp t0 exp 0000000000000000 cur 513 last 0 00000020:00000080:1.0:1789131157.105534:0:19981:0:(genops.c:1385:class_connect()) connect: client 014f7d38-34be-4f2e-b715-3fbda0147a70, cookie 0xf3fe2838e1fc38a8 00002000:00100000:1.0:1789131157.105546:0:19981:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 014f7d38-34be-4f2e-b715-3fbda0147a70/ffff91dde6d1f000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113984 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789131157.105556:0:19981:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return 37 00002000:00080000:1.0:1789131157.105643:0:19981:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789131157.105668:0:19981:0:(import.c:65:import_set_state_nolock()) ffff91dde6d1f800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789131157.105698:0:19981:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8497480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:014f7d38-34be-4f2e-b715-3fbda0147a70+6:2384:x1876039498331520:12345-192.168.203.11@tcp:8:mount.lustre.0 Request processed in 255us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131157.105705:0:19981:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 18 00000100:00100000:1.0:1789131157.105723:0:19981:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 19 00000100:00100000:3.0:1789131157.105730:0:17782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 4 00000100:00100000:1.0:1789131157.105731:0:19981:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8494780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2384:x1876039498331648:12345-192.168.203.11@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789131157.105761:0:19981:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from 014f7d38-34be-4f2e-b715-3fbda0147a70@192.168.203.11@tcp t0 exp 0000000000000000 cur 513 last 0 00000020:00000080:1.0:1789131157.105777:0:19981:0:(genops.c:1385:class_connect()) connect: client 014f7d38-34be-4f2e-b715-3fbda0147a70, cookie 0xf3fe2838e1fc38af 00002000:00100000:1.0:1789131157.105782:0:19981:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 014f7d38-34be-4f2e-b715-3fbda0147a70/ffff91dde6d1c000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113984 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789131157.105787:0:19981:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return 37 00002000:00080000:1.0:1789131157.105850:0:19981:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789131157.105869:0:19981:0:(import.c:65:import_set_state_nolock()) ffff91dcc5ff7800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789131157.105897:0:19981:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8494780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:014f7d38-34be-4f2e-b715-3fbda0147a70+6:2384:x1876039498331648:12345-192.168.203.11@tcp:8:mount.lustre.0 Request processed in 166us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131157.105903:0:19981:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 19 00000001:00100000:3.0:1789131157.110017:0:20100:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 014f7d38-34be-4f2e-b715-3fbda0147a70 00000001:00100000:3.0:1789131157.110028:0:20100:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 10a3c9cb-0ead-44d0-a06d-1a07b352d8a9 00000001:00080000:3.0:1789131157.110038:0:20100:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00000100:00100000:2.0:1789131157.110121:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789131157.110408:0:17775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498331904 00000100:00100000:1.0:1789131157.110418:0:17775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498331904 00000100:00100000:1.0:1789131157.110514:0:17775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1 00000100:00100000:1.0:1789131157.110525:0:17775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7c6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:014f7d38-34be-4f2e-b715-3fbda0147a70+6:15281:x1876039498331904:12345-192.168.203.11@tcp:33:mount.lustre.0 00000004:00200000:1.0:1789131157.110626:0:17775:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1789131157.110706:0:17775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7c6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:014f7d38-34be-4f2e-b715-3fbda0147a70+6:15281:x1876039498331904:12345-192.168.203.11@tcp:33:mount.lustre.0 Request processed in 182us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131157.110714:0:17775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1 00000100:00100000:2.0:1789131157.306321:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789131157.309738:0:17771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498332032 00000100:00100000:1.0:1789131157.309752:0:17771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498332032 00000100:00100000:1.0:1789131157.309832:0:17771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 22 00000100:00100000:1.0:1789131157.309858:0:17771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7c6b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:014f7d38-34be-4f2e-b715-3fbda0147a70+6:15317:x1876039498332032:12345-192.168.203.11@tcp:101:mkdir.0 00010000:00010000:1.0:1789131157.309879:0:17771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789131157.309902:0:17771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cbc00/0xf3fe2838e1fc38b6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269e1f expref: -99 pid: 17771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131157.309993:0:17771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca800/0xf3fe2838e1fc38bd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131157.310008:0:17771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca800/0xf3fe2838e1fc38bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131157.310022:0:17771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca800/0xf3fe2838e1fc38bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789131157.310071:0:17771:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789131157.310075:0:17771:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789131157.310097:0:17771:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca800/0xf3fe2838e1fc38bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131157.310122:0:17771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cbc00/0xf3fe2838e1fc38b6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269e1f expref: 8 pid: 17771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131157.310140:0:17771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca800/0xf3fe2838e1fc38bd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269e1f expref: 7 pid: 17771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131157.310148:0:17771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91ddc4c81200) 00010000:00010000:1.0:1789131157.310151:0:17771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789131157.310156:0:17771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dcc85ca800, rc 0) 00000100:00100000:1.0:1789131157.310231:0:17771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7c6b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:014f7d38-34be-4f2e-b715-3fbda0147a70+7:15317:x1876039498332032:12345-192.168.203.11@tcp:101:mkdir.0 Request processed in 389us (3918us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131157.310237:0:17771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 22 00010000:00010000:1.0:1789131157.523006:0:17759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789131158.103629:0:19279:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 014f7d38-34be-4f2e-b715-3fbda0147a70 00000001:00100000:2.0:1789131158.103644:0:19279:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 10a3c9cb-0ead-44d0-a06d-1a07b352d8a9 00010000:00010000:3.0:1789131158.550858:0:17760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789131158.931499:0:17805:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789131159.579738:0:19311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789131160.146778:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789131160.146800:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01ad1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1876039508907136:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789131160.146883:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131160.146923:0:19286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508907136 00000100:00100000:3.0:1789131160.146929:0:19286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508907136 00000100:00100000:3.0:1789131160.146980:0:19286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789131160.146988:0:19286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01ad12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1876039508907136:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789131160.147014:0:19286:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1789131160.147053:0:19286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01ad12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1876039508907136:12345-0@lo:13:osp-pre-0-1.0 Request processed in 65us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131160.147059:0:19286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:3.0:1789131160.147191:0:17767:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789131160.147962:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01ad1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1876039508907136:0@lo:13:osp-pre-0-1.0 00000001:00100000:3.0:1789131160.149414:0:17751:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 014f7d38-34be-4f2e-b715-3fbda0147a70 00000001:00100000:3.0:1789131160.149426:0:17751:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 10a3c9cb-0ead-44d0-a06d-1a07b352d8a9 00000001:00100000:0.0:1789131160.150390:0:18506:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 014f7d38-34be-4f2e-b715-3fbda0147a70 00000001:00100000:0.0:1789131160.150400:0:18506:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 10a3c9cb-0ead-44d0-a06d-1a07b352d8a9 00000001:02000400:2.0:1789131160.154977:0:20659:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1789131160.593778:0:17759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789131160.658024:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01ad1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1876039508907264:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789131160.658089:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131160.658123:0:18514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508907264 00000100:00100000:0.0:1789131160.658131:0:18514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508907264 00000100:00100000:0.0:1789131160.658177:0:18514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789131160.658187:0:18514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01ad3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1876039508907264:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789131160.658219:0:18514:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1789131160.658277:0:18514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01ad3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1876039508907264:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131160.658284:0:18514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789131160.658324:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7c68b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1876039508907392:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789131160.658351:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131160.658594:0:17777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508907392 00000100:00100000:3.0:1789131160.658599:0:17777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508907392 00000100:00100000:3.0:1789131160.658623:0:17777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789131160.658629:0:17777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8609e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3627:x1876039508907392:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789131160.658646:0:17777:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789131160.659662:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01ad1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1876039508907264:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789131160.664774:0:17777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8609e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3627:x1876039508907392:12345-0@lo:41:osp-pre-1-0.0 Request processed in 6134us (6412us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131160.664789:0:17777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789131160.664925:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7c68b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1876039508907392:0@lo:41:osp-pre-1-0.0 00000040:00080000:3.0:1789131161.620192:0:18526:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789131161.620987:0:17760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789131162.206484:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01ad2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1876039508907904:0@lo:400:kworker.0 00000100:00100000:0.0:1789131162.206585:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131162.206660:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01ad03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508908416:0@lo:400:kworker.0 00000100:00100000:0.0:1789131162.206682:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131162.206715:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddc12a8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3627:1876039508908928:0@lo:400:kworker.0 00000100:00100000:0.0:1789131162.206739:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131162.206803:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1789131162.207011:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01ad1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:3627:1876039508907520:0@lo:400:kworker.0 00000100:00100000:0.0:1789131162.207045:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131162.207070:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01ad0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3627:1876039508908032:0@lo:400:kworker.0 00000100:00100000:0.0:1789131162.207094:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131162.207111:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01ad0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3627:1876039508908544:0@lo:400:kworker.0 00000100:00100000:0.0:1789131162.207130:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131162.207153:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddc12ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3627:1876039508909056:0@lo:400:kworker.0 00000100:00100000:0.0:1789131162.207174:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131162.207200:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01ad2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508907648:0@lo:400:kworker.0 00000100:00100000:0.0:1789131162.207224:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131162.207244:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01ad0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508908160:0@lo:400:kworker.0 00000100:00100000:0.0:1789131162.207263:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131162.207277:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01ad1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3625:1876039508908672:0@lo:400:kworker.0 00000100:00100000:0.0:1789131162.207296:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131162.207326:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1789131162.207332:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01ad21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508907776:0@lo:400:kworker.0 00000100:00100000:0.0:1789131162.207355:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131162.207372:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01ad2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508908288:0@lo:400:kworker.0 00000100:00100000:0.0:1789131162.207402:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131162.207420:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd1dade00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3625:1876039508908800:0@lo:400:kworker.0 00000100:00100000:0.0:1789131162.207440:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131162.207479:0:17773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508908928 00000100:00100000:0.0:1789131162.207486:0:17773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508908928 00000100:00100000:0.0:1789131162.207529:0:17773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508908032 00000100:00100000:0.0:1789131162.207532:0:17773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508908032 00000100:00100000:0.0:1789131162.207544:0:17773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508908544 00000100:00100000:0.0:1789131162.207546:0:17773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508908544 00000100:00100000:0.0:1789131162.207556:0:17773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508909056 00000100:00100000:0.0:1789131162.207558:0:17773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508909056 00000100:00100000:0.0:1789131162.207570:0:17773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508908672 00000100:00100000:0.0:1789131162.207572:0:17773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508908672 00000100:00100000:0.0:1789131162.207585:0:17773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508908800 00000100:00100000:0.0:1789131162.207587:0:17773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508908800 00000100:00100000:0.0:1789131162.207602:0:17773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789131162.207610:0:17773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc860ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3627:x1876039508908928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789131162.207663:0:17773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc860ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3627:x1876039508908928:12345-0@lo:400:kworker.0 Request processed in 53us (921us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131162.207670:0:17773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789131162.207685:0:17773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789131162.207691:0:17773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8609680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1876039508908032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789131162.207716:0:17773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8609680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1876039508908032:12345-0@lo:400:kworker.0 Request processed in 26us (622us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131162.207722:0:17773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789131162.207732:0:17773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789131162.207738:0:17773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc86092c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1876039508908544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789131162.207762:0:17773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc86092c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1876039508908544:12345-0@lo:400:kworker.0 Request processed in 25us (632us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131162.207789:0:17773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789131162.207802:0:17773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789131162.208123:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789131162.208133:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7c6b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508909184:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789131162.208162:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131162.208192:0:19096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789131162.208199:0:19096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff751a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1876039508908672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131162.208229:0:19096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff751a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1876039508908672:12345-0@lo:400:kworker.0 Request processed in 32us (931us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131162.208234:0:19096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789131162.208248:0:19096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789131162.208254:0:19096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff7521c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1876039508908800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131162.208280:0:19096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff7521c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1876039508908800:12345-0@lo:400:kworker.0 Request processed in 27us (839us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131162.208286:0:19096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789131162.208304:0:17776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508907648 00000100:00100000:2.0:1789131162.208308:0:17776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508907648 00000100:00100000:2.0:1789131162.208328:0:17776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508908160 00000100:00100000:2.0:1789131162.208331:0:17776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508908160 00000100:00100000:2.0:1789131162.208344:0:17776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789131162.208349:0:17776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff753840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1876039508907648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131162.208379:0:17776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff753840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1876039508907648:12345-0@lo:400:kworker.0 Request processed in 30us (1155us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131162.208385:0:17776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789131162.208407:0:17776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789131162.208412:0:17776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff7503c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508908160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131162.208441:0:17776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff7503c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508908160:12345-0@lo:400:kworker.0 Request processed in 28us (1177us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131162.208447:0:17776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:2.0:1789131162.208526:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91ddd1dade00 x1876039508908800/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789131178 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789131162.208540:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd1dade00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3625:1876039508908800:0@lo:400:kworker.0 00000100:00100000:2.0:1789131162.208551:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01ad2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508907648:0@lo:400:kworker.0 00000100:00100000:2.0:1789131162.208559:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01ad0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508908160:0@lo:400:kworker.0 00000100:00100000:2.0:1789131162.208568:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01ad1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3625:1876039508908672:0@lo:400:kworker.0 00000100:00100000:3.0:1789131162.208816:0:19285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508907904 00000100:00100000:3.0:1789131162.208834:0:19285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508907904 00000100:00100000:3.0:1789131162.208863:0:19285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508908416 00000100:00100000:3.0:1789131162.208867:0:19285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508908416 00000100:00100000:3.0:1789131162.208878:0:19285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508907776 00000100:00100000:3.0:1789131162.208881:0:19285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508907776 00000100:00100000:3.0:1789131162.209152:0:19285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508908288 00000100:00100000:3.0:1789131162.209156:0:19285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508908288 00000100:00100000:3.0:1789131162.209171:0:19285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789131162.209177:0:19285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc860b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3627:x1876039508907904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789131162.209222:0:19285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc860b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3627:x1876039508907904:12345-0@lo:400:kworker.0 Request processed in 44us (2636us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131162.209228:0:19285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789131162.209243:0:19285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789131162.209250:0:19285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc860b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508908416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789131162.209287:0:19285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc860b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508908416:12345-0@lo:400:kworker.0 Request processed in 37us (2604us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131162.209293:0:19285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789131162.209305:0:19285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789131162.209311:0:19285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff751e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1876039508907776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789131162.209344:0:19285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff751e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1876039508907776:12345-0@lo:400:kworker.0 Request processed in 33us (1989us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131162.209349:0:19285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789131162.209359:0:19285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789131162.209365:0:19285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff750b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508908288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789131162.209390:0:19285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff750b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508908288:12345-0@lo:400:kworker.0 Request processed in 26us (1988us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131162.209396:0:19285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:3.0:1789131162.209417:0:17767:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789131162.209420:0:17767:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789131162.209423:0:17767:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789131162.209425:0:17767:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789131162.209435:0:19286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508909184 00000100:00100000:3.0:1789131162.209439:0:19286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508909184 00000100:00100000:3.0:1789131162.209487:0:19286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789131162.209493:0:19286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7c69e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508909184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789131162.209513:0:19286:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:3.0:1789131162.209548:0:19286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7c69e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508909184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 56us (1385us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131162.209554:0:19286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789131162.209594:0:3626:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:3.0:1789131162.209614:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7c6b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508909184:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789131162.209653:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01ad21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508907776:0@lo:400:kworker.0 00000100:00100000:3.0:1789131162.209664:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01ad2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508908288:0@lo:400:kworker.0 00000100:00100000:0.0:1789131162.210440:0:17773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8608b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3627:x1876039508909056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131162.210539:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01ad0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3627:1876039508908032:0@lo:400:kworker.0 00000100:00100000:2.0:1789131162.210551:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01ad0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3627:1876039508908544:0@lo:400:kworker.0 00000100:00100000:2.0:1789131162.210562:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01ad2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1876039508907904:0@lo:400:kworker.0 00000100:00100000:2.0:1789131162.210571:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01ad03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508908416:0@lo:400:kworker.0 00000100:00100000:2.0:1789131162.210580:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddc12a8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3627:1876039508908928:0@lo:400:kworker.0 00000100:00100000:2.0:1789131162.210619:0:17766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508907520 00000100:00100000:2.0:1789131162.210625:0:17766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508907520 00000100:00100000:2.0:1789131162.210661:0:17766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1789131162.210667:0:17766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddfbfe3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+24:3627:x1876039508907520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131162.210716:0:17766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddfbfe3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+24:3627:x1876039508907520:12345-0@lo:400:kworker.0 Request processed in 48us (3670us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131162.210736:0:17766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1789131162.211017:0:17773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8608b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3627:x1876039508909056:12345-0@lo:400:kworker.0 Request processed in 3209us (3841us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131162.211025:0:17773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789131162.211160:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01ad1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:3627:1876039508907520:0@lo:400:kworker.0 00010000:00080000:2.0:1789131162.211179:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91ddc12ab480 x1876039508909056/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789131178 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789131162.211189:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddc12ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3627:1876039508909056:0@lo:400:kworker.0 00000100:00100000:1.0:1789131162.214972:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789131162.214996:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff752d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508909312:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789131162.215060:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131162.226590:0:19286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508909312 00000100:00100000:2.0:1789131162.226603:0:19286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508909312 00000100:00100000:2.0:1789131162.226670:0:19286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789131162.226680:0:19286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7b7b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508909312:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789131162.226704:0:19286:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:2.0:1789131162.226968:0:19286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7b7b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508909312:12345-0@lo:13:osp-pre-1-1.0 Request processed in 289us (11907us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131162.226976:0:19286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789131162.227026:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff752d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508909312:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789131162.229304:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7c6a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1876039508909440:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789131162.229368:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131162.229487:0:19287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508909440 00000100:00100000:1.0:1789131162.229494:0:19287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508909440 00000100:00100000:1.0:1789131162.229536:0:19287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789131162.229544:0:19287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7c69a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1876039508909440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789131162.229572:0:19287:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1789131162.229617:0:19287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7c69a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1876039508909440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131162.229624:0:19287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789131162.229705:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7c6a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1876039508909440:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789131162.474768:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131162.474815:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131162.474843:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131162.474864:0:19285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498332672 00000100:00100000:3.0:1789131162.474871:0:19285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498332672 00000100:00100000:2.0:1789131162.475032:0:17764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498332160 00000100:00100000:2.0:1789131162.475037:0:17764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498332160 00000100:00100000:2.0:1789131162.475078:0:17764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 145 00000100:00100000:2.0:1789131162.475087:0:17764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddfbfe1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22edf929-4c0f-42f3-973d-fe4d92543efa+13:2388:x1876039498332160:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1789131162.475152:0:17764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddfbfe1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:22edf929-4c0f-42f3-973d-fe4d92543efa+13:2388:x1876039498332160:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 66us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131162.475172:0:17764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 145 00000100:00100000:2.0:1789131162.475223:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131162.475338:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131162.475360:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131162.475377:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131162.475396:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131162.475420:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131162.475450:0:17773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498332416 00000100:00100000:2.0:1789131162.475454:0:17773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498332416 00000100:00100000:2.0:1789131162.478536:0:17773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498332928 00000100:00100000:2.0:1789131162.478548:0:17773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498332928 00000100:00100000:2.0:1789131162.478562:0:17773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498332288 00000100:00100000:2.0:1789131162.478564:0:17773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498332288 00000100:00100000:2.0:1789131162.478576:0:17773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498332800 00000100:00100000:2.0:1789131162.478579:0:17773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498332800 00000100:00100000:2.0:1789131162.478596:0:17773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 46 00000100:00100000:2.0:1789131162.478605:0:17773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc12a9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+5:2388:x1876039498332416:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1789131162.478685:0:17773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc12a9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+5:2388:x1876039498332416:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 80us (3869us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131162.478693:0:17773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 46 00000100:00100000:2.0:1789131162.478709:0:17773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 47 00000100:00100000:2.0:1789131162.478716:0:17773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7c6a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:014f7d38-34be-4f2e-b715-3fbda0147a70+5:2388:x1876039498332928:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1789131162.478762:0:17773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7c6a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:014f7d38-34be-4f2e-b715-3fbda0147a70+5:2388:x1876039498332928:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 46us (3539us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131162.478769:0:17773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 47 00000100:00100000:2.0:1789131162.478782:0:17773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 48 00000100:00100000:2.0:1789131162.478795:0:17773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7c69680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+6:2388:x1876039498332288:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:2.0:1789131162.478836:0:17773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7c69680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+6:2388:x1876039498332288:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 41us (3475us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131162.478842:0:17773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 48 00000100:00100000:2.0:1789131162.478853:0:17773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 49 00000100:00100000:2.0:1789131162.478860:0:17773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7c6a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:014f7d38-34be-4f2e-b715-3fbda0147a70+6:2388:x1876039498332800:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1789131162.479329:0:19283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498333184 00000100:00100000:1.0:1789131162.479335:0:19283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498333184 00000100:00100000:2.0:1789131162.479363:0:17773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7c6a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:014f7d38-34be-4f2e-b715-3fbda0147a70+6:2388:x1876039498332800:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 501us (3964us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131162.479370:0:17773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 49 00000100:00080000:3.0:1789131162.479672:0:17767:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789131162.480160:0:19981:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498332544 00000100:00100000:0.0:1789131162.480165:0:19981:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498332544 00000100:00100000:0.0:1789131162.480206:0:19981:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498333056 00000100:00100000:0.0:1789131162.480209:0:19981:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498333056 00000100:00100000:0.0:1789131162.480227:0:19981:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 10 00000100:00100000:0.0:1789131162.480234:0:19981:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7c6a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+5:2388:x1876039498332544:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1789131162.480278:0:19981:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7c6a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+5:2388:x1876039498332544:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 45us (4899us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131162.480284:0:19981:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 10 00000100:00100000:0.0:1789131162.480297:0:19981:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 11 00000100:00100000:0.0:1789131162.480304:0:19981:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7c692c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:014f7d38-34be-4f2e-b715-3fbda0147a70+5:2388:x1876039498333056:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1789131162.480326:0:19981:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7c692c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:014f7d38-34be-4f2e-b715-3fbda0147a70+5:2388:x1876039498333056:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 23us (4905us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131162.480331:0:19981:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 11 00000100:00100000:1.0:1789131162.482086:0:19283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 12 00000100:00100000:1.0:1789131162.482098:0:19283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7c68780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:014f7d38-34be-4f2e-b715-3fbda0147a70+5:2388:x1876039498333184:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1789131162.482155:0:19283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7c68780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:014f7d38-34be-4f2e-b715-3fbda0147a70+5:2388:x1876039498333184:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 59us (6817us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131162.482161:0:19283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 12 00000100:00080000:3.0:1789131162.483919:0:17767:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789131162.483926:0:17767:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789131162.483929:0:17767:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789131162.484028:0:19285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 13 00000100:00100000:3.0:1789131162.484038:0:19285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc12a9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+5:2388:x1876039498332672:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1789131162.484094:0:19285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc12a9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+5:2388:x1876039498332672:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 59us (9250us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131162.484100:0:19285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 13 00010000:00010000:3.0:1789131162.644507:0:19311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789131163.679726:0:17759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789131163.760967:0:20807:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff75ef1200 20000000:00000080:3.0:1789131163.760984:0:20807:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff91dcc6841000 uarg=0000000000000000 20000000:01000000:3.0:1789131163.761028:0:20807:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789131163.761034:0:20807:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789131163.761038:0:20807:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1789131163.763649:0:20808:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 19 20000000:00000400:2.0:1789131163.763833:0:20807:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1789131163.772631:0:20807:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789131163.772825:0:20807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91ddc0030600/0xf3fe2838e1fc38c4 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131163.772845:0:20807:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91ddfd0b5e00/0xf3fe2838e1fc3559 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc3552 expref: 23 pid: 17765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131163.772867:0:20807:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91ddfd0b5800/0xf3fe2838e1fc3567 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc3560 expref: 23 pid: 17765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131163.772873:0:20807:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91ddfd0b5c00/0xf3fe2838e1fc35a6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc359f expref: 23 pid: 17764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131163.772879:0:20807:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91ddfd0b4200/0xf3fe2838e1fc3640 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc3639 expref: 23 pid: 17766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131163.772888:0:20807:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91ddfd0b4400/0xf3fe2838e1fc3854 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269d7e expref: 12 pid: 17764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131163.772894:0:20807:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91de01ad6200/0xf3fe2838e1fc3893 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269dee expref: 12 pid: 17766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131163.772902:0:20807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91ddc0030600/0xf3fe2838e1fc38c4 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131163.772947:0:20807:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91de01ad6200/0xf3fe2838e1fc3893 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269dee expref: 12 pid: 17766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131163.772961:0:20807:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91de01ad6200/0xf3fe2838e1fc3893 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269dee expref: 12 pid: 17766 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131163.772976:0:20807:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddc12ab840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20807:1876039508909568:192.168.203.11@tcp:104: 00010000:00010000:3.0:1789131163.773091:0:20807:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91ddfd0b4400/0xf3fe2838e1fc3854 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269d7e expref: 12 pid: 17764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131163.773100:0:20807:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91ddfd0b4400/0xf3fe2838e1fc3854 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269d7e expref: 12 pid: 17764 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131163.773115:0:20807:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddc12a83c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20807:1876039508909696:192.168.203.11@tcp:104: 00010000:00010000:3.0:1789131163.773149:0:20807:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91ddfd0b4200/0xf3fe2838e1fc3640 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf3fe2838e1fc3639 expref: 23 pid: 17766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131163.773158:0:20807:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91ddfd0b4200/0xf3fe2838e1fc3640 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf3fe2838e1fc3639 expref: 23 pid: 17766 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131163.773166:0:20807:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddc12abc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20807:1876039508909824:0@lo:104: 00000100:00100000:3.0:1789131163.773204:0:20807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789131163.773248:0:20807:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91ddfd0b5c00/0xf3fe2838e1fc35a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf3fe2838e1fc359f expref: 23 pid: 17764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131163.773257:0:20807:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91ddfd0b5c00/0xf3fe2838e1fc35a6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf3fe2838e1fc359f expref: 23 pid: 17764 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131163.773265:0:20807:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddc12a92c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20807:1876039508909952:0@lo:104: 00000100:00100000:3.0:1789131163.773290:0:20807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789131163.773318:0:20807:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91ddfd0b5800/0xf3fe2838e1fc3567 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf3fe2838e1fc3560 expref: 23 pid: 17765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131163.773325:0:20807:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91ddfd0b5800/0xf3fe2838e1fc3567 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf3fe2838e1fc3560 expref: 23 pid: 17765 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131163.773333:0:20807:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddc12aa940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20807:1876039508910080:0@lo:104: 00000100:00100000:3.0:1789131163.773352:0:20807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789131163.773367:0:20807:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91ddfd0b5e00/0xf3fe2838e1fc3559 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf3fe2838e1fc3552 expref: 23 pid: 17765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131163.773385:0:20807:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91ddfd0b5e00/0xf3fe2838e1fc3559 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf3fe2838e1fc3552 expref: 23 pid: 17765 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131163.773395:0:20807:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddc12aad00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20807:1876039508910208:0@lo:104: 00000100:00100000:3.0:1789131163.773416:0:20807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131163.773426:0:20807:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddd029a180 going to sleep for 11 seconds 00000100:00100000:0.0:1789131163.773649:0:17754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508909824 00000100:00100000:0.0:1789131163.773656:0:17754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508909824 00000100:00100000:0.0:1789131163.773691:0:17754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508909952 00000100:00100000:0.0:1789131163.773695:0:17754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508909952 00000100:00100000:0.0:1789131163.773705:0:17754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508910080 00000100:00100000:0.0:1789131163.773708:0:17754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508910080 00000100:00100000:0.0:1789131163.773726:0:17754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508910208 00000100:00100000:0.0:1789131163.773728:0:17754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508910208 00000100:00100000:0.0:1789131163.773740:0:17754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789131163.773748:0:17754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc12a8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+6:20807:x1876039508909824:12345-0@lo:104: 00010000:00010000:0.0:1789131163.773760:0:17754:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff91de01ad6400/0xf3fe2838e1fc3639 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3fe2838e1fc3640 expref: -99 pid: 20099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131163.773832:0:17754:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789131163.773837:0:17754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc12a8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+6:20807:x1876039508909824:12345-0@lo:104: Request processed in 91us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131163.773845:0:17754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789131163.773861:0:17754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789131163.773867:0:17754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc12a8b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+5:20807:x1876039508909952:12345-0@lo:104: 00010000:00010000:0.0:1789131163.773874:0:17754:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7f600/0xf3fe2838e1fc359f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3fe2838e1fc35a6 expref: -99 pid: 19278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131163.773909:0:17754:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789131163.773914:0:17754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc12a8b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+5:20807:x1876039508909952:12345-0@lo:104: Request processed in 48us (624us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131163.773920:0:17754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789131163.773932:0:17754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789131163.773937:0:17754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc12a9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+4:20807:x1876039508910080:12345-0@lo:104: 00010000:00010000:0.0:1789131163.773944:0:17754:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff91de01ad6a00/0xf3fe2838e1fc3560 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3fe2838e1fc3567 expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131163.773973:0:17754:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1789131163.773978:0:17754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc12a9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+4:20807:x1876039508910080:12345-0@lo:104: Request processed in 41us (626us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131163.773992:0:17754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789131163.774006:0:17754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789131163.774011:0:17754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc12a8f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+3:20807:x1876039508910208:12345-0@lo:104: 00010000:00010000:0.0:1789131163.774019:0:17754:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7ec00/0xf3fe2838e1fc3552 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3fe2838e1fc3559 expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131163.774045:0:17754:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1789131163.774049:0:17754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc12a8f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+3:20807:x1876039508910208:12345-0@lo:104: Request processed in 39us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131163.774055:0:17754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:0.0:1789131163.774072:0:19311:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1789131163.774078:0:19311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff91de01ad6400/0xf3fe2838e1fc3639 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3fe2838e1fc3640 expref: -99 pid: 20099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131163.774086:0:19311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91de01ad6400 already unused, calling callback (ffffffffc124bc20) 10000000:00010000:0.0:1789131163.774091:0:19311:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff91de01ad6400/0xf3fe2838e1fc3639 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xf3fe2838e1fc3640 expref: -99 pid: 20099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131163.774100:0:19311:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff91de01ad6400/0xf3fe2838e1fc3639 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xf3fe2838e1fc3640 expref: -99 pid: 20099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789131163.774108:0:19311:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff91de01ad6400/0xf3fe2838e1fc3639 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xf3fe2838e1fc3640 expref: -99 pid: 20099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789131163.774115:0:19311:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789131163.774142:0:19311:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff91de01ad6400/0xf3fe2838e1fc3639 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc3640 expref: -99 pid: 20099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131163.774150:0:19311:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789131163.774174:0:19311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff91de01ad6400/0xf3fe2838e1fc3639 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc3640 expref: -99 pid: 20099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131163.774181:0:19311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff91de01ad6400/0xf3fe2838e1fc3639 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc3640 expref: -99 pid: 20099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131163.774196:0:19311:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789131163.774199:0:19311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7f600/0xf3fe2838e1fc359f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3fe2838e1fc35a6 expref: -99 pid: 19278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131163.774205:0:19311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc7f7f600 already unused, calling callback (ffffffffc124bc20) 10000000:00010000:0.0:1789131163.774208:0:19311:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7f600/0xf3fe2838e1fc359f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf3fe2838e1fc35a6 expref: -99 pid: 19278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131163.774216:0:19311:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7f600/0xf3fe2838e1fc359f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf3fe2838e1fc35a6 expref: -99 pid: 19278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789131163.774223:0:19311:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7f600/0xf3fe2838e1fc359f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf3fe2838e1fc35a6 expref: -99 pid: 19278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789131163.774228:0:19311:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789131163.774241:0:19311:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7f600/0xf3fe2838e1fc359f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc35a6 expref: -99 pid: 19278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131163.774247:0:19311:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789131163.774260:0:19311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7f600/0xf3fe2838e1fc359f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc35a6 expref: -99 pid: 19278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131163.774266:0:19311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7f600/0xf3fe2838e1fc359f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc35a6 expref: -99 pid: 19278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131163.774285:0:19311:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789131163.774288:0:19311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff91de01ad6a00/0xf3fe2838e1fc3560 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3fe2838e1fc3567 expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131163.774294:0:19311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91de01ad6a00 already unused, calling callback (ffffffffc124bc20) 10000000:00010000:0.0:1789131163.774297:0:19311:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff91de01ad6a00/0xf3fe2838e1fc3560 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf3fe2838e1fc3567 expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131163.774304:0:19311:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff91de01ad6a00/0xf3fe2838e1fc3560 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf3fe2838e1fc3567 expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789131163.774310:0:19311:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff91de01ad6a00/0xf3fe2838e1fc3560 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf3fe2838e1fc3567 expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789131163.774315:0:19311:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789131163.774326:0:19311:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff91de01ad6a00/0xf3fe2838e1fc3560 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc3567 expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131163.774332:0:19311:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789131163.774337:0:19311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff91de01ad6a00/0xf3fe2838e1fc3560 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc3567 expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131163.774343:0:19311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff91de01ad6a00/0xf3fe2838e1fc3560 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc3567 expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131163.774352:0:19311:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789131163.774354:0:19311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7ec00/0xf3fe2838e1fc3552 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3fe2838e1fc3559 expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131163.774368:0:19311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc7f7ec00 already unused, calling callback (ffffffffc124bc20) 10000000:00010000:0.0:1789131163.774371:0:19311:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7ec00/0xf3fe2838e1fc3552 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf3fe2838e1fc3559 expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131163.774377:0:19311:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7ec00/0xf3fe2838e1fc3552 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf3fe2838e1fc3559 expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789131163.774383:0:19311:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7ec00/0xf3fe2838e1fc3552 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf3fe2838e1fc3559 expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789131163.774388:0:19311:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789131163.774400:0:19311:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7ec00/0xf3fe2838e1fc3552 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc3559 expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131163.774406:0:19311:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789131163.774411:0:19311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7ec00/0xf3fe2838e1fc3552 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc3559 expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131163.774418:0:19311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.111@tcp lock: ffff91dcc7f7ec00/0xf3fe2838e1fc3552 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3fe2838e1fc3559 expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131163.774431:0:19311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789131163.774433:0:19311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789131163.774435:0:19311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789131163.774441:0:17759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789131163.774488:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff751680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:3628:1876039508910336:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789131163.774519:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131163.774548:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789131163.774554:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff752940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:3628:1876039508910720:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789131163.774579:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131163.774606:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff753c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:3625:1876039508910464:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789131163.774626:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131163.774677:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789131163.774683:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff752580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:3625:1876039508910592:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789131163.774703:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131163.774733:0:17757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508910336 00000100:00100000:0.0:1789131163.774737:0:17757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508910336 00010000:00010000:0.0:1789131163.774755:0:17757:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91ddfd0b4200/0xf3fe2838e1fc3640 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3fe2838e1fc3639 expref: 24 pid: 17766 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131163.774768:0:17757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508910720 00000100:00100000:0.0:1789131163.774771:0:17757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508910720 00010000:00010000:0.0:1789131163.774780:0:17757:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91ddfd0b5e00/0xf3fe2838e1fc3559 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3fe2838e1fc3552 expref: 25 pid: 17765 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131163.774789:0:17757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508910464 00000100:00100000:0.0:1789131163.774792:0:17757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508910464 00010000:00010000:0.0:1789131163.774815:0:17757:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91ddfd0b5c00/0xf3fe2838e1fc35a6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3fe2838e1fc359f expref: 26 pid: 17764 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131163.774825:0:17757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508910592 00000100:00100000:0.0:1789131163.774827:0:17757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508910592 00010000:00010000:0.0:1789131163.774835:0:17757:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91ddfd0b5800/0xf3fe2838e1fc3567 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3fe2838e1fc3560 expref: 27 pid: 17765 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131163.774846:0:17757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789131163.774852:0:17757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff750780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+27:3628:x1876039508910336:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789131163.774862:0:17757:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789131163.774872:0:17757:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91ddfd0b4200/0xf3fe2838e1fc3640 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3fe2838e1fc3639 expref: 27 pid: 17766 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131163.774882:0:17757:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91ddfd0b4200/0xf3fe2838e1fc3640 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf3fe2838e1fc3639 expref: 27 pid: 17766 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131163.774897:0:17757:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789131163.774925:0:17757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff750780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+27:3628:x1876039508910336:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131163.774932:0:17757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789131163.774946:0:17757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789131163.774951:0:17757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff753480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+26:3628:x1876039508910720:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789131163.774959:0:17757:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789131163.774963:0:17757:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91ddfd0b5e00/0xf3fe2838e1fc3559 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3fe2838e1fc3552 expref: 26 pid: 17765 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131163.774971:0:17757:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91ddfd0b5e00/0xf3fe2838e1fc3559 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf3fe2838e1fc3552 expref: 26 pid: 17765 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131163.774980:0:17757:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789131163.775000:0:17757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff753480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+26:3628:x1876039508910720:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131163.775006:0:17757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789131163.775018:0:17757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789131163.775024:0:17757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff750000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+25:3625:x1876039508910464:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789131163.775031:0:17757:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789131163.775035:0:17757:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91ddfd0b5c00/0xf3fe2838e1fc35a6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3fe2838e1fc359f expref: 25 pid: 17764 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131163.775053:0:17757:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91ddfd0b5c00/0xf3fe2838e1fc35a6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf3fe2838e1fc359f expref: 25 pid: 17764 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131163.775063:0:17757:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789131163.775087:0:17757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff750000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+25:3625:x1876039508910464:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131163.775094:0:17757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789131163.775106:0:17757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789131163.775111:0:17757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff750f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+24:3625:x1876039508910592:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789131163.775119:0:17757:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789131163.775123:0:17757:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91ddfd0b5800/0xf3fe2838e1fc3567 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3fe2838e1fc3560 expref: 24 pid: 17765 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131163.775130:0:17757:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91ddfd0b5800/0xf3fe2838e1fc3567 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf3fe2838e1fc3560 expref: 24 pid: 17765 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131163.775139:0:17757:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789131163.775158:0:17757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff750f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+24:3625:x1876039508910592:12345-0@lo:103:ldlm_bl.0 Request processed in 47us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131163.775164:0:17757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789131163.775202:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff752580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:3625:1876039508910592:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789131163.775210:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff753c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:3625:1876039508910464:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789131163.775235:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff752940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:3628:1876039508910720:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789131163.775243:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff751680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:3628:1876039508910336:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789131163.775317:0:17760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789131163.777022:0:20807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91ddfd0b4200/0xf3fe2838e1fc3640 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf3fe2838e1fc3639 expref: 23 pid: 17766 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131163.777036:0:20807:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddc12abc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20807:1876039508909824:0@lo:104: 00010000:00010000:3.0:1789131163.777047:0:20807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91ddfd0b5c00/0xf3fe2838e1fc35a6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf3fe2838e1fc359f expref: 22 pid: 17764 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131163.777056:0:20807:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddc12a92c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20807:1876039508909952:0@lo:104: 00010000:00010000:3.0:1789131163.777065:0:20807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91ddfd0b5800/0xf3fe2838e1fc3567 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf3fe2838e1fc3560 expref: 21 pid: 17765 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131163.777072:0:20807:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddc12aa940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20807:1876039508910080:0@lo:104: 00010000:00010000:3.0:1789131163.777080:0:20807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91ddfd0b5e00/0xf3fe2838e1fc3559 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf3fe2838e1fc3552 expref: 20 pid: 17765 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131163.777088:0:20807:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddc12aad00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20807:1876039508910208:0@lo:104: 00000100:00100000:1.0:1789131163.782832:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131163.782917:0:17757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498333312 00000100:00100000:2.0:1789131163.782928:0:17757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498333312 00010000:00010000:2.0:1789131163.782969:0:17757:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91ddfd0b4400/0xf3fe2838e1fc3854 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269d7e expref: 13 pid: 17764 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131163.783014:0:17757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 13 00000100:00100000:2.0:1789131163.783025:0:17757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff4e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:22edf929-4c0f-42f3-973d-fe4d92543efa+13:2387:x1876039498333312:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789131163.783039:0:17757:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789131163.783045:0:17757:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91ddfd0b4400/0xf3fe2838e1fc3854 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269d7e expref: 13 pid: 17764 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131163.783056:0:17757:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91ddfd0b4400/0xf3fe2838e1fc3854 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269d7e expref: 13 pid: 17764 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131163.783079:0:17757:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789131163.783153:0:17757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff4e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:22edf929-4c0f-42f3-973d-fe4d92543efa+13:2387:x1876039498333312:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 129us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131163.783162:0:17757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 13 00000100:00100000:0.0:1789131163.783530:0:20807:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddc12ab840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20807:1876039508909568:192.168.203.11@tcp:104: 00010000:00010000:0.0:1789131163.783557:0:20807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91ddfd0b4400/0xf3fe2838e1fc3854 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269d7e expref: 12 pid: 17764 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131163.783569:0:20807:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddc12a83c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20807:1876039508909696:192.168.203.11@tcp:104: 00010000:00010000:0.0:1789131163.783603:0:20807:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91ddc0030600/0xf3fe2838e1fc38c4 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131163.785355:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131163.785431:0:17756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498333440 00000100:00100000:0.0:1789131163.785440:0:17756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498333440 00010000:00010000:0.0:1789131163.785502:0:17756:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91de01ad6200/0xf3fe2838e1fc3893 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269dee expref: 12 pid: 17766 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131163.785537:0:17756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 14 00000100:00100000:0.0:1789131163.785546:0:17756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7b7a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:22edf929-4c0f-42f3-973d-fe4d92543efa+12:2387:x1876039498333440:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789131163.785560:0:17756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789131163.785566:0:17756:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91de01ad6200/0xf3fe2838e1fc3893 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269dee expref: 12 pid: 17766 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131163.785578:0:17756:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91de01ad6200/0xf3fe2838e1fc3893 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269dee expref: 12 pid: 17766 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131163.785596:0:17756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91de01ad6200/0xf3fe2838e1fc3893 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269dee expref: 12 pid: 17766 timeout: 619 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131163.785613:0:17756:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91ddc0030600/0xf3fe2838e1fc38c4 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131163.785621:0:17756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91ddc0030600/0xf3fe2838e1fc38c4 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131163.785649:0:17756:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91ddc0030600/0xf3fe2838e1fc38c4 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131163.785656:0:17756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91ddc0030600/0xf3fe2838e1fc38c4 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131163.785662:0:17756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91ddc0030600/0xf3fe2838e1fc38c4 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131163.785668:0:17756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91ddc0030600/0xf3fe2838e1fc38c4 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131163.785675:0:17756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddc0030600 already unused, calling callback (ffffffffc0c4e550) 00010000:00010000:0.0:1789131163.785679:0:17756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91ddc0030600/0xf3fe2838e1fc38c4 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131163.785686:0:17756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91ddc0030600/0xf3fe2838e1fc38c4 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 20807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131163.785711:0:17756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91ddc0030600/0xf3fe2838e1fc38c4 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131163.785723:0:17756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789131163.785773:0:17756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7b7a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:22edf929-4c0f-42f3-973d-fe4d92543efa+11:2387:x1876039498333440:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 227us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131163.785780:0:17756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 14 00010000:00010000:3.0:1789131163.786426:0:20807:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91ddc0030600/0xf3fe2838e1fc38c4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131163.786437:0:20807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91ddc0030600/0xf3fe2838e1fc38c4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131163.786454:0:20807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91ddc0030600/0xf3fe2838e1fc38c4 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131164.689979:0:19311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789131165.265550:0:17768:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789131165.265562:0:17768:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91de01a79000 from 19 10000000:01000000:1.0:1789131165.265570:0:17768:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789131165.265640:0:17768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff91dcc85cb400/0xf3fe2838e1fc38cb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131165.265663:0:17768:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff91dcc85cb400/0xf3fe2838e1fc38cb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131165.265688:0:17768:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff91dcc85cb400/0xf3fe2838e1fc38cb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131165.265726:0:17768:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7b78780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:17768:1876039508910848:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789131165.265841:0:17768:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131165.265906:0:17768:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddd0683600 going to sleep for 11 seconds 00000100:00100000:3.0:1789131165.265951:0:17765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508910848 00000100:00100000:3.0:1789131165.265963:0:17765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508910848 00000100:00100000:3.0:1789131165.266022:0:17765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1789131165.266033:0:17765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddfbfe2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+20:17768:x1876039508910848:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789131165.266049:0:17765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789131165.266075:0:17765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91ddc0030600/0xf3fe2838e1fc38d2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3fe2838e1fc38cb expref: -99 pid: 17765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131165.266104:0:17765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91ddc0030600/0xf3fe2838e1fc38d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3fe2838e1fc38cb expref: 21 pid: 17765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131165.266117:0:17765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91ddc0030600/0xf3fe2838e1fc38d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc38cb expref: 21 pid: 17765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131165.266127:0:17765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ddc0030600, rc 0) 00000100:00100000:3.0:1789131165.266214:0:17765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddfbfe2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+21:17768:x1876039508910848:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 182us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131165.266294:0:17765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1789131165.266355:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddc12aa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1876039508910976:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789131165.266367:0:17768:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7b78780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:17768:1876039508910848:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789131165.266394:0:17768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff91dcc85cb400/0xf3fe2838e1fc38cb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc38d2 expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131165.266408:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789131165.266421:0:17768:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff91dcc85cb400/0xf3fe2838e1fc38cb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3fe2838e1fc38d2 expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131165.266836:0:17768:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7b78780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:17768:1876039508911104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789131165.266883:0:17768:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131165.266928:0:17768:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddd0683600 going to sleep for 11 seconds 00000100:00100000:1.0:1789131165.266952:0:19287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508910976 00000100:00100000:1.0:1789131165.266958:0:19287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508910976 00000100:00100000:1.0:1789131165.268233:0:19287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789131165.268252:0:19287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc12aa1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1876039508910976:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789131165.268298:0:19287:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1789131165.268383:0:19287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc12aa1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1876039508910976:12345-0@lo:13:osp-pre-0-1.0 Request processed in 139us (1986us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131165.268407:0:19287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:1.0:1789131165.268439:0:17767:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789131165.268525:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddc12aa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1876039508910976:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789131165.270286:0:17766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508911104 00000100:00100000:3.0:1789131165.270304:0:17766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508911104 00000100:00100000:3.0:1789131165.270386:0:17766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1789131165.270396:0:17766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddfbfe1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+21:17768:x1876039508911104:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789131165.270775:0:17766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddfbfe1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+21:17768:x1876039508911104:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 380us (3889us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131165.270795:0:17766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1789131165.271263:0:17768:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7b78780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:17768:1876039508911104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789131165.271348:0:17768:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7b78780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:17768:1876039508911232:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789131165.271433:0:17768:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131165.271518:0:17768:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddd0683600 going to sleep for 11 seconds 00000100:00100000:3.0:1789131165.271859:0:17764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508911232 00000100:00100000:3.0:1789131165.271869:0:17764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508911232 00000100:00100000:3.0:1789131165.271920:0:17764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1789131165.271929:0:17764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddfbfe0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+21:17768:x1876039508911232:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789131165.272054:0:17764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddfbfe0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+21:17768:x1876039508911232:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 127us (622us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131165.272061:0:17764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1789131165.272761:0:17768:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7b78780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:17768:1876039508911232:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789131165.275010:0:20869:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 19 00000020:01000000:2.0:1789131165.276191:0:17768:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 19-18 (rc=0) 10000000:01000000:2.0:1789131165.276301:0:17768:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789131165.276314:0:17768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff91dcc85cb400/0xf3fe2838e1fc38cb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc38d2 expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131165.276326:0:17768:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff91dcc85cb400/0xf3fe2838e1fc38cb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc38d2 expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789131165.276337:0:17768:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789131165.276339:0:17768:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91ddfd258000 from 19 10000000:01000000:2.0:1789131165.276342:0:17768:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789131165.276380:0:17768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff91dcc78dfa00/0xf3fe2838e1fc38d9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131165.276387:0:17768:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff91dcc78dfa00/0xf3fe2838e1fc38d9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131165.276398:0:17768:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff91dcc78dfa00/0xf3fe2838e1fc38d9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131165.276423:0:17768:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7c68000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:17768:1876039508911360:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789131165.276592:0:17768:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131165.277071:0:17768:0:(client.c:2715:ptlrpc_set_wait()) set ffff91dcc7c5a480 going to sleep for 11 seconds 00000100:00100000:0.0:1789131165.277182:0:17765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508911360 00000100:00100000:0.0:1789131165.277198:0:17765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508911360 00000100:00100000:0.0:1789131165.277284:0:17765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1789131165.277363:0:17765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddfbfe2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+21:17768:x1876039508911360:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789131165.277413:0:17765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789131165.277436:0:17765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91de01ad6400/0xf3fe2838e1fc38e0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3fe2838e1fc38d9 expref: -99 pid: 17765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131165.277568:0:17765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91de01ad6400/0xf3fe2838e1fc38e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3fe2838e1fc38d9 expref: 22 pid: 17765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131165.277580:0:17765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91de01ad6400/0xf3fe2838e1fc38e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc38d9 expref: 22 pid: 17765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131165.277590:0:17765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91de01ad6400, rc 0) 00000100:00100000:0.0:1789131165.277679:0:17765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddfbfe2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+22:17768:x1876039508911360:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 385us (1086us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131165.277688:0:17765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1789131165.278940:0:17768:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7c68000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:17768:1876039508911360:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789131165.278972:0:17768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff91dcc78dfa00/0xf3fe2838e1fc38d9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc38e0 expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131165.279003:0:17768:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff91dcc78dfa00/0xf3fe2838e1fc38d9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3fe2838e1fc38e0 expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131165.279019:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131165.279074:0:17766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498333568 00000100:00100000:0.0:1789131165.279084:0:17766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498333568 00000100:00100000:2.0:1789131165.279101:0:17768:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7c68000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:17768:1876039508911488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789131165.279139:0:17766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 150 00000100:00100000:0.0:1789131165.279153:0:17766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddfbfe0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22edf929-4c0f-42f3-973d-fe4d92543efa+11:15162:x1876039498333568:12345-192.168.203.11@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789131165.279168:0:17768:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789131165.279171:0:17766:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789131165.279192:0:17766:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91de01ad6a00/0xf3fe2838e1fc38e7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269e26 expref: -99 pid: 17766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131165.279212:0:17768:0:(client.c:2715:ptlrpc_set_wait()) set ffff91dcc7c5a480 going to sleep for 11 seconds 00010000:00010000:0.0:1789131165.279221:0:17766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91de01ad6a00/0xf3fe2838e1fc38e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269e26 expref: 12 pid: 17766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131165.279234:0:17766:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91de01ad6a00/0xf3fe2838e1fc38e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269e26 expref: 12 pid: 17766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131165.279259:0:17766:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91de01ad6a00, rc 0) 00000100:00100000:0.0:1789131165.279334:0:17766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddfbfe0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22edf929-4c0f-42f3-973d-fe4d92543efa+12:15162:x1876039498333568:12345-192.168.203.11@tcp:101:ll_cfg_requeue.0 Request processed in 185us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131165.279343:0:17766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 150 00000100:00100000:0.0:1789131165.279373:0:17766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508911488 00000100:00100000:0.0:1789131165.279386:0:17766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508911488 00000100:00100000:0.0:1789131165.279403:0:17766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1789131165.279409:0:17766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddfbfe3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+22:17768:x1876039508911488:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789131165.279613:0:17766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddfbfe3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+22:17768:x1876039508911488:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 204us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131165.279621:0:17766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1789131165.279679:0:17768:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7c68000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:17768:1876039508911488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789131165.279730:0:17768:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff751680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:17768:1876039508911616:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789131165.279779:0:17768:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131165.279818:0:17768:0:(client.c:2715:ptlrpc_set_wait()) set ffff91dcc10f5840 going to sleep for 11 seconds 00000100:00100000:0.0:1789131165.279831:0:17766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508911616 00000100:00100000:0.0:1789131165.279834:0:17766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508911616 00000100:00100000:0.0:1789131165.279856:0:17766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1789131165.279862:0:17766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddfbfe1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+22:17768:x1876039508911616:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789131165.279960:0:17766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddfbfe1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+22:17768:x1876039508911616:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 96us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131165.279967:0:17766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1789131165.280016:0:17768:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff751680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:17768:1876039508911616:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789131165.281918:0:20870:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 19 00000020:01000000:0.0:1789131165.282105:0:17768:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 19-18 (rc=0) 10000000:01000000:0.0:1789131165.282150:0:17768:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789131165.282495:0:17768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff91dcc78dfa00/0xf3fe2838e1fc38d9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc38e0 expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131165.282510:0:17768:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff91dcc78dfa00/0xf3fe2838e1fc38d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc38e0 expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789131165.282877:0:17768:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789131165.282883:0:17768:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91ddf34a7800 from 19 10000000:01000000:0.0:1789131165.282887:0:17768:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789131165.282942:0:17768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff91de01ad6200/0xf3fe2838e1fc38ee lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131165.282950:0:17768:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff91de01ad6200/0xf3fe2838e1fc38ee lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131165.282963:0:17768:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff91de01ad6200/0xf3fe2838e1fc38ee lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131165.282995:0:17768:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff751680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:17768:1876039508911744:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789131165.283089:0:17768:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131165.283155:0:17768:0:(client.c:2715:ptlrpc_set_wait()) set ffff91dcc10f5840 going to sleep for 11 seconds 00000100:00100000:2.0:1789131165.283655:0:17765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508911744 00000100:00100000:2.0:1789131165.283670:0:17765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508911744 00000100:00100000:2.0:1789131165.283724:0:17765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1789131165.283734:0:17765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddfbfe2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+22:17768:x1876039508911744:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789131165.283751:0:17765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789131165.283771:0:17765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91dcc78de400/0xf3fe2838e1fc38f5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3fe2838e1fc38ee expref: -99 pid: 17765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131165.283809:0:17765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91dcc78de400/0xf3fe2838e1fc38f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3fe2838e1fc38ee expref: 23 pid: 17765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131165.283821:0:17765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91dcc78de400/0xf3fe2838e1fc38f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc38ee expref: 23 pid: 17765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131165.283830:0:17765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dcc78de400, rc 0) 00000100:00100000:2.0:1789131165.283906:0:17765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddfbfe2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+23:17768:x1876039508911744:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 173us (816us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131165.283914:0:17765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1789131165.284223:0:17768:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff751680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:17768:1876039508911744:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789131165.284252:0:17768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff91de01ad6200/0xf3fe2838e1fc38ee lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc38f5 expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131165.284265:0:17768:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff91de01ad6200/0xf3fe2838e1fc38ee lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3fe2838e1fc38f5 expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131165.284395:0:17768:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff751680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:17768:1876039508911872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789131165.284445:0:17768:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131165.284517:0:17768:0:(client.c:2715:ptlrpc_set_wait()) set ffff91dcc10f5840 going to sleep for 11 seconds 00000100:00100000:2.0:1789131165.286970:0:17764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508911872 00000100:00100000:2.0:1789131165.286987:0:17764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508911872 00000100:00100000:2.0:1789131165.287080:0:17764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1789131165.287090:0:17764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddfbfe1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+23:17768:x1876039508911872:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789131165.287287:0:17764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddfbfe1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+23:17768:x1876039508911872:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 198us (2842us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131165.287295:0:17764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1789131165.287694:0:17768:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff751680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:17768:1876039508911872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789131165.287793:0:17768:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff751680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:17768:1876039508912000:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789131165.287959:0:17768:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131165.288015:0:17768:0:(client.c:2715:ptlrpc_set_wait()) set ffff91dcc10f5840 going to sleep for 11 seconds 00000100:00100000:2.0:1789131165.289011:0:17766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508912000 00000100:00100000:2.0:1789131165.289022:0:17766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508912000 00000100:00100000:2.0:1789131165.289069:0:17766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1789131165.289079:0:17766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddfbfe0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+23:17768:x1876039508912000:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789131165.289226:0:17766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddfbfe0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+23:17768:x1876039508912000:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 139us (1259us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131165.289234:0:17766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1789131165.289292:0:17768:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff751680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:17768:1876039508912000:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789131165.289936:0:20872:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 19 00000020:01000000:2.0:1789131165.289987:0:17768:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 19-18 (rc=0) 10000000:01000000:2.0:1789131165.290010:0:17768:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789131165.290020:0:17768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff91de01ad6200/0xf3fe2838e1fc38ee lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc38f5 expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131165.290031:0:17768:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff91de01ad6200/0xf3fe2838e1fc38ee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc38f5 expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789131165.290042:0:17768:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789131165.290045:0:17768:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91dcc78a7000 from 19 10000000:01000000:2.0:1789131165.290048:0:17768:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789131165.290079:0:17768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.111@tcp lock: ffff91dcc78de800/0xf3fe2838e1fc38fc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131165.290099:0:17768:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.111@tcp lock: ffff91dcc78de800/0xf3fe2838e1fc38fc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131165.290107:0:17768:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.111@tcp lock: ffff91dcc78de800/0xf3fe2838e1fc38fc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131165.290128:0:17768:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7c683c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:17768:1876039508912128:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789131165.290165:0:17768:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131165.290185:0:17768:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddfcfc2c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789131165.290201:0:17764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508912128 00000100:00100000:2.0:1789131165.290205:0:17764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508912128 00000100:00100000:2.0:1789131165.290233:0:17764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789131165.290240:0:17764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddfff14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+23:17768:x1876039508912128:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789131165.290249:0:17764:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789131165.290262:0:17764:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91dcc78dfe00/0xf3fe2838e1fc3903 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3fe2838e1fc38fc expref: -99 pid: 17764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131165.290282:0:17764:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91dcc78dfe00/0xf3fe2838e1fc3903 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3fe2838e1fc38fc expref: 24 pid: 17764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131165.290293:0:17764:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91dcc78dfe00/0xf3fe2838e1fc3903 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3fe2838e1fc38fc expref: 24 pid: 17764 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131165.290301:0:17764:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dcc78dfe00, rc 0) 00000100:00100000:2.0:1789131165.290331:0:17764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddfff14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+24:17768:x1876039508912128:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 91us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131165.290338:0:17764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789131165.290376:0:17768:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7c683c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:17768:1876039508912128:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789131165.290389:0:17768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.111@tcp lock: ffff91dcc78de800/0xf3fe2838e1fc38fc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc3903 expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131165.290398:0:17768:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.111@tcp lock: ffff91dcc78de800/0xf3fe2838e1fc38fc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3fe2838e1fc3903 expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131165.290439:0:17768:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7c683c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:17768:1876039508912256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789131165.290483:0:17768:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131165.290497:0:17768:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddfcfc2c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789131165.290508:0:17764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508912256 00000100:00100000:2.0:1789131165.290511:0:17764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508912256 00000100:00100000:2.0:1789131165.290532:0:17764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1789131165.290537:0:17764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddfff17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+24:17768:x1876039508912256:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789131165.290620:0:17764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddfff17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+24:17768:x1876039508912256:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 83us (136us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131165.290627:0:17764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1789131165.290654:0:17768:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7c683c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:17768:1876039508912256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789131165.290676:0:17768:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7c683c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:17768:1876039508912384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789131165.290710:0:17768:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131165.290722:0:17768:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddfcfc2c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789131165.290732:0:17764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508912384 00000100:00100000:2.0:1789131165.290735:0:17764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508912384 00000100:00100000:2.0:1789131165.290755:0:17764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1789131165.290760:0:17764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddfff15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+24:17768:x1876039508912384:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789131165.291617:0:17764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddfff15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+24:17768:x1876039508912384:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 855us (905us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131165.291730:0:17764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1789131165.291862:0:17768:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7c683c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:17768:1876039508912384:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789131165.295660:0:20873:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 19 00000020:01000000:0.0:1789131165.295796:0:17768:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 19-18 (rc=0) 10000000:01000000:0.0:1789131165.295837:0:17768:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.111@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789131165.295853:0:17768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.111@tcp lock: ffff91dcc78de800/0xf3fe2838e1fc38fc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc3903 expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131165.295867:0:17768:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.111@tcp lock: ffff91dcc78de800/0xf3fe2838e1fc38fc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3fe2838e1fc3903 expref: -99 pid: 17768 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131165.302908:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789131165.303049:0:17765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498333696 00000100:00100000:1.0:1789131165.303059:0:17765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498333696 00000100:00100000:1.0:1789131165.303111:0:17765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 159 00000100:00100000:1.0:1789131165.303120:0:17765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddfff14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22edf929-4c0f-42f3-973d-fe4d92543efa+12:15162:x1876039498333696:12345-192.168.203.11@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789131165.303404:0:17765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddfff14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22edf929-4c0f-42f3-973d-fe4d92543efa+12:15162:x1876039498333696:12345-192.168.203.11@tcp:501:ll_cfg_requeue.0 Request processed in 284us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131165.303412:0:17765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 159 00000100:00100000:2.0:1789131165.306736:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131165.306892:0:17766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498333824 00000100:00100000:3.0:1789131165.306902:0:17766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498333824 00000100:00100000:3.0:1789131165.306957:0:17766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 160 00000100:00100000:3.0:1789131165.306967:0:17766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddfff14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22edf929-4c0f-42f3-973d-fe4d92543efa+12:15162:x1876039498333824:12345-192.168.203.11@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789131165.307122:0:17766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddfff14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22edf929-4c0f-42f3-973d-fe4d92543efa+12:15162:x1876039498333824:12345-192.168.203.11@tcp:503:ll_cfg_requeue.0 Request processed in 156us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131165.307131:0:17766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 160 00000100:00100000:0.0:1789131165.330268:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789131165.330597:0:17765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498333952 00000100:00100000:1.0:1789131165.330606:0:17765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498333952 00000100:00100000:1.0:1789131165.330719:0:17765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 161 00000100:00100000:1.0:1789131165.330730:0:17765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddfff16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22edf929-4c0f-42f3-973d-fe4d92543efa+12:15162:x1876039498333952:12345-192.168.203.11@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789131165.330747:0:17765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789131165.330763:0:17765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91dcc85ca400/0xf3fe2838e1fc390a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269e2d expref: -99 pid: 17765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131165.330800:0:17765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91dcc85ca400/0xf3fe2838e1fc390a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269e2d expref: 13 pid: 17765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131165.330819:0:17765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91dcc85ca400/0xf3fe2838e1fc390a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269e2d expref: 13 pid: 17765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131165.330829:0:17765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dcc85ca400, rc 0) 00000100:00100000:1.0:1789131165.330887:0:17765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddfff16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22edf929-4c0f-42f3-973d-fe4d92543efa+13:15162:x1876039498333952:12345-192.168.203.11@tcp:101:ll_cfg_requeue.0 Request processed in 158us (628us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131165.330894:0:17765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 161 00000100:00100000:2.0:1789131165.335474:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131165.335641:0:17766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498334080 00000100:00100000:3.0:1789131165.335650:0:17766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498334080 00000100:00100000:3.0:1789131165.335706:0:17766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 162 00000100:00100000:3.0:1789131165.335717:0:17766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddfff16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22edf929-4c0f-42f3-973d-fe4d92543efa+13:15162:x1876039498334080:12345-192.168.203.11@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789131165.335871:0:17766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddfff16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22edf929-4c0f-42f3-973d-fe4d92543efa+13:15162:x1876039498334080:12345-192.168.203.11@tcp:501:ll_cfg_requeue.0 Request processed in 154us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131165.335878:0:17766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 162 00000100:00100000:0.0:1789131165.338449:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131165.338568:0:17765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498334208 00000100:00100000:2.0:1789131165.338577:0:17765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498334208 00000100:00100000:2.0:1789131165.338635:0:17765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 163 00000100:00100000:2.0:1789131165.338644:0:17765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddfff17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22edf929-4c0f-42f3-973d-fe4d92543efa+13:15162:x1876039498334208:12345-192.168.203.11@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789131165.338816:0:17765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddfff17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22edf929-4c0f-42f3-973d-fe4d92543efa+13:15162:x1876039498334208:12345-192.168.203.11@tcp:503:ll_cfg_requeue.0 Request processed in 172us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131165.338824:0:17765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 163 00010000:00010000:0.0:1789131165.713588:0:17759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789131165.778178:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7c683c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508912512:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789131165.778272:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131165.778325:0:17776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508912512 00000100:00100000:2.0:1789131165.778331:0:17776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508912512 00000100:00100000:2.0:1789131165.778376:0:17776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789131165.778383:0:17776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7c6ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508912512:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789131165.778412:0:17776:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1789131165.778448:0:17776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7c6ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508912512:12345-0@lo:41:osp-pre-0-1.0 Request processed in 66us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131165.778478:0:17776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789131165.778512:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7c683c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508912512:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789131165.780008:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789131165.780032:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7c683c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508912640:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789131165.780078:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131165.780113:0:18514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508912640 00000100:00100000:2.0:1789131165.780118:0:18514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508912640 00000100:00100000:2.0:1789131165.780148:0:18514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789131165.780154:0:18514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7c68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1876039508912640:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789131165.780180:0:18514:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789131165.780212:0:18514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7c68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1876039508912640:12345-0@lo:41:osp-pre-1-0.0 Request processed in 58us (134us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131165.780218:0:18514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789131165.780499:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7c683c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508912640:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789131166.741139:0:17760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789131167.103177:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789131167.103346:0:19096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498334336 00000100:00100000:1.0:1789131167.103356:0:19096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498334336 00000100:00100000:1.0:1789131167.103429:0:19096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 23 00000100:00100000:1.0:1789131167.103448:0:19096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff752940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+6:15834:x1876039498334336:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789131167.103481:0:19096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789131167.103502:0:19096:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cac00/0xf3fe2838e1fc3911 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269e34 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131167.103559:0:19096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca600/0xf3fe2838e1fc3918 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131167.103573:0:19096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca600/0xf3fe2838e1fc3918 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131167.103585:0:19096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca600/0xf3fe2838e1fc3918 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131167.103599:0:19096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85caa00/0xf3fe2838e1fc391f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131167.103622:0:19096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85caa00/0xf3fe2838e1fc391f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131167.103629:0:19096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85caa00/0xf3fe2838e1fc391f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131167.103699:0:19096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cbc00/0xf3fe2838e1fc3926 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131167.103708:0:19096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cbc00/0xf3fe2838e1fc3926 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131167.103715:0:19096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cbc00/0xf3fe2838e1fc3926 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789131167.103742:0:19096:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789131167.103746:0:19096:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789131167.103795:0:19096:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cbc00/0xf3fe2838e1fc3926 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131167.103807:0:19096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca600/0xf3fe2838e1fc3918 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131167.103812:0:19096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca600/0xf3fe2838e1fc3918 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131167.103818:0:19096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca600/0xf3fe2838e1fc3918 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131167.103824:0:19096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc85ca600 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:1.0:1789131167.103828:0:19096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca600/0xf3fe2838e1fc3918 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131167.103853:0:19096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca600/0xf3fe2838e1fc3918 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131167.103865:0:19096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91ddc4c81200) 00010000:00010000:1.0:1789131167.103868:0:19096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789131167.103872:0:19096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca600/0xf3fe2838e1fc3918 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131167.103877:0:19096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca600/0xf3fe2838e1fc3918 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131167.103892:0:19096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85caa00/0xf3fe2838e1fc391f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131167.103896:0:19096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85caa00/0xf3fe2838e1fc391f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131167.103901:0:19096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85caa00/0xf3fe2838e1fc391f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131167.103906:0:19096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc85caa00 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:1.0:1789131167.103908:0:19096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85caa00/0xf3fe2838e1fc391f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131167.103914:0:19096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85caa00/0xf3fe2838e1fc391f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131167.103920:0:19096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff91ddf5c12100) 00010000:00010000:1.0:1789131167.103923:0:19096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789131167.103926:0:19096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85caa00/0xf3fe2838e1fc391f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131167.103941:0:19096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85caa00/0xf3fe2838e1fc391f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131167.104423:0:19096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cac00/0xf3fe2838e1fc3911 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269e34 expref: 8 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131167.104438:0:19096:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85cbc00/0xf3fe2838e1fc3926 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269e34 expref: 7 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131167.104456:0:19096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff91ddf5c12400) 00010000:00010000:1.0:1789131167.104497:0:19096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789131167.104500:0:19096:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dcc85cbc00, rc 0) 00000100:00100000:1.0:1789131167.104558:0:19096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff752940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+7:15834:x1876039498334336:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 1119us (1388us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131167.104566:0:19096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 23 00000100:00080000:3.0:1789131167.105278:0:17767:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789131167.109432:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131167.109612:0:17783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498334464 00000100:00100000:2.0:1789131167.109622:0:17783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498334464 00000100:00100000:2.0:1789131167.109715:0:17783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 5 00000100:00100000:2.0:1789131167.109726:0:17783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc12a83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+7:15834:x1876039498334464:12345-192.168.203.11@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1789131167.109806:0:17783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc12a83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+7:15834:x1876039498334464:12345-192.168.203.11@tcp:900:lhsmtool_posix.0 Request processed in 82us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131167.109815:0:17783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 5 00000100:00100000:1.0:1789131167.111584:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131167.111918:0:17771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498334720 00000100:00100000:0.0:1789131167.111927:0:17771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498334720 00000100:00100000:0.0:1789131167.112030:0:17771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 24 00000100:00100000:0.0:1789131167.112039:0:17771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7b7ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+7:15834:x1876039498334720:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789131167.112059:0:17771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789131167.112093:0:17771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7e00/0xf3fe2838e1fc392d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269e3b expref: -99 pid: 17771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131167.112181:0:17771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7a00/0xf3fe2838e1fc3934 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131167.112196:0:17771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7a00/0xf3fe2838e1fc3934 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131167.112208:0:17771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7a00/0xf3fe2838e1fc3934 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131167.112266:0:17771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5e00/0xf3fe2838e1fc393b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131167.112275:0:17771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5e00/0xf3fe2838e1fc393b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131167.112283:0:17771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5e00/0xf3fe2838e1fc393b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131167.112377:0:17771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5800/0xf3fe2838e1fc3942 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131167.112386:0:17771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5800/0xf3fe2838e1fc3942 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131167.112393:0:17771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5800/0xf3fe2838e1fc3942 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789131167.112403:0:17771:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1789131167.112599:0:17771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7a00/0xf3fe2838e1fc3934 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131167.112617:0:17771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7a00/0xf3fe2838e1fc3934 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131167.112624:0:17771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7a00/0xf3fe2838e1fc3934 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131167.112630:0:17771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91de01ad7a00 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:0.0:1789131167.112634:0:17771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7a00/0xf3fe2838e1fc3934 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131167.112642:0:17771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7a00/0xf3fe2838e1fc3934 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131167.112653:0:17771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff91ddf5c12400) 00010000:00010000:0.0:1789131167.112656:0:17771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789131167.112661:0:17771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7a00/0xf3fe2838e1fc3934 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131167.112667:0:17771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7a00/0xf3fe2838e1fc3934 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131167.112681:0:17771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5e00/0xf3fe2838e1fc393b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131167.112687:0:17771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5e00/0xf3fe2838e1fc393b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131167.112694:0:17771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5e00/0xf3fe2838e1fc393b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131167.112699:0:17771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddfd0b5e00 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:0.0:1789131167.112707:0:17771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5e00/0xf3fe2838e1fc393b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131167.112713:0:17771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5e00/0xf3fe2838e1fc393b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131167.112720:0:17771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff91ddc4c81f00) 00010000:00010000:0.0:1789131167.112723:0:17771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789131167.112725:0:17771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5e00/0xf3fe2838e1fc393b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131167.112730:0:17771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5e00/0xf3fe2838e1fc393b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131167.116560:0:17771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7e00/0xf3fe2838e1fc392d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269e3b expref: 10 pid: 17771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131167.116587:0:17771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5800/0xf3fe2838e1fc3942 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269e3b expref: 9 pid: 17771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131167.116596:0:17771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff91ddc4c81700) 00010000:00010000:0.0:1789131167.116600:0:17771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789131167.116603:0:17771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ddfd0b5800, rc 0) 00000100:00100000:0.0:1789131167.116674:0:17771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7b7ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+9:15834:x1876039498334720:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 4636us (5097us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1789131167.116683:0:17771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 24 00000100:00100000:0.0:1789131167.121860:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131167.121995:0:17773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498334848 00000100:00100000:2.0:1789131167.122007:0:17773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498334848 00000100:00100000:2.0:1789131167.122062:0:17773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 25 00000100:00100000:2.0:1789131167.122071:0:17773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff753c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+9:15834:x1876039498334848:12345-192.168.203.11@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1789131167.122299:0:17773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff753c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+9:15834:x1876039498334848:12345-192.168.203.11@tcp:59:lhsmtool_posix.0 Request processed in 228us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131167.122309:0:17773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 25 00000100:00100000:3.0:1789131167.122806:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789131167.123357:0:19096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498334976 00000100:00100000:1.0:1789131167.123366:0:19096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498334976 00000100:00100000:1.0:1789131167.123413:0:19096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 26 00000100:00100000:1.0:1789131167.123422:0:19096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc12ab840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+9:15840:x1876039498334976:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:1.0:1789131167.123436:0:19096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789131167.123455:0:19096:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dde19aa400/0xf3fe2838e1fc3950 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269e42 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131167.123539:0:19096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dde19ab600/0xf3fe2838e1fc3957 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131167.123565:0:19096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dde19ab600/0xf3fe2838e1fc3957 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131167.123576:0:19096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dde19ab600/0xf3fe2838e1fc3957 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131167.123590:0:19096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dde19aaa00/0xf3fe2838e1fc395e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131167.123596:0:19096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dde19aaa00/0xf3fe2838e1fc395e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131167.123602:0:19096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dde19aaa00/0xf3fe2838e1fc395e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131167.123639:0:19096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dde19ab600/0xf3fe2838e1fc3957 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131167.123646:0:19096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dde19ab600/0xf3fe2838e1fc3957 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131167.123652:0:19096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91dde19ab600/0xf3fe2838e1fc3957 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131167.123658:0:19096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dde19ab600 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:1.0:1789131167.123661:0:19096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dde19ab600/0xf3fe2838e1fc3957 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131167.123668:0:19096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dde19ab600/0xf3fe2838e1fc3957 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131167.123679:0:19096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91ddc4c81200) 00010000:00010000:1.0:1789131167.123688:0:19096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789131167.123693:0:19096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91dde19ab600/0xf3fe2838e1fc3957 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131167.123700:0:19096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dde19ab600/0xf3fe2838e1fc3957 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131167.123714:0:19096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dde19aaa00/0xf3fe2838e1fc395e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131167.123719:0:19096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dde19aaa00/0xf3fe2838e1fc395e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131167.123725:0:19096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91dde19aaa00/0xf3fe2838e1fc395e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131167.123729:0:19096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dde19aaa00 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:1.0:1789131167.123732:0:19096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dde19aaa00/0xf3fe2838e1fc395e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131167.123738:0:19096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dde19aaa00/0xf3fe2838e1fc395e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131167.123746:0:19096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff91ddf5c12100) 00010000:00010000:1.0:1789131167.123748:0:19096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789131167.123751:0:19096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91dde19aaa00/0xf3fe2838e1fc395e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131167.123758:0:19096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dde19aaa00/0xf3fe2838e1fc395e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131167.123798:0:19096:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91dde19aa400/0xf3fe2838e1fc3950 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269e42 expref: 10 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131167.123814:0:19096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91ddc4c81200) 00010000:00010000:1.0:1789131167.123817:0:19096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789131167.123821:0:19096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dde19aa400/0xf3fe2838e1fc3950 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269e42 expref: 10 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131167.123830:0:19096:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dde19aa400, rc 0) 00000100:00100000:3.0:1789131167.124520:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131167.124548:0:17773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498335104 00000100:00100000:3.0:1789131167.124554:0:17773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498335104 00000100:00100000:3.0:1789131167.124593:0:17773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 27 00000100:00100000:3.0:1789131167.124601:0:17773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc12aad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+5:15834:x1876039498335104:12345-192.168.203.11@tcp:59:lhsmtool_posix.0 00000100:00080000:3.0:1789131167.124644:0:17767:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:3.0:1789131167.125339:0:17773:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 711us 00000100:00100000:1.0:1789131167.126120:0:19096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc12ab840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+9:15840:x1876039498334976:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 2695us (3318us total) trans 0 rc 301/301 00000100:00100000:1.0:1789131167.126129:0:19096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 26 00000100:00100000:2.0:1789131167.139436:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131167.145032:0:17780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498335232 00000100:00100000:3.0:1789131167.145049:0:17780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498335232 00000100:00100000:3.0:1789131167.145115:0:17780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 0 00000100:00100000:3.0:1789131167.145126:0:17780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7c683c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+9:15840:x1876039498335232:12345-192.168.203.11@tcp:700:lfs.0 00000100:00100000:2.0:1789131167.150961:0:17780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7c683c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+9:15840:x1876039498335232:12345-192.168.203.11@tcp:700:lfs.0 Request processed in 5820us (11520us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131167.150980:0:17780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 0 00000100:00100000:2.0:1789131167.158186:0:17773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc12aad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+5:15834:x1876039498335104:12345-192.168.203.11@tcp:59:lhsmtool_posix.0 Request processed in 33576us (33659us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131167.158198:0:17773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 27 00000100:00100000:0.0:1789131167.163284:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131167.163411:0:17771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498335488 00000100:00100000:3.0:1789131167.163420:0:17771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498335488 00000100:00100000:3.0:1789131167.163500:0:17771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 28 00000100:00100000:3.0:1789131167.163510:0:17771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff752580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+9:15840:x1876039498335488:12345-192.168.203.11@tcp:36:lfs.0 00010000:00010000:3.0:1789131167.163565:0:17771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789131167.163592:0:17771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc387e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269daf expref: 9 pid: 17771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131167.163612:0:17771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91ddc4c81200) 00010000:00010000:3.0:1789131167.163616:0:17771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789131167.163670:0:17771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0031e00/0xf3fe2838e1fc3965 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131167.163697:0:17771:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca800/0xf3fe2838e1fc38bd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269e1f expref: 5 pid: 17771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131167.163705:0:17771:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0031e00/0xf3fe2838e1fc3965 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131167.163733:0:17771:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca800/0xf3fe2838e1fc38bd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269e1f expref: 5 pid: 17771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131167.163744:0:17771:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca800/0xf3fe2838e1fc38bd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269e1f expref: 5 pid: 17771 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131167.163757:0:17771:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddc12aa940 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17771:1876039508912768:192.168.203.11@tcp:104: 00000100:00100000:3.0:1789131167.163960:0:17771:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddc32b1b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789131167.171228:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131167.171307:0:17771:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddc12aa940 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17771:1876039508912768:192.168.203.11@tcp:104: 00010000:00010000:3.0:1789131167.171347:0:17771:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0031e00/0xf3fe2838e1fc3965 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131167.171510:0:17757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498335616 00000100:00100000:0.0:1789131167.171530:0:17757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498335616 00010000:00010000:0.0:1789131167.171581:0:17757:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca800/0xf3fe2838e1fc38bd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269e1f expref: 6 pid: 17771 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789131167.171613:0:17767:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789131167.171627:0:17757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 15 00000100:00100000:0.0:1789131167.171639:0:17757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7c6b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:014f7d38-34be-4f2e-b715-3fbda0147a70+6:2388:x1876039498335616:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789131167.171652:0:17757:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789131167.171659:0:17757:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca800/0xf3fe2838e1fc38bd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269e1f expref: 6 pid: 17771 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131167.171672:0:17757:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca800/0xf3fe2838e1fc38bd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269e1f expref: 6 pid: 17771 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131167.171693:0:17757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc85ca800/0xf3fe2838e1fc38bd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269e1f expref: 6 pid: 17771 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131167.171711:0:17757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91ddc4c81200) 00010000:00010000:0.0:1789131167.171716:0:17757:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0031e00/0xf3fe2838e1fc3965 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131167.171725:0:17757:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0031e00/0xf3fe2838e1fc3965 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131167.171733:0:17757:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0031e00/0xf3fe2838e1fc3965 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131167.171759:0:17757:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789131167.171798:0:17771:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0031e00/0xf3fe2838e1fc3965 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131167.171821:0:17757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7c6b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:014f7d38-34be-4f2e-b715-3fbda0147a70+5:2388:x1876039498335616:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 182us (601us total) trans 0 rc 0/0 00010000:00010000:3.0:1789131167.171822:0:17771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0031e00/0xf3fe2838e1fc3965 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131167.171855:0:17757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 15 00010000:00010000:3.0:1789131167.171868:0:17771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0031200/0xf3fe2838e1fc396c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131167.171901:0:17771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0031200/0xf3fe2838e1fc396c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131167.171914:0:17771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0031200/0xf3fe2838e1fc396c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131167.177165:0:17771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78df000/0xf3fe2838e1fc3973 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131167.177187:0:17771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78df000/0xf3fe2838e1fc3973 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131167.177200:0:17771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78df000/0xf3fe2838e1fc3973 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789131167.177217:0:17771:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000001c1fdc29 reply state 0000000014492a01 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78df000/0xf3fe2838e1fc3973 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131167.177227:0:17771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78df000/0xf3fe2838e1fc3973 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131167.177235:0:17771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff91dcc7d6cd00) 00010000:00010000:2.0:1789131167.177617:0:17771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789131167.177621:0:17771:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789131167.177627:0:17771:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1789131167.177636:0:17771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0031e00/0xf3fe2838e1fc3965 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131167.177643:0:17771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0031e00/0xf3fe2838e1fc3965 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131167.177656:0:17771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0031e00/0xf3fe2838e1fc3965 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131167.177662:0:17771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddc0031e00 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:2.0:1789131167.177666:0:17771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0031e00/0xf3fe2838e1fc3965 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131167.177673:0:17771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0031e00/0xf3fe2838e1fc3965 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131167.177685:0:17771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91ddc4c81200) 00010000:00010000:2.0:1789131167.177687:0:17771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789131167.177691:0:17771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0031e00/0xf3fe2838e1fc3965 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131167.177697:0:17771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0031e00/0xf3fe2838e1fc3965 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789131167.177716:0:17771:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000001c1fdc29 reply state 0000000014492a01 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0031200/0xf3fe2838e1fc396c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131167.177725:0:17771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0031200/0xf3fe2838e1fc396c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131167.177730:0:17771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff91dcc6c0f700) 00010000:00010000:2.0:1789131167.177732:0:17771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789131167.177734:0:17771:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1789131167.177919:0:17771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff752580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+10:15840:x1876039498335488:12345-192.168.203.11@tcp:36:lfs.0 Request processed in 14406us (14641us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1789131167.177928:0:17771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 28 00000100:00100000:2.0:1789131167.283028:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789131167.284505:0:17772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498335744 00000100:00100000:1.0:1789131167.284519:0:17772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498335744 00000100:00100000:1.0:1789131167.284595:0:17772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 29 00000100:00100000:1.0:1789131167.284606:0:17772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7c68b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+10:15848:x1876039498335744:12345-192.168.203.11@tcp:101:lctl.0 00010000:00010000:1.0:1789131167.284632:0:17772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789131167.284656:0:17772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dde19aa400/0xf3fe2838e1fc397a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269e49 expref: -99 pid: 17772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131167.284719:0:17772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dde19aaa00/0xf3fe2838e1fc3981 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131167.284732:0:17772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dde19aaa00/0xf3fe2838e1fc3981 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131167.284742:0:17772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dde19aaa00/0xf3fe2838e1fc3981 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789131167.284793:0:17772:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789131167.284809:0:17772:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789131167.284857:0:17772:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91dde19aaa00/0xf3fe2838e1fc3981 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131167.284881:0:17772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dde19aa400/0xf3fe2838e1fc397a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269e49 expref: 12 pid: 17772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131167.284898:0:17772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91dde19aaa00/0xf3fe2838e1fc3981 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269e49 expref: 11 pid: 17772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131167.284907:0:17772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91ddf5c12100) 00010000:00010000:1.0:1789131167.284909:0:17772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789131167.284912:0:17772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dde19aaa00, rc 0) 00000100:00100000:1.0:1789131167.284989:0:17772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7c68b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+11:15848:x1876039498335744:12345-192.168.203.11@tcp:101:lctl.0 Request processed in 384us (1969us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131167.284996:0:17772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 29 00000100:00100000:0.0:1789131167.315071:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff750780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508913280:0@lo:400:kworker.0 00000100:00100000:3.0:1789131167.315076:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff7530c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:3627:1876039508912896:0@lo:400:kworker.0 00000100:00100000:1.0:1789131167.315151:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff751680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1876039508913024:0@lo:400:kworker.0 00000100:00100000:2.0:1789131167.315288:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff7512c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508913152:0@lo:400:kworker.0 00000100:00100000:3.0:1789131167.320148:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131167.320209:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff753480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3627:1876039508913408:0@lo:400:kworker.0 00000100:00100000:3.0:1789131167.322521:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131167.322576:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc8608f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3627:1876039508913920:0@lo:400:kworker.0 00000100:00100000:3.0:1789131167.322620:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131167.322643:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd1dfa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3627:1876039508914432:0@lo:400:kworker.0 00000100:00100000:3.0:1789131167.322664:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131167.322692:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789131167.322699:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7c68f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1876039508914560:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789131167.322722:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131167.322762:0:17766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508912896 00000100:00100000:3.0:1789131167.322782:0:17766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508912896 00000100:00100000:3.0:1789131167.322828:0:17766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1789131167.323154:0:17766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddfff15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+24:3627:x1876039508912896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789131167.324224:0:17766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddfff15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+24:3627:x1876039508912896:12345-0@lo:400:kworker.0 Request processed in 1069us (4079us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131167.324510:0:17766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1789131167.324566:0:19287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508914560 00000100:00100000:3.0:1789131167.324581:0:19287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508914560 00000100:00100000:3.0:1789131167.324625:0:19287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789131167.324632:0:19287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc12ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1876039508914560:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789131167.324657:0:19287:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:3.0:1789131167.324700:0:19287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc12ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1876039508914560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (1976us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131167.324706:0:19287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:3.0:1789131167.324725:0:17767:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789131167.324762:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7c68f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1876039508914560:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789131167.324786:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff7530c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:3627:1876039508912896:0@lo:400:kworker.0 00000100:00100000:3.0:1789131167.324817:0:17772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508913408 00000100:00100000:3.0:1789131167.324821:0:17772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508913408 00000100:00100000:3.0:1789131167.325046:0:17772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508913920 00000100:00100000:3.0:1789131167.325050:0:17772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508913920 00000100:00100000:3.0:1789131167.325067:0:17772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508914432 00000100:00100000:3.0:1789131167.325070:0:17772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508914432 00000100:00100000:3.0:1789131167.325092:0:17772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789131167.325099:0:17772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc12aa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1876039508913408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789131167.325141:0:17772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc12aa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1876039508913408:12345-0@lo:400:kworker.0 Request processed in 42us (2625us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131167.325147:0:17772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789131167.325160:0:17772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789131167.325165:0:17772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc12a92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1876039508913920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789131167.325193:0:17772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc12a92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1876039508913920:12345-0@lo:400:kworker.0 Request processed in 27us (2583us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131167.325198:0:17772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789131167.325209:0:17772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789131167.325223:0:17772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc12abc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3627:x1876039508914432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789131167.325613:0:17772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc12abc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3627:x1876039508914432:12345-0@lo:400:kworker.0 Request processed in 390us (2946us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131167.325621:0:17772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:3.0:1789131167.325641:0:17767:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789131167.325667:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff753480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3627:1876039508913408:0@lo:400:kworker.0 00000100:00100000:3.0:1789131167.325679:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc8608f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3627:1876039508913920:0@lo:400:kworker.0 00010000:00080000:3.0:1789131167.325690:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91ddd1dfa1c0 x1876039508914432/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789131183 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789131167.325700:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd1dfa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3627:1876039508914432:0@lo:400:kworker.0 00000100:00100000:3.0:1789131167.326384:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131167.326413:0:17772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498335872 00000100:00100000:3.0:1789131167.326418:0:17772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498335872 00000100:00100000:1.0:1789131167.326444:0:19096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 30 00000100:00100000:1.0:1789131167.326454:0:19096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8608f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:014f7d38-34be-4f2e-b715-3fbda0147a70+5:15849:x1876039498335872:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:1.0:1789131167.326478:0:19096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789131167.326498:0:19096:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dde19aa400/0xf3fe2838e1fc3988 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269e50 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131167.326553:0:19096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dde19ab600/0xf3fe2838e1fc398f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131167.326566:0:19096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dde19ab600/0xf3fe2838e1fc398f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131167.326592:0:19096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dde19ab600/0xf3fe2838e1fc398f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789131167.326632:0:19096:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789131167.326636:0:19096:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789131167.326655:0:19096:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91dde19ab600/0xf3fe2838e1fc398f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131167.326679:0:19096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dde19aa400/0xf3fe2838e1fc3988 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269e50 expref: 7 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131167.326696:0:19096:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91dde19ab600/0xf3fe2838e1fc398f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269e50 expref: 6 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131167.326704:0:19096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91ddf5c12100) 00010000:00010000:1.0:1789131167.326706:0:19096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789131167.326710:0:19096:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dde19ab600, rc 0) 00000100:00100000:1.0:1789131167.326764:0:19096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8608f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:014f7d38-34be-4f2e-b715-3fbda0147a70+6:15849:x1876039498335872:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 311us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131167.326780:0:19096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 30 00000100:00100000:1.0:1789131167.326827:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131167.326857:0:18514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508913024 00000100:00100000:1.0:1789131167.326860:0:18514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508913024 00000100:00100000:1.0:1789131167.326893:0:18514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789131167.326900:0:18514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7b7bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3628:x1876039508913024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789131167.326934:0:18514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7b7bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3628:x1876039508913024:12345-0@lo:400:kworker.0 Request processed in 34us (106us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131167.326940:0:18514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789131167.326981:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff751680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1876039508913024:0@lo:400:kworker.0 00000100:00100000:1.0:1789131167.326991:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff750000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1876039508913536:0@lo:400:kworker.0 00000100:00100000:1.0:1789131167.327017:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131167.327038:0:17777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508913536 00000100:00100000:1.0:1789131167.327041:0:17777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508913536 00000100:00100000:1.0:1789131167.327061:0:17777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789131167.327067:0:17777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7b7a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3628:x1876039508913536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789131167.327098:0:17777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7b7a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3628:x1876039508913536:12345-0@lo:400:kworker.0 Request processed in 31us (80us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131167.327103:0:17777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789131167.327126:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff750000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1876039508913536:0@lo:400:kworker.0 00000100:00100000:1.0:1789131167.327133:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc860bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3628:1876039508914048:0@lo:400:kworker.0 00000100:00100000:1.0:1789131167.327156:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131167.327176:0:17771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508914048 00000100:00100000:1.0:1789131167.327180:0:17771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508914048 00000100:00100000:1.0:1789131167.327212:0:17771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789131167.327218:0:17771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7b78f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3628:x1876039508914048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789131167.327247:0:17771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7b78f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3628:x1876039508914048:12345-0@lo:400:kworker.0 Request processed in 29us (91us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131167.327253:0:17771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:1.0:1789131167.327267:0:17767:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789131167.327286:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc860bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3628:1876039508914048:0@lo:400:kworker.0 00000100:00100000:0.0:1789131167.331080:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131167.331191:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff752d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1876039508913792:0@lo:400:kworker.0 00000100:00100000:0.0:1789131167.331237:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131167.338381:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131167.338504:0:17773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498336000 00000100:00100000:3.0:1789131167.338513:0:17773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498336000 00000100:00100000:3.0:1789131167.338571:0:17773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 31 00000100:00100000:3.0:1789131167.338581:0:17773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7c68f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:014f7d38-34be-4f2e-b715-3fbda0147a70+6:15849:x1876039498336000:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:3.0:1789131167.338600:0:17773:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789131167.338619:0:17773:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030c00/0xf3fe2838e1fc3996 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269e57 expref: -99 pid: 17773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131167.338676:0:17773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0031600/0xf3fe2838e1fc399d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131167.338689:0:17773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0031600/0xf3fe2838e1fc399d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131167.338716:0:17773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0031600/0xf3fe2838e1fc399d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131167.338727:0:17773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030000/0xf3fe2838e1fc39a4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131167.338734:0:17773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030000/0xf3fe2838e1fc39a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131167.338740:0:17773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030000/0xf3fe2838e1fc39a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131167.338820:0:17773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030e00/0xf3fe2838e1fc39ab lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131167.338839:0:17773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030e00/0xf3fe2838e1fc39ab lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131167.338848:0:17773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030e00/0xf3fe2838e1fc39ab lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17773 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789131167.338884:0:17773:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789131167.338887:0:17773:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789131167.338909:0:17773:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030e00/0xf3fe2838e1fc39ab lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131167.338920:0:17773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0031600/0xf3fe2838e1fc399d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131167.338926:0:17773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0031600/0xf3fe2838e1fc399d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131167.338941:0:17773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0031600/0xf3fe2838e1fc399d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131167.338948:0:17773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddc0031600 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:3.0:1789131167.338952:0:17773:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0031600/0xf3fe2838e1fc399d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131167.339108:0:17773:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0031600/0xf3fe2838e1fc399d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131167.339123:0:17773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91ddf5c12100) 00010000:00010000:3.0:1789131167.339127:0:17773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789131167.339132:0:17773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0031600/0xf3fe2838e1fc399d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131167.341501:0:17773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0031600/0xf3fe2838e1fc399d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131167.341541:0:17773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030000/0xf3fe2838e1fc39a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131167.341549:0:17773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030000/0xf3fe2838e1fc39a4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131167.341556:0:17773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030000/0xf3fe2838e1fc39a4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131167.341561:0:17773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddc0030000 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:3.0:1789131167.341565:0:17773:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030000/0xf3fe2838e1fc39a4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131167.341593:0:17773:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030000/0xf3fe2838e1fc39a4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131167.341608:0:17773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff91dcc6c0f700) 00010000:00010000:3.0:1789131167.341611:0:17773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789131167.341616:0:17773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030000/0xf3fe2838e1fc39a4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131167.341622:0:17773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030000/0xf3fe2838e1fc39a4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131167.341665:0:17773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030c00/0xf3fe2838e1fc3996 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269e57 expref: 8 pid: 17773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131167.341681:0:17773:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030e00/0xf3fe2838e1fc39ab lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269e57 expref: 7 pid: 17773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131167.341690:0:17773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff91dcc7d6cd00) 00010000:00010000:3.0:1789131167.341692:0:17773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789131167.341694:0:17773:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ddc0030e00, rc 0) 00000100:00100000:3.0:1789131167.341780:0:17773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7c68f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:014f7d38-34be-4f2e-b715-3fbda0147a70+7:15849:x1876039498336000:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 3187us (3394us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131167.341790:0:17773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 31 00000100:00100000:0.0:1789131167.344213:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dde0b80f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3626:1876039508914304:0@lo:400:kworker.0 00000100:00100000:0.0:1789131167.344285:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131167.344316:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddc12aa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1876039508914816:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789131167.344343:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131167.344373:0:19287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508914816 00000100:00100000:0.0:1789131167.344380:0:19287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508914816 00000100:00100000:0.0:1789131167.344432:0:19287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789131167.344583:0:19287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd1dfb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1876039508914816:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789131167.344606:0:19287:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:0.0:1789131167.344646:0:19287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd1dfb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1876039508914816:12345-0@lo:13:osp-pre-1-1.0 Request processed in 67us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131167.344653:0:19287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:0.0:1789131167.344674:0:17767:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789131167.344705:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddc12aa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1876039508914816:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789131167.344723:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789131167.344729:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddc12a8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508914688:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789131167.344751:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131167.344786:0:19287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508914688 00000100:00100000:0.0:1789131167.344790:0:19287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508914688 00000100:00100000:0.0:1789131167.344815:0:19287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00080000:3.0:1789131167.345596:0:17767:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789131167.345628:0:17771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508914304 00000100:00100000:3.0:1789131167.345635:0:17771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508914304 00000100:00100000:3.0:1789131167.345682:0:17771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789131167.345690:0:17771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd1df8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1876039508914304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789131167.345753:0:17771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd1df8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1876039508914304:12345-0@lo:400:kworker.0 Request processed in 64us (1467us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131167.345760:0:17771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:3.0:1789131167.345790:0:17767:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789131167.345818:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dde0b80f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3626:1876039508914304:0@lo:400:kworker.0 00000100:00100000:0.0:1789131167.346102:0:19287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd1dfbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508914688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789131167.346124:0:19287:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1789131167.346158:0:19287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd1dfbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508914688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1324us (1406us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131167.346165:0:19287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789131167.347134:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddc12a8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508914688:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789131167.350365:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131167.350732:0:17783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498336128 00000100:00100000:0.0:1789131167.350741:0:17783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498336128 00000100:00100000:0.0:1789131167.350818:0:17783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 6 00000100:00100000:0.0:1789131167.350839:0:17783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc860bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:014f7d38-34be-4f2e-b715-3fbda0147a70+5:15849:x1876039498336128:12345-192.168.203.11@tcp:900:lfs.0 00000100:00100000:0.0:1789131167.350914:0:17783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc860bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:014f7d38-34be-4f2e-b715-3fbda0147a70+5:15849:x1876039498336128:12345-192.168.203.11@tcp:900:lfs.0 Request processed in 88us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131167.350921:0:17783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 6 00000100:00080000:3.0:1789131167.351072:0:17767:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789131167.351672:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131167.352576:0:19283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508913280 00000100:00100000:1.0:1789131167.352586:0:19283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508913280 00000100:00100000:1.0:1789131167.352634:0:19283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508913792 00000100:00100000:1.0:1789131167.352637:0:19283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508913792 00000100:00100000:1.0:1789131167.352680:0:19283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789131167.352687:0:19283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd1df9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508913280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789131167.352760:0:19283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd1df9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508913280:12345-0@lo:400:kworker.0 Request processed in 74us (21689us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131167.352767:0:19283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789131167.352794:0:19283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789131167.352800:0:19283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd1dfad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1876039508913792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789131167.352828:0:19283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd1dfad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1876039508913792:12345-0@lo:400:kworker.0 Request processed in 29us (21591us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131167.353011:0:19283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789131167.353062:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff750780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508913280:0@lo:400:kworker.0 00000100:00100000:1.0:1789131167.353073:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff752d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1876039508913792:0@lo:400:kworker.0 00000100:00100000:3.0:1789131167.360937:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff750f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508913664:0@lo:400:kworker.0 00000100:00100000:3.0:1789131167.361007:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131167.361043:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dde0b81680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3625:1876039508914176:0@lo:400:kworker.0 00000100:00100000:3.0:1789131167.361068:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131167.361097:0:17773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508914176 00000100:00100000:3.0:1789131167.361105:0:17773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508914176 00000100:00100000:3.0:1789131167.361163:0:17773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789131167.361171:0:17773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff750780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1876039508914176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789131167.361218:0:17773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff750780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1876039508914176:12345-0@lo:400:kworker.0 Request processed in 47us (149us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131167.361225:0:17773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:3.0:1789131167.361245:0:17767:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1789131167.361268:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dde0b81680 x1876039508914176/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789131183 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789131167.361283:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dde0b81680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3625:1876039508914176:0@lo:400:kworker.0 00000100:00100000:2.0:1789131167.361299:0:19283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508913152 00000100:00100000:2.0:1789131167.361306:0:19283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508913152 00000100:00100000:2.0:1789131167.361339:0:19283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508913664 00000100:00100000:2.0:1789131167.361342:0:19283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508913664 00000100:00100000:2.0:1789131167.361382:0:19283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789131167.361390:0:19283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dde0b80f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1876039508913152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131167.361430:0:19283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dde0b80f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1876039508913152:12345-0@lo:400:kworker.0 Request processed in 41us (9758us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131167.361436:0:19283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789131167.361449:0:19283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789131167.361455:0:19283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff752d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508913664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131167.361500:0:19283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff752d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508913664:12345-0@lo:400:kworker.0 Request processed in 46us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131167.361507:0:19283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789131167.361541:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff7512c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1876039508913152:0@lo:400:kworker.0 00000100:00100000:2.0:1789131167.361551:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff750f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508913664:0@lo:400:kworker.0 00000100:00080000:3.0:1789131167.361613:0:17767:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789131167.366042:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789131167.366148:0:17771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498336384 00000100:00100000:1.0:1789131167.366157:0:17771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498336384 00000100:00100000:1.0:1789131167.366217:0:17771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 32 00000100:00100000:1.0:1789131167.366228:0:17771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff750000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:014f7d38-34be-4f2e-b715-3fbda0147a70+7:15849:x1876039498336384:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:1.0:1789131167.366247:0:17771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789131167.366275:0:17771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dde19aa400/0xf3fe2838e1fc39b2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269e5e expref: -99 pid: 17771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789131167.366366:0:17771:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1789131167.366511:0:17771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91dde19aa400/0xf3fe2838e1fc39b2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269e5e expref: 9 pid: 17771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131167.366526:0:17771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91ddf5c12100) 00010000:00010000:1.0:1789131167.366529:0:17771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789131167.366547:0:17771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dde19aa400/0xf3fe2838e1fc39b2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269e5e expref: 9 pid: 17771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131167.366561:0:17771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dde19aa400, rc 0) 00000100:00100000:1.0:1789131167.366618:0:17771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff750000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:014f7d38-34be-4f2e-b715-3fbda0147a70+8:15849:x1876039498336384:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 392us (586us total) trans 8589934595 rc 301/301 00000100:00100000:1.0:1789131167.366627:0:17771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 32 00000100:00100000:0.0:1789131167.370079:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131167.370159:0:17773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498336640 00000100:00100000:3.0:1789131167.370169:0:17773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498336640 00000100:00100000:3.0:1789131167.370223:0:17773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 33 00000100:00100000:3.0:1789131167.370244:0:17773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd1df83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:014f7d38-34be-4f2e-b715-3fbda0147a70+8:15849:x1876039498336640:12345-192.168.203.11@tcp:36:lfs.0 00010000:00010000:3.0:1789131167.370294:0:17773:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789131167.370319:0:17773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030e00/0xf3fe2838e1fc39ab lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269e57 expref: 8 pid: 17773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131167.370338:0:17773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff91dcc7d6cd00) 00010000:00010000:3.0:1789131167.370343:0:17773:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789131167.370362:0:17773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030c00/0xf3fe2838e1fc39c0 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131167.370374:0:17773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030c00/0xf3fe2838e1fc39c0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131167.370383:0:17773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030c00/0xf3fe2838e1fc39c0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17773 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789131167.370597:0:17773:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000af003d29 reply state 00000000be725901 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030c00/0xf3fe2838e1fc39c0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131167.370610:0:17773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030c00/0xf3fe2838e1fc39c0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131167.370616:0:17773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff91dcc7d6cd00) 00010000:00010000:3.0:1789131167.370619:0:17773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:3.0:1789131167.370621:0:17773:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789131167.370627:0:17773:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1789131167.370704:0:17773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd1df83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:014f7d38-34be-4f2e-b715-3fbda0147a70+9:15849:x1876039498336640:12345-192.168.203.11@tcp:36:lfs.0 Request processed in 472us (633us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1789131167.370724:0:17773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 33 00000100:00100000:3.0:1789131167.374714:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789131167.374819:0:17774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498336896 00000100:00100000:1.0:1789131167.374828:0:17774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498336896 00000100:00100000:1.0:1789131167.374882:0:17774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2 00000100:00100000:1.0:1789131167.374892:0:17774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff751680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:014f7d38-34be-4f2e-b715-3fbda0147a70+9:15849:x1876039498336896:12345-192.168.203.11@tcp:35:lfs.0 00000100:00100000:1.0:1789131167.375121:0:17774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff751680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:014f7d38-34be-4f2e-b715-3fbda0147a70+10:15849:x1876039498336896:12345-192.168.203.11@tcp:35:lfs.0 Request processed in 230us (414us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1789131167.375129:0:17774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2 00000100:00100000:0.0:1789131167.385424:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789131167.385659:0:17771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498337152 00000100:00100000:1.0:1789131167.385669:0:17771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498337152 00000100:00100000:1.0:1789131167.385726:0:17771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 34 00000100:00100000:1.0:1789131167.385736:0:17771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd1df92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:014f7d38-34be-4f2e-b715-3fbda0147a70+10:15849:x1876039498337152:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:1.0:1789131167.385760:0:17771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789131167.385793:0:17771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dde19aa400/0xf3fe2838e1fc39c7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269e65 expref: -99 pid: 17771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131167.385864:0:17771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dde19ab800/0xf3fe2838e1fc39ce lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131167.385877:0:17771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dde19ab800/0xf3fe2838e1fc39ce lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131167.385906:0:17771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dde19ab800/0xf3fe2838e1fc39ce lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131167.385917:0:17771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dde19aac00/0xf3fe2838e1fc39d5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131167.385925:0:17771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dde19aac00/0xf3fe2838e1fc39d5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131167.385931:0:17771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dde19aac00/0xf3fe2838e1fc39d5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789131167.386048:0:17771:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1789131167.386117:0:17771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dde19ab800/0xf3fe2838e1fc39ce lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131167.386124:0:17771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dde19ab800/0xf3fe2838e1fc39ce lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131167.386130:0:17771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91dde19ab800/0xf3fe2838e1fc39ce lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131167.386136:0:17771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dde19ab800 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:1.0:1789131167.386140:0:17771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dde19ab800/0xf3fe2838e1fc39ce lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131167.386147:0:17771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dde19ab800/0xf3fe2838e1fc39ce lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131167.386158:0:17771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91ddf5c12100) 00010000:00010000:1.0:1789131167.386162:0:17771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789131167.386173:0:17771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91dde19ab800/0xf3fe2838e1fc39ce lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131167.386179:0:17771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dde19ab800/0xf3fe2838e1fc39ce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131167.386193:0:17771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dde19aac00/0xf3fe2838e1fc39d5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131167.386199:0:17771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dde19aac00/0xf3fe2838e1fc39d5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131167.386205:0:17771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91dde19aac00/0xf3fe2838e1fc39d5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131167.386211:0:17771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dde19aac00 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:1.0:1789131167.386214:0:17771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dde19aac00/0xf3fe2838e1fc39d5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131167.386220:0:17771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dde19aac00/0xf3fe2838e1fc39d5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131167.386228:0:17771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff91dcc6c0f700) 00010000:00010000:1.0:1789131167.386231:0:17771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789131167.386584:0:17771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91dde19aac00/0xf3fe2838e1fc39d5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131167.386593:0:17771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dde19aac00/0xf3fe2838e1fc39d5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131167.386631:0:17771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91dde19aa400/0xf3fe2838e1fc39c7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269e65 expref: 12 pid: 17771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131167.386653:0:17771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91ddf5c12100) 00010000:00010000:1.0:1789131167.386655:0:17771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789131167.386660:0:17771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dde19aa400/0xf3fe2838e1fc39c7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269e65 expref: 12 pid: 17771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131167.386671:0:17771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dde19aa400, rc 0) 00000100:00100000:1.0:1789131167.386788:0:17771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd1df92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:014f7d38-34be-4f2e-b715-3fbda0147a70+11:15849:x1876039498337152:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 1052us (1371us total) trans 8589934598 rc 301/301 00000100:00100000:1.0:1789131167.386796:0:17771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 34 00000100:00100000:0.0:1789131167.395028:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131167.395160:0:19096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498337280 00000100:00100000:2.0:1789131167.395169:0:19096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498337280 00000100:00100000:2.0:1789131167.395226:0:19096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 35 00000100:00100000:2.0:1789131167.395353:0:19096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd1dfa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:014f7d38-34be-4f2e-b715-3fbda0147a70+11:15849:x1876039498337280:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:2.0:1789131167.395378:0:19096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789131167.395398:0:19096:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78dec00/0xf3fe2838e1fc39e3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269e6c expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131167.395621:0:19096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78de600/0xf3fe2838e1fc39ea lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131167.395635:0:19096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78de600/0xf3fe2838e1fc39ea lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131167.395646:0:19096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78de600/0xf3fe2838e1fc39ea lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789131167.395669:0:19096:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789131167.395673:0:19096:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789131167.395765:0:19096:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78de600/0xf3fe2838e1fc39ea lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131167.395801:0:19096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78dec00/0xf3fe2838e1fc39e3 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269e6c expref: 13 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131167.395817:0:19096:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78de600/0xf3fe2838e1fc39ea lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269e6c expref: 12 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131167.395825:0:19096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff91dcc7d6cd00) 00010000:00010000:2.0:1789131167.395828:0:19096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789131167.395831:0:19096:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dcc78de600, rc 0) 00000100:00100000:2.0:1789131167.395973:0:19096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd1dfa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:014f7d38-34be-4f2e-b715-3fbda0147a70+12:15849:x1876039498337280:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 737us (952us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131167.395988:0:19096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 35 00000100:00100000:2.0:1789131167.414350:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789131167.418406:0:17774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498337408 00000100:00100000:1.0:1789131167.418419:0:17774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498337408 00000100:00100000:1.0:1789131167.418550:0:17774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 3 00000100:00100000:1.0:1789131167.418562:0:17774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7c6bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:014f7d38-34be-4f2e-b715-3fbda0147a70+12:15849:x1876039498337408:12345-192.168.203.11@tcp:37:lfs.0 00000100:00100000:1.0:1789131167.426890:0:17774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7c6bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:014f7d38-34be-4f2e-b715-3fbda0147a70+12:15849:x1876039498337408:12345-192.168.203.11@tcp:37:lfs.0 Request processed in 8320us (12537us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131167.426904:0:17774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 3 00000100:00100000:1.0:1789131167.441419:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131167.441523:0:17775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498337664 00000100:00100000:3.0:1789131167.441532:0:17775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498337664 00000100:00100000:3.0:1789131167.441583:0:17775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 4 00000100:00100000:3.0:1789131167.441593:0:17775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8639c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:014f7d38-34be-4f2e-b715-3fbda0147a70+12:15849:x1876039498337664:12345-192.168.203.11@tcp:35:lfs.0 00000100:00100000:3.0:1789131167.441784:0:17775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8639c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:014f7d38-34be-4f2e-b715-3fbda0147a70+13:15849:x1876039498337664:12345-192.168.203.11@tcp:35:lfs.0 Request processed in 192us (373us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1789131167.441792:0:17775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 4 00000100:00100000:2.0:1789131167.545852:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131167.546163:0:17772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498337792 00000100:00100000:0.0:1789131167.546173:0:17772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498337792 00000100:00100000:0.0:1789131167.546289:0:17772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 36 00000100:00100000:0.0:1789131167.546301:0:17772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7c6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+11:15855:x1876039498337792:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:0.0:1789131167.546322:0:17772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789131167.546342:0:17772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5e00/0xf3fe2838e1fc39f1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269e73 expref: -99 pid: 17772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131167.546403:0:17772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4200/0xf3fe2838e1fc39f8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131167.546417:0:17772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4200/0xf3fe2838e1fc39f8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131167.546437:0:17772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4200/0xf3fe2838e1fc39f8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131167.546450:0:17772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4400/0xf3fe2838e1fc39ff lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131167.546514:0:17772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4400/0xf3fe2838e1fc39ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131167.546524:0:17772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4400/0xf3fe2838e1fc39ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131167.546618:0:17772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5c00/0xf3fe2838e1fc3a06 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131167.546628:0:17772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5c00/0xf3fe2838e1fc3a06 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131167.546634:0:17772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5c00/0xf3fe2838e1fc3a06 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789131167.546669:0:17772:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789131167.546673:0:17772:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789131167.546707:0:17772:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5c00/0xf3fe2838e1fc3a06 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131167.546719:0:17772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4200/0xf3fe2838e1fc39f8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131167.546725:0:17772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4200/0xf3fe2838e1fc39f8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131167.546741:0:17772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4200/0xf3fe2838e1fc39f8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131167.546748:0:17772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddfd0b4200 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:0.0:1789131167.546752:0:17772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4200/0xf3fe2838e1fc39f8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131167.546779:0:17772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4200/0xf3fe2838e1fc39f8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131167.546792:0:17772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91ddf5c12100) 00010000:00010000:0.0:1789131167.546795:0:17772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789131167.546799:0:17772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4200/0xf3fe2838e1fc39f8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131167.546806:0:17772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4200/0xf3fe2838e1fc39f8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131167.546818:0:17772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4400/0xf3fe2838e1fc39ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131167.546824:0:17772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4400/0xf3fe2838e1fc39ff lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131167.547297:0:17772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4400/0xf3fe2838e1fc39ff lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131167.547306:0:17772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddfd0b4400 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:0.0:1789131167.547309:0:17772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4400/0xf3fe2838e1fc39ff lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131167.547327:0:17772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4400/0xf3fe2838e1fc39ff lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131167.547336:0:17772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff91dcc6c0f700) 00010000:00010000:0.0:1789131167.547339:0:17772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789131167.547342:0:17772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4400/0xf3fe2838e1fc39ff lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131167.547348:0:17772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4400/0xf3fe2838e1fc39ff lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131167.547378:0:17772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5e00/0xf3fe2838e1fc39f1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269e73 expref: 13 pid: 17772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131167.547392:0:17772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5c00/0xf3fe2838e1fc3a06 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269e73 expref: 12 pid: 17772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131167.547399:0:17772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff91dcc7d6cd00) 00010000:00010000:0.0:1789131167.547401:0:17772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789131167.547403:0:17772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ddfd0b5c00, rc 0) 00000100:00100000:0.0:1789131167.547736:0:17772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7c6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+12:15855:x1876039498337792:12345-192.168.203.11@tcp:101:bash.0 Request processed in 1206us (1660us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131167.547747:0:17772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 36 00000100:00100000:0.0:1789131167.552121:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131167.552214:0:17783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498337920 00000100:00100000:2.0:1789131167.552224:0:17783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498337920 00000100:00100000:2.0:1789131167.552287:0:17783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 7 00000100:00100000:2.0:1789131167.552297:0:17783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd1dfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+5:15855:x1876039498337920:12345-192.168.203.11@tcp:900:bash.0 00000100:00100000:2.0:1789131167.552384:0:17783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd1dfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+5:15855:x1876039498337920:12345-192.168.203.11@tcp:900:bash.0 Request processed in 88us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131167.552392:0:17783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 7 00000100:00100000:2.0:1789131167.561089:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131167.561169:0:17773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498338176 00000100:00100000:3.0:1789131167.561178:0:17773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498338176 00000100:00100000:3.0:1789131167.561233:0:17773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 37 00000100:00100000:3.0:1789131167.561243:0:17773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7c6bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+12:15855:x1876039498338176:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:3.0:1789131167.561262:0:17773:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789131167.561291:0:17773:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030e00/0xf3fe2838e1fc3a0d lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269e7a expref: -99 pid: 17773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131167.561393:0:17773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030000/0xf3fe2838e1fc3a14 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131167.561409:0:17773:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78de600/0xf3fe2838e1fc39ea lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269e6c expref: 12 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131167.561417:0:17773:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030000/0xf3fe2838e1fc3a14 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131167.561505:0:17773:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78de600/0xf3fe2838e1fc39ea lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269e6c expref: 12 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131167.561650:0:17773:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78de600/0xf3fe2838e1fc39ea lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269e6c expref: 12 pid: 19096 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131167.561664:0:17773:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff751680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17773:1876039508914944:192.168.203.11@tcp:104: 00000100:00100000:3.0:1789131167.561746:0:17773:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddc3049b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789131167.565380:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131167.566292:0:17773:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff751680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17773:1876039508914944:192.168.203.11@tcp:104: 00010000:00010000:0.0:1789131167.566320:0:17773:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030000/0xf3fe2838e1fc3a14 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17773 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131167.566921:0:17756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498338304 00000100:00100000:2.0:1789131167.566928:0:17756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498338304 00010000:00010000:2.0:1789131167.566963:0:17756:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78de600/0xf3fe2838e1fc39ea lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269e6c expref: 13 pid: 19096 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131167.567088:0:17756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 16 00000100:00100000:2.0:1789131167.567097:0:17756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff753480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:014f7d38-34be-4f2e-b715-3fbda0147a70+13:2387:x1876039498338304:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789131167.567111:0:17756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789131167.567118:0:17756:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78de600/0xf3fe2838e1fc39ea lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269e6c expref: 13 pid: 19096 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131167.567131:0:17756:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78de600/0xf3fe2838e1fc39ea lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269e6c expref: 13 pid: 19096 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131167.567151:0:17756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78de600/0xf3fe2838e1fc39ea lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269e6c expref: 13 pid: 19096 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131167.567165:0:17756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff91dcc7d6cd00) 00010000:00010000:2.0:1789131167.567169:0:17756:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030000/0xf3fe2838e1fc3a14 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131167.567185:0:17756:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030000/0xf3fe2838e1fc3a14 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131167.567193:0:17756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030000/0xf3fe2838e1fc3a14 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131167.567220:0:17756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789131167.567267:0:17756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff753480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:014f7d38-34be-4f2e-b715-3fbda0147a70+12:2387:x1876039498338304:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 171us (1896us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131167.567284:0:17756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 16 00010000:00010000:3.0:1789131167.567335:0:17773:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030000/0xf3fe2838e1fc3a14 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131167.567343:0:17773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030000/0xf3fe2838e1fc3a14 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131167.567367:0:17773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0031600/0xf3fe2838e1fc3a1b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131167.567377:0:17773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0031600/0xf3fe2838e1fc3a1b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131167.567386:0:17773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0031600/0xf3fe2838e1fc3a1b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131167.568153:0:17773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030200/0xf3fe2838e1fc3a22 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131167.568165:0:17773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030200/0xf3fe2838e1fc3a22 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131167.568172:0:17773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030200/0xf3fe2838e1fc3a22 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17773 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789131167.568197:0:17773:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1789131167.568224:0:17773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030000/0xf3fe2838e1fc3a14 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131167.568231:0:17773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030000/0xf3fe2838e1fc3a14 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131167.568237:0:17773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030000/0xf3fe2838e1fc3a14 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131167.568242:0:17773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddc0030000 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:3.0:1789131167.568245:0:17773:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030000/0xf3fe2838e1fc3a14 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131167.568252:0:17773:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030000/0xf3fe2838e1fc3a14 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131167.568261:0:17773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff91dcc7d6cd00) 00010000:00010000:3.0:1789131167.568264:0:17773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789131167.568267:0:17773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030000/0xf3fe2838e1fc3a14 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131167.568273:0:17773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030000/0xf3fe2838e1fc3a14 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17773 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789131167.568299:0:17773:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000010359ba0 reply state 00000000c42c7c11 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0031600/0xf3fe2838e1fc3a1b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131167.568309:0:17773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0031600/0xf3fe2838e1fc3a1b lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131167.568325:0:17773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff91dcc6c0fa00) 00010000:00010000:3.0:1789131167.568327:0:17773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789131167.568330:0:17773:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789131167.568370:0:17773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030e00/0xf3fe2838e1fc3a0d lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269e7a expref: 15 pid: 17773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131167.568384:0:17773:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030200/0xf3fe2838e1fc3a22 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269e7a expref: 14 pid: 17773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131167.568391:0:17773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91dcc6c0f600) 00010000:00010000:3.0:1789131167.568393:0:17773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:3.0:1789131167.568395:0:17773:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ddc0030200, rc 0) 00000100:00100000:3.0:1789131167.568452:0:17773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7c6bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+15:15855:x1876039498338176:12345-192.168.203.11@tcp:101:bash.0 Request processed in 7210us (7371us total) trans 8589934600 rc 0/0 00000100:00100000:3.0:1789131167.568946:0:17773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 37 00000100:00100000:3.0:1789131167.593271:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131167.593377:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131167.593419:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131167.594195:0:19981:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498338688 00000100:00100000:0.0:1789131167.594205:0:19981:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498338688 00000100:00100000:0.0:1789131167.594287:0:19981:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 18 00000100:00100000:0.0:1789131167.594298:0:19981:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff751680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+5:2385:x1876039498338688:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1789131167.594386:0:19981:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff751680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+5:2385:x1876039498338688:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 90us (965us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131167.594395:0:19981:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 18 00000100:00100000:1.0:1789131167.595025:0:17771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498338560 00000100:00100000:1.0:1789131167.595032:0:17771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498338560 00000100:00100000:1.0:1789131167.595076:0:17771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 38 00000100:00100000:1.0:1789131167.595084:0:17771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff7530c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+15:15855:x1876039498338560:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:1.0:1789131167.595103:0:17771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789131167.595122:0:17771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dde19ab200/0xf3fe2838e1fc3a30 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269e81 expref: -99 pid: 17771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131167.595214:0:17771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dde19abe00/0xf3fe2838e1fc3a37 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131167.595228:0:17771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dde19abe00/0xf3fe2838e1fc3a37 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131167.595239:0:17771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dde19abe00/0xf3fe2838e1fc3a37 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789131167.595286:0:17771:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1789131167.595291:0:17771:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789131167.595314:0:17771:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91dde19abe00/0xf3fe2838e1fc3a37 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131167.595325:0:17771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dde19abe00/0xf3fe2838e1fc3a37 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131167.595361:0:17771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dde19ab200/0xf3fe2838e1fc3a30 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269e81 expref: 17 pid: 17771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131167.595380:0:17771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91dde19abe00/0xf3fe2838e1fc3a37 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269e81 expref: 16 pid: 17771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131167.595388:0:17771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91dcc6c0f600) 00010000:00010000:1.0:1789131167.595392:0:17771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789131167.595395:0:17771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dde19abe00, rc 0) 00000100:00100000:1.0:1789131167.595426:0:17771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff7530c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+16:15855:x1876039498338560:12345-192.168.203.11@tcp:101:bash.0 Request processed in 343us (2049us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131167.595433:0:17771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 38 00000100:00080000:3.0:1789131167.595918:0:17767:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789131167.596839:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789131167.596876:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789131167.596906:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789131167.596934:0:20403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498338944 00000100:00100000:3.0:1789131167.596937:0:19284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498338816 00000100:00100000:1.0:1789131167.596942:0:20403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498338944 00000100:00100000:3.0:1789131167.596947:0:19284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498338816 00000100:00100000:1.0:1789131167.596992:0:20403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498339072 00000100:00100000:1.0:1789131167.596995:0:20403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498339072 00000100:00100000:3.0:1789131167.597012:0:19284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 19 00000100:00100000:3.0:1789131167.597023:0:19284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7b79680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:014f7d38-34be-4f2e-b715-3fbda0147a70+5:2386:x1876039498338944:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1789131167.597157:0:19284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7b79680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:014f7d38-34be-4f2e-b715-3fbda0147a70+5:2386:x1876039498338944:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 136us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131167.599227:0:17765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498338432 00000100:00100000:2.0:1789131167.599240:0:17765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498338432 00000100:00080000:2.0:1789131167.599370:0:17767:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789131167.599375:0:17767:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789131167.600776:0:20403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 20 00000100:00100000:1.0:1789131167.600803:0:20403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7b78b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+5:2386:x1876039498338816:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1789131167.600875:0:20403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7b78b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+5:2386:x1876039498338816:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 88us (3998us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131167.600882:0:20403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 20 00000100:00100000:1.0:1789131167.600902:0:20403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 21 00000100:00100000:1.0:1789131167.600909:0:20403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7b7b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:014f7d38-34be-4f2e-b715-3fbda0147a70+5:2386:x1876039498339072:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1789131167.600933:0:20403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7b7b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:014f7d38-34be-4f2e-b715-3fbda0147a70+5:2386:x1876039498339072:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 25us (4027us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131167.600940:0:20403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 21 00000100:00100000:1.0:1789131167.601003:0:17765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 165 00000100:00100000:1.0:1789131167.601011:0:17765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddfff16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22edf929-4c0f-42f3-973d-fe4d92543efa+13:2385:x1876039498338432:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1789131167.601034:0:17765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddfff16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:22edf929-4c0f-42f3-973d-fe4d92543efa+13:2385:x1876039498338432:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 25us (7773us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131167.601041:0:17765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 165 00000100:00100000:3.0:1789131167.602349:0:19284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 19 00000100:00100000:1.0:1789131167.602839:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131167.602959:0:17775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498339328 00000100:00100000:3.0:1789131167.602967:0:17775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498339328 00000100:00100000:3.0:1789131167.603019:0:17775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 5 00000100:00100000:3.0:1789131167.603028:0:17775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7b78780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+16:15855:x1876039498339328:12345-192.168.203.11@tcp:35:bash.0 00000100:00100000:3.0:1789131167.603419:0:17775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7b78780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+17:15855:x1876039498339328:12345-192.168.203.11@tcp:35:bash.0 Request processed in 390us (580us total) trans 8589934601 rc 0/0 00000100:00100000:3.0:1789131167.603427:0:17775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 5 00000100:00100000:1.0:1789131167.725302:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131167.725745:0:19096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498339584 00000100:00100000:2.0:1789131167.725755:0:19096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498339584 00000100:00100000:2.0:1789131167.725838:0:19096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 39 00000100:00100000:2.0:1789131167.725848:0:19096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7b78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+17:15865:x1876039498339584:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:2.0:1789131167.725871:0:19096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789131167.725891:0:19096:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78de600/0xf3fe2838e1fc3a3e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269e88 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789131167.725983:0:19096:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1789131167.726073:0:19096:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78de600/0xf3fe2838e1fc3a3e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269e88 expref: 19 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131167.726087:0:19096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91ddf5c12100) 00010000:00010000:2.0:1789131167.726090:0:19096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789131167.726107:0:19096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78de600/0xf3fe2838e1fc3a3e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269e88 expref: 19 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131167.726121:0:19096:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dcc78de600, rc 0) 00000100:00100000:2.0:1789131167.726236:0:19096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7b78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+18:15865:x1876039498339584:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 389us (942us total) trans 8589934602 rc 301/301 00000100:00100000:2.0:1789131167.726243:0:19096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 39 00000100:00100000:0.0:1789131167.749805:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131167.750014:0:17775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498339840 00000100:00100000:3.0:1789131167.750023:0:17775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498339840 00000100:00100000:3.0:1789131167.750083:0:17775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 6 00000100:00100000:3.0:1789131167.750093:0:17775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd1dfa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+18:15865:x1876039498339840:12345-192.168.203.11@tcp:35:lfs.0 00000100:00100000:3.0:1789131167.750380:0:17775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd1dfa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+19:15865:x1876039498339840:12345-192.168.203.11@tcp:35:lfs.0 Request processed in 287us (590us total) trans 8589934603 rc 0/0 00000100:00100000:3.0:1789131167.750388:0:17775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 6 00010000:00010000:3.0:1789131167.763267:0:19311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789131167.765100:0:18526:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789131167.843037:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131167.843144:0:17771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498340096 00000100:00100000:3.0:1789131167.843154:0:17771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498340096 00000100:00100000:3.0:1789131167.843214:0:17771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 40 00000100:00100000:3.0:1789131167.843224:0:17771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7b79a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+19:15868:x1876039498340096:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:3.0:1789131167.843248:0:17771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789131167.843269:0:17771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030e00/0xf3fe2838e1fc3a4c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269e8f expref: -99 pid: 17771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131167.843381:0:17771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030000/0xf3fe2838e1fc3a53 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131167.843396:0:17771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030000/0xf3fe2838e1fc3a53 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131167.843414:0:17771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030000/0xf3fe2838e1fc3a53 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789131167.843426:0:17771:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789131167.844003:0:17771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030e00/0xf3fe2838e1fc3a4c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269e8f expref: 22 pid: 17771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131167.844025:0:17771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030000/0xf3fe2838e1fc3a53 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269e8f expref: 21 pid: 17771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131167.844033:0:17771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91dcc6c0f600) 00010000:00010000:2.0:1789131167.844036:0:17771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789131167.844039:0:17771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ddc0030000, rc 0) 00000100:00100000:2.0:1789131167.844104:0:17771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7b79a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+21:15868:x1876039498340096:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 880us (1076us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1789131167.844112:0:17771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 40 00000100:00100000:0.0:1789131167.851603:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131167.851726:0:17757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498340224 00000100:00100000:2.0:1789131167.851734:0:17757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498340224 00000100:00100000:2.0:1789131167.851811:0:17757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 0 00000100:00100000:2.0:1789131167.851831:0:17757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd1df9680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+21:2388:x1876039498340224:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789131167.851847:0:17757:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789131167.851869:0:17757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030000/0xf3fe2838e1fc3a53 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269e8f expref: 21 pid: 17771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131167.851903:0:17757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91dcc6c0f600) 00010000:00010000:2.0:1789131167.851908:0:17757:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789131167.851964:0:17757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd1df9680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+20:2388:x1876039498340224:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 144us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131167.851972:0:17757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 0 00000100:00100000:0.0:1789131167.852700:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131167.852833:0:19096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498340352 00000100:00100000:2.0:1789131167.852839:0:19096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498340352 00000100:00100000:2.0:1789131167.852881:0:19096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 41 00000100:00100000:2.0:1789131167.852889:0:19096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd1df9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+20:15868:x1876039498340352:12345-192.168.203.11@tcp:54:lfs.0 00010000:00010000:2.0:1789131167.852943:0:19096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78de600/0xf3fe2838e1fc3a61 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131167.852957:0:19096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78de600/0xf3fe2838e1fc3a61 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131167.852969:0:19096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78de600/0xf3fe2838e1fc3a61 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131167.853003:0:19096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78de600/0xf3fe2838e1fc3a61 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131167.853010:0:19096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78de600/0xf3fe2838e1fc3a61 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131167.853017:0:19096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78de600/0xf3fe2838e1fc3a61 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131167.853024:0:19096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc78de600 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:2.0:1789131167.853036:0:19096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78de600/0xf3fe2838e1fc3a61 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131167.853045:0:19096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78de600/0xf3fe2838e1fc3a61 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131167.853055:0:19096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91dcc6c0f600) 00010000:00010000:2.0:1789131167.853058:0:19096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789131167.853062:0:19096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78de600/0xf3fe2838e1fc3a61 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131167.853069:0:19096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78de600/0xf3fe2838e1fc3a61 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131167.853125:0:19096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd1df9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+20:15868:x1876039498340352:12345-192.168.203.11@tcp:54:lfs.0 Request processed in 235us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131167.853133:0:19096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 41 00000100:00100000:1.0:1789131167.859274:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131167.859541:0:17775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498340608 00000100:00100000:3.0:1789131167.859555:0:17775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498340608 00000100:00100000:3.0:1789131167.859636:0:17775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 7 00000100:00100000:3.0:1789131167.859649:0:17775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7b7a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+20:15868:x1876039498340608:12345-192.168.203.11@tcp:35:lfs.0 00000100:00100000:3.0:1789131167.859958:0:17775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7b7a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+21:15868:x1876039498340608:12345-192.168.203.11@tcp:35:lfs.0 Request processed in 311us (697us total) trans 8589934605 rc 0/0 00000100:00100000:3.0:1789131167.859968:0:17775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 7 00000040:00080000:3.0:1789131168.147351:0:17805:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789131168.220830:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789131168.221002:0:17772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498340864 00000100:00100000:1.0:1789131168.221012:0:17772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498340864 00000100:00100000:1.0:1789131168.221129:0:17772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 42 00000100:00100000:1.0:1789131168.221141:0:17772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd1df8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+21:15900:x1876039498340864:12345-192.168.203.11@tcp:101:cat.0 00010000:00010000:1.0:1789131168.221164:0:17772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789131168.221185:0:17772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dde19ab000/0xf3fe2838e1fc3a68 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269e96 expref: -99 pid: 17772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131168.221289:0:17772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dde19aa600/0xf3fe2838e1fc3a6f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131168.221303:0:17772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dde19aa600/0xf3fe2838e1fc3a6f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131168.221317:0:17772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dde19aa600/0xf3fe2838e1fc3a6f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789131168.221329:0:17772:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1789131168.221450:0:17772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dde19ab000/0xf3fe2838e1fc3a68 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269e96 expref: 24 pid: 17772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131168.221509:0:17772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91dde19aa600/0xf3fe2838e1fc3a6f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269e96 expref: 23 pid: 17772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131168.221518:0:17772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91dcc6c0f600) 00010000:00010000:1.0:1789131168.221520:0:17772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789131168.221524:0:17772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dde19aa600, rc 0) 00000100:00100000:1.0:1789131168.221586:0:17772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd1df8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+23:15900:x1876039498340864:12345-192.168.203.11@tcp:101:cat.0 Request processed in 447us (774us total) trans 8589934606 rc 0/0 00000100:00100000:1.0:1789131168.221608:0:17772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 42 00000100:00100000:0.0:1789131168.231349:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131168.231531:0:18530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498340992 00000100:00100000:2.0:1789131168.231543:0:18530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498340992 00000100:00100000:2.0:1789131168.231628:0:18530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 1 00000100:00100000:2.0:1789131168.231640:0:18530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd1df8780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+23:2388:x1876039498340992:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789131168.231659:0:18530:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789131168.231692:0:18530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dde19aa600/0xf3fe2838e1fc3a6f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269e96 expref: 23 pid: 17772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131168.231716:0:18530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91dcc6c0f600) 00010000:00010000:2.0:1789131168.231722:0:18530:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789131168.231806:0:18530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd1df8780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+22:2388:x1876039498340992:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 168us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131168.231844:0:18530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 1 00000100:00100000:0.0:1789131168.243198:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131168.243419:0:17775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498341248 00000100:00100000:3.0:1789131168.243445:0:17775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498341248 00000100:00100000:3.0:1789131168.243576:0:17775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 8 00000100:00100000:3.0:1789131168.243590:0:17775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd1dfb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+22:15900:x1876039498341248:12345-192.168.203.11@tcp:35:cat.0 00000100:00100000:3.0:1789131168.244430:0:17775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd1dfb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+23:15900:x1876039498341248:12345-192.168.203.11@tcp:35:cat.0 Request processed in 836us (1240us total) trans 8589934607 rc 0/0 00000100:00100000:3.0:1789131168.244441:0:17775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 8 00000100:00100000:1.0:1789131168.351417:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131168.351575:0:19096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498341504 00000100:00100000:2.0:1789131168.351588:0:19096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498341504 00000100:00100000:2.0:1789131168.351660:0:19096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 43 00000100:00100000:2.0:1789131168.351674:0:19096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddca0f8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+23:15906:x1876039498341504:12345-192.168.203.11@tcp:101:dd.0 00010000:00010000:2.0:1789131168.351708:0:19096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789131168.351737:0:19096:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78de600/0xf3fe2838e1fc3a7d lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269e9d expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131168.351891:0:19096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78de000/0xf3fe2838e1fc3a84 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131168.351911:0:19096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78de000/0xf3fe2838e1fc3a84 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131168.351923:0:19096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78de000/0xf3fe2838e1fc3a84 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789131168.351936:0:19096:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789131168.353273:0:19096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78de600/0xf3fe2838e1fc3a7d lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269e9d expref: 26 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131168.353306:0:19096:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78de000/0xf3fe2838e1fc3a84 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269e9d expref: 25 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131168.353317:0:19096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91dcc6c0f600) 00010000:00010000:2.0:1789131168.353320:0:19096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789131168.353325:0:19096:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dcc78de000, rc 0) 00000100:00100000:2.0:1789131168.353662:0:19096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddca0f8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+25:15906:x1876039498341504:12345-192.168.203.11@tcp:101:dd.0 Request processed in 1989us (2256us total) trans 8589934608 rc 0/0 00000100:00100000:2.0:1789131168.353671:0:19096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 43 00000100:00100000:0.0:1789131168.359224:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131168.359321:0:17771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498341632 00000100:00100000:2.0:1789131168.359334:0:17771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498341632 00000100:00100000:2.0:1789131168.359414:0:17771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 44 00000100:00100000:2.0:1789131168.362526:0:17771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd1df8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+25:15906:x1876039498341632:12345-192.168.203.11@tcp:101:dd.0 00010000:00010000:2.0:1789131168.362586:0:17771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789131168.362624:0:17771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78de600/0xf3fe2838e1fc3a92 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269ea4 expref: -99 pid: 17771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131168.362672:0:17771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78dec00/0xf3fe2838e1fc3a99 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131168.362692:0:17771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78dec00/0xf3fe2838e1fc3a99 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131168.362706:0:17771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78dec00/0xf3fe2838e1fc3a99 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131168.362892:0:17771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78de600/0xf3fe2838e1fc3a92 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269ea4 expref: 27 pid: 17771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131168.362913:0:17771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78dec00/0xf3fe2838e1fc3a99 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269ea4 expref: 26 pid: 17771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131168.362922:0:17771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91dcc6c0f600) 00010000:00010000:2.0:1789131168.362925:0:17771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789131168.362930:0:17771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dcc78dec00, rc 0) 00000100:00100000:2.0:1789131168.363097:0:17771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd1df8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+26:15906:x1876039498341632:12345-192.168.203.11@tcp:101:dd.0 Request processed in 3672us (3889us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131168.363107:0:17771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 44 00000100:00100000:1.0:1789131168.368282:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131168.368519:0:17758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498341760 00000100:00100000:2.0:1789131168.368533:0:17758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498341760 00000100:00100000:2.0:1789131168.368611:0:17758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 2 00000100:00100000:2.0:1789131168.368623:0:17758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddca0f9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+26:2387:x1876039498341760:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789131168.368641:0:17758:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789131168.368672:0:17758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78de000/0xf3fe2838e1fc3a84 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269e9d expref: 26 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131168.368698:0:17758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91dcc6c0f600) 00010000:00010000:2.0:1789131168.368704:0:17758:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789131168.368780:0:17758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddca0f9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+25:2387:x1876039498341760:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 159us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131168.368789:0:17758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 2 00000100:00100000:1.0:1789131168.372039:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131168.372420:0:19096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498342016 00000100:00100000:2.0:1789131168.372440:0:19096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498342016 00000100:00100000:2.0:1789131168.372746:0:19096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 45 00000100:00100000:2.0:1789131168.372760:0:19096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc5f91680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+25:15906:x1876039498342016:12345-192.168.203.11@tcp:36:dd.0 00010000:00010000:2.0:1789131168.372842:0:19096:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789131168.372874:0:19096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dde19abe00/0xf3fe2838e1fc3a37 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269e81 expref: 25 pid: 17771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131168.372896:0:19096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91dcc6c0f600) 00010000:00010000:2.0:1789131168.372902:0:19096:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789131168.373153:0:19096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78de600/0xf3fe2838e1fc3aa0 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131168.373169:0:19096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78de600/0xf3fe2838e1fc3aa0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131168.373180:0:19096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78de600/0xf3fe2838e1fc3aa0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789131168.373229:0:19096:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:2.0:1789131168.373253:0:19096:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000a0b875eb reply state 00000000e517f625 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78de600/0xf3fe2838e1fc3aa0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131168.373267:0:19096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78de600/0xf3fe2838e1fc3aa0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131168.373273:0:19096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91dcc6c0f600) 00010000:00010000:2.0:1789131168.373276:0:19096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789131168.373279:0:19096:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789131168.373867:0:19096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc5f91680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+27:15906:x1876039498342016:12345-192.168.203.11@tcp:36:dd.0 Request processed in 1107us (1894us total) trans 8589934610 rc 0/0 00000100:00100000:2.0:1789131168.373878:0:19096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 45 00000020:00080000:2.0:1789131168.373885:0:19096:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789131168.458349:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789131168.458944:0:17774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498342272 00000100:00100000:1.0:1789131168.458958:0:17774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498342272 00000100:00100000:1.0:1789131168.459041:0:17774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 9 00000100:00100000:1.0:1789131168.459052:0:17774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd1dfa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+27:15906:x1876039498342272:12345-192.168.203.11@tcp:35:dd.0 00000100:00100000:1.0:1789131168.459614:0:17774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd1dfa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+28:15906:x1876039498342272:12345-192.168.203.11@tcp:35:dd.0 Request processed in 561us (1275us total) trans 8589934611 rc 0/0 00000100:00100000:1.0:1789131168.459632:0:17774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 9 00000100:00100000:3.0:1789131168.756964:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131168.757147:0:17772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498342400 00000100:00100000:0.0:1789131168.757159:0:17772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498342400 00000100:00100000:0.0:1789131168.757243:0:17772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 46 00000100:00100000:0.0:1789131168.757254:0:17772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff750f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+28:15920:x1876039498342400:12345-192.168.203.11@tcp:101:stat.0 00010000:00010000:0.0:1789131168.757285:0:17772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789131168.757312:0:17772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4400/0xf3fe2838e1fc3aa7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269eab expref: -99 pid: 17772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131168.757394:0:17772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5e00/0xf3fe2838e1fc3aae lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131168.757443:0:17772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5e00/0xf3fe2838e1fc3aae lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131168.757501:0:17772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5e00/0xf3fe2838e1fc3aae lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131168.757516:0:17772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4200/0xf3fe2838e1fc3ab5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131168.757524:0:17772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4200/0xf3fe2838e1fc3ab5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131168.757531:0:17772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4200/0xf3fe2838e1fc3ab5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131168.757639:0:17772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc3abc lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131168.757648:0:17772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc3abc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131168.757655:0:17772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc3abc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789131168.757710:0:17772:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1789131168.757716:0:17772:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789131168.757775:0:17772:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc3abc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131168.757789:0:17772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc3abc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131168.757809:0:17772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5e00/0xf3fe2838e1fc3aae lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131168.757816:0:17772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5e00/0xf3fe2838e1fc3aae lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131168.757824:0:17772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5e00/0xf3fe2838e1fc3aae lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131168.757830:0:17772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddfd0b5e00 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:0.0:1789131168.757835:0:17772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5e00/0xf3fe2838e1fc3aae lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131168.757843:0:17772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5e00/0xf3fe2838e1fc3aae lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131168.757856:0:17772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff91dcc7d6cd00) 00010000:00010000:0.0:1789131168.757859:0:17772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789131168.757864:0:17772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5e00/0xf3fe2838e1fc3aae lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131168.757869:0:17772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5e00/0xf3fe2838e1fc3aae lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131168.757885:0:17772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4200/0xf3fe2838e1fc3ab5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131168.757890:0:17772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4200/0xf3fe2838e1fc3ab5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131168.757896:0:17772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4200/0xf3fe2838e1fc3ab5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131168.757907:0:17772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddfd0b4200 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:0.0:1789131168.757911:0:17772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4200/0xf3fe2838e1fc3ab5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131168.757916:0:17772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4200/0xf3fe2838e1fc3ab5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131168.757924:0:17772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff91dcc6c0fa00) 00010000:00010000:0.0:1789131168.757927:0:17772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789131168.757930:0:17772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4200/0xf3fe2838e1fc3ab5 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131168.757936:0:17772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4200/0xf3fe2838e1fc3ab5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131168.757965:0:17772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4400/0xf3fe2838e1fc3aa7 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269eab expref: 30 pid: 17772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131168.757978:0:17772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc3abc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269eab expref: 29 pid: 17772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131168.757985:0:17772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91dcc6c0f600) 00010000:00010000:0.0:1789131168.757988:0:17772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789131168.757990:0:17772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91de01ad7600, rc 0) 00000100:00100000:0.0:1789131168.758069:0:17772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff750f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+29:15920:x1876039498342400:12345-192.168.203.11@tcp:101:stat.0 Request processed in 817us (1119us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131168.758076:0:17772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 46 00010000:00010000:0.0:1789131168.785841:0:17759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789131168.853858:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131168.854136:0:17773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498342656 00000100:00100000:3.0:1789131168.854152:0:17773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498342656 00000100:00100000:3.0:1789131168.854231:0:17773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 47 00000100:00100000:3.0:1789131168.854243:0:17773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc12a8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+29:15926:x1876039498342656:12345-192.168.203.11@tcp:36:truncate.0 00010000:00010000:3.0:1789131168.854315:0:17773:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789131168.854368:0:17773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc3abc lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269eab expref: 29 pid: 17772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131168.854394:0:17773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91dcc6c0f600) 00010000:00010000:3.0:1789131168.854400:0:17773:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789131168.854707:0:17773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0031400/0xf3fe2838e1fc3ac3 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131168.854725:0:17773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0031400/0xf3fe2838e1fc3ac3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131168.854737:0:17773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0031400/0xf3fe2838e1fc3ac3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17773 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789131168.854794:0:17773:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934612 00000004:00010000:3.0:1789131168.854817:0:17773:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000009be8dad reply state 00000000876531f7 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0031400/0xf3fe2838e1fc3ac3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131168.854830:0:17773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0031400/0xf3fe2838e1fc3ac3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131168.854837:0:17773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91dcc6c0f600) 00010000:00010000:3.0:1789131168.854839:0:17773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789131168.854842:0:17773:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789131168.856734:0:17773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc12a8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+31:15926:x1876039498342656:12345-192.168.203.11@tcp:36:truncate.0 Request processed in 2476us (2875us total) trans 8589934613 rc 0/0 00000100:00100000:3.0:1789131168.856749:0:17773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 47 00000020:00080000:3.0:1789131168.856771:0:17773:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789131169.126335:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131169.134753:0:17772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498342784 00000100:00100000:0.0:1789131169.134782:0:17772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498342784 00000100:00100000:0.0:1789131169.134952:0:17772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 48 00000100:00100000:0.0:1789131169.134978:0:17772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc5f90b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+31:15940:x1876039498342784:12345-192.168.203.11@tcp:101:stat.0 00010000:00010000:0.0:1789131169.135011:0:17772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789131169.135039:0:17772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7e00/0xf3fe2838e1fc3aca lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269eb2 expref: -99 pid: 17772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131169.135125:0:17772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7a00/0xf3fe2838e1fc3ad1 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131169.135141:0:17772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7a00/0xf3fe2838e1fc3ad1 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131169.135157:0:17772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7a00/0xf3fe2838e1fc3ad1 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131169.135170:0:17772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc3ad8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131169.135177:0:17772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc3ad8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131169.135183:0:17772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc3ad8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131169.135273:0:17772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4400/0xf3fe2838e1fc3adf lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131169.135282:0:17772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4400/0xf3fe2838e1fc3adf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131169.135309:0:17772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4400/0xf3fe2838e1fc3adf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789131169.135358:0:17772:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00000004:00200000:0.0:1789131169.135363:0:17772:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789131169.135389:0:17772:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4400/0xf3fe2838e1fc3adf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131169.135403:0:17772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4400/0xf3fe2838e1fc3adf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131169.135412:0:17772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7a00/0xf3fe2838e1fc3ad1 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131169.136754:0:17772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7a00/0xf3fe2838e1fc3ad1 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131169.136777:0:17772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7a00/0xf3fe2838e1fc3ad1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131169.136785:0:17772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91de01ad7a00 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:0.0:1789131169.136790:0:17772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7a00/0xf3fe2838e1fc3ad1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131169.136800:0:17772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7a00/0xf3fe2838e1fc3ad1 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131169.136818:0:17772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff91dcc7d6cd00) 00010000:00010000:0.0:1789131169.136822:0:17772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789131169.136827:0:17772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7a00/0xf3fe2838e1fc3ad1 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131169.136854:0:17772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7a00/0xf3fe2838e1fc3ad1 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131169.136876:0:17772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc3ad8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131169.136883:0:17772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc3ad8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131169.136889:0:17772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc3ad8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131169.136894:0:17772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91de01ad7600 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:0.0:1789131169.136897:0:17772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc3ad8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131169.136903:0:17772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc3ad8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131169.136911:0:17772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff91dcc6c0fa00) 00010000:00010000:0.0:1789131169.136913:0:17772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789131169.136916:0:17772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc3ad8 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131169.136921:0:17772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7600/0xf3fe2838e1fc3ad8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131169.137860:0:17772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91de01ad7e00/0xf3fe2838e1fc3aca lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269eb2 expref: 33 pid: 17772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131169.137912:0:17772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4400/0xf3fe2838e1fc3adf lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269eb2 expref: 32 pid: 17772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131169.137921:0:17772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91dcc6c0f600) 00010000:00010000:0.0:1789131169.137924:0:17772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789131169.137927:0:17772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ddfd0b4400, rc 0) 00000100:00100000:0.0:1789131169.140525:0:17772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc5f90b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+32:15940:x1876039498342784:12345-192.168.203.11@tcp:101:stat.0 Request processed in 5545us (14186us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131169.140541:0:17772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 48 00000100:00080000:2.0:1789131169.143738:0:17767:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789131169.299922:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131169.300040:0:19096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498343040 00000100:00100000:2.0:1789131169.300053:0:19096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498343040 00000100:00100000:2.0:1789131169.300134:0:19096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 49 00000100:00100000:2.0:1789131169.300147:0:19096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc5f93840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+32:15950:x1876039498343040:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:2.0:1789131169.300176:0:19096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789131169.300204:0:19096:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78de000/0xf3fe2838e1fc3ae6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269eb9 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789131169.300384:0:19096:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1789131169.300577:0:19096:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78de000/0xf3fe2838e1fc3ae6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269eb9 expref: 34 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131169.300595:0:19096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91ddf5c12100) 00010000:00010000:2.0:1789131169.300600:0:19096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789131169.300606:0:19096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78de000/0xf3fe2838e1fc3ae6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269eb9 expref: 34 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131169.301036:0:19096:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dcc78de000, rc 0) 00000100:00100000:2.0:1789131169.301123:0:19096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc5f93840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+33:15950:x1876039498343040:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 977us (1215us total) trans 8589934614 rc 301/301 00000100:00100000:2.0:1789131169.301132:0:19096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 49 00000100:00100000:1.0:1789131169.310180:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131169.310315:0:17775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498343296 00000100:00100000:3.0:1789131169.310327:0:17775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498343296 00000100:00100000:3.0:1789131169.310392:0:17775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 10 00000100:00100000:3.0:1789131169.310403:0:17775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc8638050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+33:15950:x1876039498343296:12345-192.168.203.11@tcp:35:lfs.0 00000100:00100000:3.0:1789131169.310866:0:17775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc8638050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+34:15950:x1876039498343296:12345-192.168.203.11@tcp:35:lfs.0 Request processed in 463us (698us total) trans 8589934615 rc 0/0 00000100:00100000:3.0:1789131169.310875:0:17775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 10 00000100:00100000:1.0:1789131169.410340:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131169.410572:0:17771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498343552 00000100:00100000:2.0:1789131169.410585:0:17771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498343552 00000100:00100000:2.0:1789131169.410673:0:17771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 50 00000100:00100000:2.0:1789131169.410685:0:17771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc5f91e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+34:15956:x1876039498343552:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:2.0:1789131169.410717:0:17771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789131169.410743:0:17771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78de000/0xf3fe2838e1fc3af4 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269ec0 expref: -99 pid: 17771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131169.410882:0:17771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78df200/0xf3fe2838e1fc3afb lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131169.410898:0:17771:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030200/0xf3fe2838e1fc3a22 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269e7a expref: 35 pid: 17773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131169.410930:0:17771:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4400/0xf3fe2838e1fc3adf lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269eb2 expref: 35 pid: 17772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131169.410939:0:17771:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78df200/0xf3fe2838e1fc3afb lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131169.411293:0:17771:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4400/0xf3fe2838e1fc3adf lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269eb2 expref: 35 pid: 17772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131169.411310:0:17771:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4400/0xf3fe2838e1fc3adf lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269eb2 expref: 35 pid: 17772 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131169.411325:0:17771:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd286c000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17771:1876039508915072:192.168.203.11@tcp:104: 00010000:00010000:2.0:1789131169.411448:0:17771:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030200/0xf3fe2838e1fc3a22 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269e7a expref: 35 pid: 17773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131169.411493:0:17771:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030200/0xf3fe2838e1fc3a22 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269e7a expref: 35 pid: 17773 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131169.411505:0:17771:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7ffcf00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17771:1876039508915200:192.168.203.11@tcp:104: 00000100:00100000:2.0:1789131169.411546:0:17771:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddc11ca840 going to sleep for 11 seconds 00000100:00100000:0.0:1789131169.417437:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131169.417528:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131169.417765:0:17756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498343680 00000100:00100000:3.0:1789131169.417777:0:17756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498343680 00010000:00010000:3.0:1789131169.417831:0:17756:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4400/0xf3fe2838e1fc3adf lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269eb2 expref: 36 pid: 17772 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131169.417878:0:17756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498343808 00000100:00100000:3.0:1789131169.417882:0:17756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498343808 00010000:00010000:3.0:1789131169.417896:0:17756:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030200/0xf3fe2838e1fc3a22 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269e7a expref: 37 pid: 17773 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131169.417923:0:17756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 17 00000100:00100000:3.0:1789131169.417934:0:17756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff4eb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+37:2388:x1876039498343680:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789131169.417952:0:17756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789131169.417960:0:17756:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4400/0xf3fe2838e1fc3adf lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269eb2 expref: 37 pid: 17772 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131169.417987:0:17756:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4400/0xf3fe2838e1fc3adf lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269eb2 expref: 37 pid: 17772 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131169.418016:0:17756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91dcc6c0f600) 00010000:00010000:3.0:1789131169.418022:0:17756:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78df200/0xf3fe2838e1fc3afb lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131169.418033:0:17756:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78df200/0xf3fe2838e1fc3afb lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131169.418059:0:17756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789131169.418125:0:17756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff4eb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+37:2388:x1876039498343680:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 192us (708us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131169.418134:0:17756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 17 00000100:00100000:3.0:1789131169.418194:0:17756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 18 00000100:00100000:3.0:1789131169.418200:0:17756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddc12aa580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+36:2388:x1876039498343808:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789131169.418208:0:17756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789131169.418213:0:17756:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030200/0xf3fe2838e1fc3a22 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269e7a expref: 36 pid: 17773 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131169.418224:0:17756:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030200/0xf3fe2838e1fc3a22 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269e7a expref: 36 pid: 17773 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131169.418235:0:17756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91dcc6c0f600) 00010000:00010000:3.0:1789131169.418239:0:17756:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78df200/0xf3fe2838e1fc3afb lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131169.418248:0:17756:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78df200/0xf3fe2838e1fc3afb lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131169.418256:0:17756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78df200/0xf3fe2838e1fc3afb lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131169.418276:0:17756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789131169.418295:0:17756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddc12aa580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+36:2388:x1876039498343808:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 94us (766us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131169.418302:0:17756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 18 00010000:00010000:2.0:1789131169.418939:0:17771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4400/0xf3fe2838e1fc3adf lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269eb2 expref: 35 pid: 17772 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131169.418962:0:17771:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd286c000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17771:1876039508915072:192.168.203.11@tcp:104: 00010000:00010000:2.0:1789131169.419003:0:17771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030200/0xf3fe2838e1fc3a22 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269e7a expref: 34 pid: 17773 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131169.419015:0:17771:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7ffcf00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17771:1876039508915200:192.168.203.11@tcp:104: 00010000:00010000:2.0:1789131169.419053:0:17771:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78df200/0xf3fe2838e1fc3afb lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131169.419064:0:17771:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78df200/0xf3fe2838e1fc3afb lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131169.419071:0:17771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78df200/0xf3fe2838e1fc3afb lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789131169.419095:0:17771:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00010000:00010000:2.0:1789131169.419261:0:17771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78de000/0xf3fe2838e1fc3af4 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269ec0 expref: 35 pid: 17771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131169.419277:0:17771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78df200/0xf3fe2838e1fc3afb lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269ec0 expref: 34 pid: 17771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131169.419284:0:17771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91dcc6c0f600) 00010000:00010000:2.0:1789131169.419286:0:17771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789131169.419289:0:17771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dcc78df200, rc 0) 00000100:00100000:2.0:1789131169.419339:0:17771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc5f91e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+34:15956:x1876039498343552:12345-192.168.203.11@tcp:101:bash.0 Request processed in 8656us (9012us total) trans 8589934616 rc 0/0 00000100:00100000:2.0:1789131169.419347:0:17771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 50 00000100:00100000:0.0:1789131169.422660:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131169.423008:0:19096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498344064 00000100:00100000:2.0:1789131169.423020:0:19096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498344064 00000100:00100000:2.0:1789131169.423113:0:19096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 51 00000100:00100000:2.0:1789131169.423125:0:19096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff7c3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+34:15956:x1876039498344064:12345-192.168.203.11@tcp:36:bash.0 00010000:00010000:2.0:1789131169.423408:0:19096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78df400/0xf3fe2838e1fc3b09 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131169.423432:0:19096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78df400/0xf3fe2838e1fc3b09 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131169.423446:0:19096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78df400/0xf3fe2838e1fc3b09 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789131169.424206:0:19096:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000004:00010000:2.0:1789131169.424243:0:19096:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000007d1c8b56 reply state 00000000ce898ca0 transno 8589934618 ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78df400/0xf3fe2838e1fc3b09 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131169.424261:0:19096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78df400/0xf3fe2838e1fc3b09 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131169.424270:0:19096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91dcc6c0f600) 00010000:00010000:2.0:1789131169.424273:0:19096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789131169.424278:0:19096:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789131169.424398:0:19096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff7c3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+37:15956:x1876039498344064:12345-192.168.203.11@tcp:36:bash.0 Request processed in 1273us (1749us total) trans 8589934618 rc 0/0 00000100:00100000:2.0:1789131169.424407:0:19096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 51 00000020:00080000:2.0:1789131169.424413:0:19096:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789131169.430370:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131169.430486:0:17772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498344192 00000100:00100000:2.0:1789131169.430502:0:17772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498344192 00000100:00100000:2.0:1789131169.430578:0:17772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 52 00000100:00100000:2.0:1789131169.430589:0:17772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff7c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+37:15956:x1876039498344192:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:2.0:1789131169.430630:0:17772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789131169.430676:0:17772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78df800/0xf3fe2838e1fc3b10 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269ec7 expref: -99 pid: 17772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131169.430746:0:17772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78df800/0xf3fe2838e1fc3b10 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269ec7 expref: 38 pid: 17772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131169.430771:0:17772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78df800/0xf3fe2838e1fc3b10 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269ec7 expref: 38 pid: 17772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131169.430791:0:17772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91dcc6c0f600) 00010000:00010000:2.0:1789131169.430795:0:17772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789131169.430800:0:17772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dcc78df800, rc 0) 00000100:00100000:2.0:1789131169.430866:0:17772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff7c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+38:15956:x1876039498344192:12345-192.168.203.11@tcp:101:bash.0 Request processed in 278us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131169.430874:0:17772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 52 00000100:00100000:3.0:1789131169.442147:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131169.442347:0:17773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498344320 00000100:00100000:0.0:1789131169.442360:0:17773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498344320 00000100:00100000:0.0:1789131169.442441:0:17773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 53 00000100:00100000:0.0:1789131169.442453:0:17773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff753480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+38:15956:x1876039498344320:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:0.0:1789131169.442515:0:17773:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789131169.442543:0:17773:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5e00/0xf3fe2838e1fc3b17 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269ece expref: -99 pid: 17773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131169.442667:0:17773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4400/0xf3fe2838e1fc3b1e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 17773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131169.442684:0:17773:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78df200/0xf3fe2838e1fc3afb lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269ec0 expref: 39 pid: 17771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131169.442720:0:17773:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4400/0xf3fe2838e1fc3b1e lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 17773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131169.442776:0:17773:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78df200/0xf3fe2838e1fc3afb lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269ec0 expref: 39 pid: 17771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131169.442792:0:17773:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78df200/0xf3fe2838e1fc3afb lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269ec0 expref: 39 pid: 17771 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131169.443345:0:17773:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff7c1680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17773:1876039508915328:192.168.203.11@tcp:104: 00000100:00100000:0.0:1789131169.443507:0:17773:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddcf4e26c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789131169.457133:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789131169.457356:0:17756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498344448 00000100:00100000:1.0:1789131169.457367:0:17756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498344448 00010000:00010000:1.0:1789131169.457418:0:17756:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78df200/0xf3fe2838e1fc3afb lrc: 5/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269ec0 expref: 40 pid: 17771 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131169.457512:0:17756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 19 00000100:00100000:1.0:1789131169.457524:0:17756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff7c0f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+40:2387:x1876039498344448:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789131169.457544:0:17756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789131169.457552:0:17756:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78df200/0xf3fe2838e1fc3afb lrc: 5/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269ec0 expref: 40 pid: 17771 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131169.457590:0:17756:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78df200/0xf3fe2838e1fc3afb lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269ec0 expref: 40 pid: 17771 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131169.457832:0:17756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91dcc6c0f600) 00010000:00010000:1.0:1789131169.457839:0:17756:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4400/0xf3fe2838e1fc3b1e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 17773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131169.457852:0:17756:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4400/0xf3fe2838e1fc3b1e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 17773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131169.457861:0:17756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4400/0xf3fe2838e1fc3b1e lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 17773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131169.457888:0:17756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789131169.458066:0:17773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78df200/0xf3fe2838e1fc3afb lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269ec0 expref: 40 pid: 17771 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131169.458088:0:17773:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff7c1680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17773:1876039508915328:192.168.203.11@tcp:104: 00010000:00010000:3.0:1789131169.458112:0:17773:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4400/0xf3fe2838e1fc3b1e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131169.458122:0:17773:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4400/0xf3fe2838e1fc3b1e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131169.458127:0:17773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4400/0xf3fe2838e1fc3b1e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17773 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789131169.458205:0:17773:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1789131169.458210:0:17773:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789131169.458237:0:17773:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4400/0xf3fe2838e1fc3b1e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131169.458273:0:17773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b5e00/0xf3fe2838e1fc3b17 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269ece expref: 40 pid: 17773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131169.458288:0:17773:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4400/0xf3fe2838e1fc3b1e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269ece expref: 39 pid: 17773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131169.458295:0:17773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91dcc6c0f600) 00010000:00010000:3.0:1789131169.458298:0:17773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789131169.458300:0:17773:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ddfd0b4400, rc 0) 00000100:00100000:1.0:1789131169.458346:0:17756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff7c0f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+39:2387:x1876039498344448:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 824us (1228us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131169.458354:0:17756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 19 00000100:00100000:3.0:1789131169.461844:0:17773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff753480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+38:15956:x1876039498344320:12345-192.168.203.11@tcp:101:bash.0 Request processed in 19375us (19692us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131169.461900:0:17773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 53 00000100:00100000:1.0:1789131169.470907:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131169.471138:0:18530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498344704 00000100:00100000:2.0:1789131169.471151:0:18530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498344704 00000100:00100000:2.0:1789131169.471242:0:18530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 3 00000100:00100000:2.0:1789131169.471255:0:18530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc5f93480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+38:15956:x1876039498344704:12345-192.168.203.11@tcp:103:bash.0 00010000:00010000:2.0:1789131169.471274:0:18530:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1789131169.471304:0:18530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78df800/0xf3fe2838e1fc3b10 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269ec7 expref: 38 pid: 17772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131169.471330:0:18530:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4400/0xf3fe2838e1fc3b1e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269ece expref: 37 pid: 17773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131169.471341:0:18530:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91dcc6c0f600) 00010000:00010000:2.0:1789131169.471365:0:18530:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789131169.471439:0:18530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc5f93480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+36:15956:x1876039498344704:12345-192.168.203.11@tcp:103:bash.0 Request processed in 186us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131169.471450:0:18530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 3 00000100:00100000:2.0:1789131169.475843:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131169.475998:0:17771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498344832 00000100:00100000:3.0:1789131169.476010:0:17771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498344832 00000100:00100000:3.0:1789131169.476085:0:17771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 54 00000100:00100000:3.0:1789131169.476096:0:17771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7ffcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+36:15956:x1876039498344832:12345-192.168.203.11@tcp:58:bash.0 00010000:00010000:3.0:1789131169.476246:0:17771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030400/0xf3fe2838e1fc3b25 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131169.476268:0:17771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030400/0xf3fe2838e1fc3b25 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131169.476282:0:17771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030400/0xf3fe2838e1fc3b25 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789131169.488840:0:17771:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789131169.492764:0:17771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:3.0:1789131169.493239:0:17771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:3.0:1789131169.494119:0:17771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7ffcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+36:15956:x1876039498344832:12345-192.168.203.11@tcp:58:bash.0 Request processed in 17359us (17624us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131169.494136:0:17771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 54 00000100:00100000:1.0:1789131169.498508:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131169.498627:0:19096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498344960 00000100:00100000:2.0:1789131169.498639:0:19096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498344960 00000100:00100000:2.0:1789131169.498711:0:19096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 55 00000100:00100000:2.0:1789131169.498724:0:19096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc5f912c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+36:15956:x1876039498344960:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:2.0:1789131169.498761:0:19096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789131169.498790:0:19096:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78df800/0xf3fe2838e1fc3b2c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269ed5 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131169.498859:0:19096:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030400/0xf3fe2838e1fc3b25 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131169.498872:0:19096:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78df800/0xf3fe2838e1fc3b2c lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269ed5 expref: 37 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131169.498898:0:19096:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030400/0xf3fe2838e1fc3b25 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131169.498914:0:19096:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78df800/0xf3fe2838e1fc3b2c lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269ed5 expref: 37 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131169.498932:0:19096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91dcc6c0f600) 00010000:00010000:2.0:1789131169.498935:0:19096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789131169.498939:0:19096:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78df800/0xf3fe2838e1fc3b2c lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269ed5 expref: 37 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131169.498978:0:19096:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dcc78df800, rc 0) 00000100:00100000:2.0:1789131169.499054:0:19096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc5f912c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+37:15956:x1876039498344960:12345-192.168.203.11@tcp:101:bash.0 Request processed in 331us (599us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131169.499061:0:19096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 55 00010000:00010000:1.0:1789131169.809839:0:17760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789131170.194178:0:17805:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789131170.194191:0:17805:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789131170.194222:0:17805:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1789131170.194235:0:17805:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1789131170.194404:0:17805:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff7512c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17805:1876039508915456:192.168.203.11@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789131170.194586:0:17805:0:(client.c:2715:ptlrpc_set_wait()) set ffff91dcc7fab3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789131170.204976:0:17805:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff7512c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17805:1876039508915456:192.168.203.11@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789131170.212431:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131170.212828:0:17772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498345088 00000100:00100000:2.0:1789131170.212842:0:17772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498345088 00000100:00100000:2.0:1789131170.212922:0:17772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 56 00000100:00100000:2.0:1789131170.212934:0:17772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff7c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+37:15957:x1876039498345088:12345-192.168.203.11@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789131170.212987:0:17772:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789131170.213411:0:17772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff7c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+37:15957:x1876039498345088:12345-192.168.203.11@tcp:53:lhsmtool_posix.0 Request processed in 477us (1001us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131170.213421:0:17772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 56 00000100:00100000:3.0:1789131170.216957:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131170.217185:0:19096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498345216 00000100:00100000:2.0:1789131170.217199:0:19096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498345216 00000100:00100000:2.0:1789131170.217279:0:19096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 57 00000100:00100000:2.0:1789131170.217291:0:19096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff7512c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+37:15957:x1876039498345216:12345-192.168.203.11@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1789131170.217392:0:19096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78dea00/0xf3fe2838e1fc3b33 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131170.217415:0:19096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78dea00/0xf3fe2838e1fc3b33 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131170.217433:0:19096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78dea00/0xf3fe2838e1fc3b33 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131170.217450:0:19096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78dfc00/0xf3fe2838e1fc3b3a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131170.217508:0:19096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78dfc00/0xf3fe2838e1fc3b3a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131170.217516:0:19096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78dfc00/0xf3fe2838e1fc3b3a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131170.217545:0:19096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78dee00/0xf3fe2838e1fc3b41 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131170.217555:0:19096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78dee00/0xf3fe2838e1fc3b41 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131170.217561:0:19096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78dee00/0xf3fe2838e1fc3b41 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789131170.217619:0:19096:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1789131170.217625:0:19096:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789131170.217644:0:19096:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78dee00/0xf3fe2838e1fc3b41 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131170.217656:0:19096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78dea00/0xf3fe2838e1fc3b33 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131170.217662:0:19096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78dea00/0xf3fe2838e1fc3b33 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131170.217670:0:19096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78dea00/0xf3fe2838e1fc3b33 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131170.217677:0:19096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc78dea00 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:2.0:1789131170.217682:0:19096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78dea00/0xf3fe2838e1fc3b33 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131170.217697:0:19096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78dea00/0xf3fe2838e1fc3b33 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131170.217711:0:19096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff91ddc4c81700) 00010000:00010000:2.0:1789131170.217714:0:19096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789131170.217720:0:19096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78dea00/0xf3fe2838e1fc3b33 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131170.217726:0:19096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78dea00/0xf3fe2838e1fc3b33 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131170.217741:0:19096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78dfc00/0xf3fe2838e1fc3b3a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131170.217767:0:19096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78dfc00/0xf3fe2838e1fc3b3a lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131170.217775:0:19096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78dfc00/0xf3fe2838e1fc3b3a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131170.217780:0:19096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc78dfc00 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:2.0:1789131170.217783:0:19096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78dfc00/0xf3fe2838e1fc3b3a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131170.217790:0:19096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78dfc00/0xf3fe2838e1fc3b3a lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131170.217797:0:19096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff91dcc7d6c300) 00010000:00010000:2.0:1789131170.217800:0:19096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789131170.217803:0:19096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78dfc00/0xf3fe2838e1fc3b3a lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131170.217820:0:19096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78dfc00/0xf3fe2838e1fc3b3a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131170.217837:0:19096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78dee00/0xf3fe2838e1fc3b41 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131170.217844:0:19096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78dee00/0xf3fe2838e1fc3b41 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131170.217851:0:19096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78dee00/0xf3fe2838e1fc3b41 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131170.217856:0:19096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc78dee00 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:2.0:1789131170.217859:0:19096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78dee00/0xf3fe2838e1fc3b41 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131170.217865:0:19096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78dee00/0xf3fe2838e1fc3b41 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131170.217873:0:19096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91dcc6c0f600) 00010000:00010000:2.0:1789131170.217875:0:19096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789131170.217879:0:19096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78dee00/0xf3fe2838e1fc3b41 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131170.217884:0:19096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78dee00/0xf3fe2838e1fc3b41 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131170.217987:0:19096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff7512c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+37:15957:x1876039498345216:12345-192.168.203.11@tcp:34:lhsmtool_posix.0 Request processed in 697us (1047us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131170.217997:0:19096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 57 00000100:00100000:1.0:1789131170.221305:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131170.221743:0:17771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498345472 00000100:00100000:3.0:1789131170.221764:0:17771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498345472 00000100:00100000:3.0:1789131170.221842:0:17771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 58 00000100:00100000:3.0:1789131170.221855:0:17771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc5f903c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+37:15957:x1876039498345472:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789131170.221884:0:17771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789131170.221912:0:17771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030800/0xf3fe2838e1fc3b48 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269edc expref: -99 pid: 17771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131170.222205:0:17771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0031a00/0xf3fe2838e1fc3b4f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131170.222225:0:17771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0031a00/0xf3fe2838e1fc3b4f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131170.222240:0:17771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0031a00/0xf3fe2838e1fc3b4f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789131170.222255:0:17771:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1789131170.222381:0:17771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0031a00/0xf3fe2838e1fc3b4f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131170.222390:0:17771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0031a00/0xf3fe2838e1fc3b4f lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131170.222398:0:17771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0031a00/0xf3fe2838e1fc3b4f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131170.222404:0:17771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddc0031a00 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:3.0:1789131170.222410:0:17771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0031a00/0xf3fe2838e1fc3b4f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131170.223237:0:17771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0031a00/0xf3fe2838e1fc3b4f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131170.223254:0:17771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91dcc6c0f600) 00010000:00010000:3.0:1789131170.223258:0:17771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789131170.223264:0:17771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0031a00/0xf3fe2838e1fc3b4f lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131170.223271:0:17771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0031a00/0xf3fe2838e1fc3b4f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131170.223359:0:17771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030800/0xf3fe2838e1fc3b48 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269edc expref: 39 pid: 17771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131170.223372:0:17771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff91ddc4c81700) 00010000:00010000:3.0:1789131170.223375:0:17771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789131170.223379:0:17771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030800/0xf3fe2838e1fc3b48 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269edc expref: 39 pid: 17771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131170.223389:0:17771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ddc0030800, rc 0) 00000100:00100000:3.0:1789131170.223532:0:17771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc5f903c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+38:15957:x1876039498345472:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 1679us (2242us total) trans 8589934619 rc 301/301 00000100:00100000:3.0:1789131170.223542:0:17771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 58 00000100:00100000:0.0:1789131170.226853:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131170.226952:0:19096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498345600 00000100:00100000:2.0:1789131170.226974:0:19096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498345600 00000100:00100000:2.0:1789131170.227050:0:19096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 59 00000100:00100000:2.0:1789131170.227062:0:19096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff7c2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+38:15957:x1876039498345600:12345-192.168.203.11@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789131170.227111:0:19096:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789131170.227265:0:19096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff7c2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+38:15957:x1876039498345600:12345-192.168.203.11@tcp:53:lhsmtool_posix.0 Request processed in 203us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131170.227274:0:19096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 59 00000100:00100000:0.0:1789131170.233342:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131170.233441:0:17772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498345856 00000100:00100000:2.0:1789131170.233494:0:17772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498345856 00000100:00100000:2.0:1789131170.233568:0:17772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 60 00000100:00100000:2.0:1789131170.233580:0:17772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff7c0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+38:15957:x1876039498345856:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789131170.233620:0:17772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789131170.233647:0:17772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78de200/0xf3fe2838e1fc3b5d lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269ee3 expref: -99 pid: 17772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789131170.234330:0:17772:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x7:0x0], count =27 00000004:00080000:2.0:1789131170.234338:0:17772:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000401:0x7:0x0]+27 in llog 00000004:00080000:2.0:1789131170.234366:0:17772:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x22:0x0], index 1: 0 00010000:00010000:2.0:1789131170.234589:0:17772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78df600/0xf3fe2838e1fc3b64 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131170.234607:0:17772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78df600/0xf3fe2838e1fc3b64 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131170.234620:0:17772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78df600/0xf3fe2838e1fc3b64 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131170.234690:0:17772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78de200/0xf3fe2838e1fc3b5d lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269ee3 expref: 41 pid: 17772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131170.234730:0:17772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78df600/0xf3fe2838e1fc3b64 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269ee3 expref: 40 pid: 17772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131170.234740:0:17772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff91dcc7d6ca00) 00010000:00010000:2.0:1789131170.234743:0:17772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789131170.234760:0:17772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dcc78df600, rc 0) 00000100:00100000:2.0:1789131170.234840:0:17772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff7c0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+40:15957:x1876039498345856:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 1261us (1512us total) trans 8589934620 rc 0/0 00000100:00100000:2.0:1789131170.234850:0:17772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 60 00000100:00100000:1.0:1789131170.247741:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131170.247864:0:19096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498346112 00000100:00100000:2.0:1789131170.247877:0:19096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498346112 00000100:00100000:2.0:1789131170.247953:0:19096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 61 00000100:00100000:2.0:1789131170.248219:0:19096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc5f92580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+40:15957:x1876039498346112:12345-192.168.203.11@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789131170.248293:0:19096:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789131170.248330:0:19096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78df600/0xf3fe2838e1fc3b64 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269ee3 expref: 40 pid: 17772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131170.248354:0:19096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff91dcc7d6ca00) 00010000:00010000:2.0:1789131170.248368:0:19096:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789131170.248396:0:19096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78de200/0xf3fe2838e1fc3b72 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131170.249096:0:19096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78de200/0xf3fe2838e1fc3b72 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131170.249114:0:19096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78de200/0xf3fe2838e1fc3b72 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131170.251447:0:19096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78dee00/0xf3fe2838e1fc3b79 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xae576c57 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131170.251504:0:19096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78dee00/0xf3fe2838e1fc3b79 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xae576c57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131170.251517:0:19096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78dee00/0xf3fe2838e1fc3b79 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xae576c57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131170.251571:0:19096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78de200/0xf3fe2838e1fc3b72 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131170.251578:0:19096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78de200/0xf3fe2838e1fc3b72 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131170.251585:0:19096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78de200/0xf3fe2838e1fc3b72 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131170.251590:0:19096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc78de200 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:2.0:1789131170.251594:0:19096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78de200/0xf3fe2838e1fc3b72 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131170.251602:0:19096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78de200/0xf3fe2838e1fc3b72 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131170.251614:0:19096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff91dcc7d6cd00) 00010000:00010000:2.0:1789131170.251618:0:19096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789131170.251622:0:19096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78de200/0xf3fe2838e1fc3b72 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131170.251628:0:19096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78de200/0xf3fe2838e1fc3b72 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131170.251660:0:19096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78dee00/0xf3fe2838e1fc3b79 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xae576c57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131170.251667:0:19096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78dee00/0xf3fe2838e1fc3b79 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xae576c57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131170.251674:0:19096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78dee00/0xf3fe2838e1fc3b79 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xae576c57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131170.251679:0:19096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc78dee00 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:2.0:1789131170.251683:0:19096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78dee00/0xf3fe2838e1fc3b79 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xae576c57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131170.251690:0:19096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78dee00/0xf3fe2838e1fc3b79 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xae576c57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131170.251699:0:19096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xae576c57 (ffff91dcc7d6c300) 00010000:00010000:2.0:1789131170.251701:0:19096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789131170.251704:0:19096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78dee00/0xf3fe2838e1fc3b79 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xae576c57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131170.251710:0:19096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78dee00/0xf3fe2838e1fc3b79 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xae576c57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131170.251832:0:19096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc5f92580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+39:15957:x1876039498346112:12345-192.168.203.11@tcp:36:lhsmtool_posix.0 Request processed in 3866us (4101us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789131170.251841:0:19096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 61 00000100:00100000:0.0:1789131170.270987:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131170.271109:0:17772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498346240 00000100:00100000:2.0:1789131170.271118:0:17772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498346240 00000100:00100000:2.0:1789131170.271183:0:17772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 62 00000100:00100000:2.0:1789131170.271216:0:17772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff7c1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+39:15957:x1876039498346240:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789131170.271235:0:17772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789131170.271265:0:17772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78dee00/0xf3fe2838e1fc3b80 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269eea expref: -99 pid: 17772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131170.271297:0:17772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78de200/0xf3fe2838e1fc3b87 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131170.271311:0:17772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78de200/0xf3fe2838e1fc3b87 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131170.271321:0:17772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78de200/0xf3fe2838e1fc3b87 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131170.271444:0:17772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78dee00/0xf3fe2838e1fc3b80 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269eea expref: 41 pid: 17772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131170.271498:0:17772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78de200/0xf3fe2838e1fc3b87 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269eea expref: 40 pid: 17772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131170.271507:0:17772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff91dcc7d6c300) 00010000:00010000:2.0:1789131170.271510:0:17772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789131170.271513:0:17772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dcc78de200, rc 0) 00000100:00100000:2.0:1789131170.271567:0:17772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff7c1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+40:15957:x1876039498346240:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 363us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131170.271575:0:17772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 62 00000100:00100000:0.0:1789131170.273713:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131170.274110:0:17773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498346496 00000100:00100000:3.0:1789131170.274120:0:17773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498346496 00000100:00100000:3.0:1789131170.274176:0:17773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 63 00000100:00100000:3.0:1789131170.274186:0:17773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff7c2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+40:15957:x1876039498346496:12345-192.168.203.11@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789131170.274294:0:17773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030800/0xf3fe2838e1fc3b8e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131170.274311:0:17773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030800/0xf3fe2838e1fc3b8e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131170.274811:0:17773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030800/0xf3fe2838e1fc3b8e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17773 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789131170.274969:0:17773:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:3.0:1789131170.274978:0:17773:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 526192518775ns, next at 527192516594ns, rc = 0 00000004:00010000:3.0:1789131170.275023:0:17773:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000d1f693ff reply state 0000000050e0a6a2 transno 8589934621 ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030800/0xf3fe2838e1fc3b8e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131170.275036:0:17773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030800/0xf3fe2838e1fc3b8e lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131170.275043:0:17773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff91dcc7d6c300) 00010000:00010000:3.0:1789131170.275045:0:17773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1789131170.275049:0:17773:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789131170.275160:0:17773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff7c2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+42:15957:x1876039498346496:12345-192.168.203.11@tcp:36:lhsmtool_posix.0 Request processed in 973us (1454us total) trans 8589934621 rc 0/0 00000100:00100000:3.0:1789131170.275168:0:17773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 63 00000100:00100000:3.0:1789131170.283444:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131170.285745:0:17772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498346624 00000100:00100000:2.0:1789131170.285770:0:17772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498346624 00000100:00100000:0.0:1789131170.287777:0:17772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 64 00000100:00100000:0.0:1789131170.287791:0:17772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7c6b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+42:15957:x1876039498346624:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789131170.287815:0:17772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789131170.287838:0:17772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4200/0xf3fe2838e1fc3b95 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269ef1 expref: -99 pid: 17772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131170.287893:0:17772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4200/0xf3fe2838e1fc3b95 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269ef1 expref: 43 pid: 17772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131170.287929:0:17772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4200/0xf3fe2838e1fc3b95 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269ef1 expref: 43 pid: 17772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131170.287949:0:17772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff91dcc7d6c300) 00010000:00010000:0.0:1789131170.287952:0:17772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789131170.287955:0:17772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ddfd0b4200, rc 0) 00000100:00100000:0.0:1789131170.288033:0:17772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7c6b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+43:15957:x1876039498346624:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 245us (4597us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131170.288041:0:17772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 64 00000100:00100000:0.0:1789131170.297792:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789131170.297888:0:20403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498346752 00000100:00100000:1.0:1789131170.297898:0:20403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498346752 00000100:00100000:1.0:1789131170.297982:0:20403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 20 00000100:00100000:1.0:1789131170.297993:0:20403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff7c0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+5:2385:x1876039498346752:12345-192.168.203.11@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1789131170.298275:0:20403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff7c0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+6:2385:x1876039498346752:12345-192.168.203.11@tcp:2:lhsmtool_posix.0 Request processed in 283us (492us total) trans 8589934595 rc 0/0 00000100:00100000:1.0:1789131170.298289:0:20403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 20 00000100:00080000:2.0:1789131170.298488:0:17767:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789131170.303850:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131170.305086:0:17775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498347008 00000100:00100000:3.0:1789131170.305099:0:17775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498347008 00000100:00100000:3.0:1789131170.305156:0:17775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 11 00000100:00100000:3.0:1789131170.305166:0:17775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc5f91a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+43:15957:x1876039498347008:12345-192.168.203.11@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789131170.306717:0:17775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc5f91a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+44:15957:x1876039498347008:12345-192.168.203.11@tcp:35:lhsmtool_posix.0 Request processed in 1544us (2866us total) trans 8589934622 rc 0/0 00000100:00100000:3.0:1789131170.306739:0:17775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 11 00000100:00100000:3.0:1789131170.309255:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131170.309360:0:19096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498347264 00000100:00100000:2.0:1789131170.309383:0:19096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498347264 00000100:00100000:2.0:1789131170.309486:0:19096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 65 00000100:00100000:2.0:1789131170.309498:0:19096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddca0f9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+44:15957:x1876039498347264:12345-192.168.203.11@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789131170.309620:0:19096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddca0f9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+44:15957:x1876039498347264:12345-192.168.203.11@tcp:57:lhsmtool_posix.0 Request processed in 124us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131170.309628:0:19096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 65 00000100:00100000:0.0:1789131170.313038:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131170.313192:0:17771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498347392 00000100:00100000:3.0:1789131170.313207:0:17771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498347392 00000100:00100000:3.0:1789131170.313289:0:17771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 66 00000100:00100000:3.0:1789131170.313301:0:17771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff7c2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+44:15957:x1876039498347392:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789131170.313328:0:17771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789131170.313355:0:17771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0031a00/0xf3fe2838e1fc3b9c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269ef8 expref: -99 pid: 17771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131170.313644:0:17771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030200/0xf3fe2838e1fc3ba3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131170.313662:0:17771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030200/0xf3fe2838e1fc3ba3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131170.313676:0:17771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030200/0xf3fe2838e1fc3ba3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789131170.313731:0:17771:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789131170.313765:0:17771:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030200/0xf3fe2838e1fc3ba3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131170.313798:0:17771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0031a00/0xf3fe2838e1fc3b9c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269ef8 expref: 46 pid: 17771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131170.313820:0:17771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030200/0xf3fe2838e1fc3ba3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269ef8 expref: 45 pid: 17771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131170.313843:0:17771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff91dcc7d6c300) 00010000:00010000:3.0:1789131170.313847:0:17771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789131170.313851:0:17771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ddc0030200, rc 0) 00000100:00100000:3.0:1789131170.313929:0:17771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff7c2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+45:15957:x1876039498347392:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 630us (908us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131170.313936:0:17771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 66 00000100:00100000:2.0:1789131170.316315:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131170.316931:0:19285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498347520 00000100:00100000:3.0:1789131170.316942:0:19285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498347520 00000100:00100000:3.0:1789131170.316998:0:19285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 21 00000100:00100000:3.0:1789131170.317008:0:19285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd286c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+6:2388:x1876039498347520:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789131170.317027:0:19285:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789131170.317046:0:19285:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000008639f49/0xf3fe2838e1fc3baa lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269eff expref: -99 pid: 19285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789131170.317080:0:19285:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa3f9a1, blocks: 0x0 00010000:00010000:3.0:1789131170.317100:0:19285:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=526s v=(0 0) 00010000:00010000:3.0:1789131170.317104:0:19285:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789131170.317114:0:19285:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000008639f49/0xf3fe2838e1fc3baa lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269eff expref: 7 pid: 19285 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131170.317133:0:19285:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000008639f49/0xf3fe2838e1fc3baa lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269eff expref: 7 pid: 19285 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131170.317146:0:19285:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ddc0030000, rc 0) 00000100:00100000:3.0:1789131170.317206:0:19285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd286c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+7:2388:x1876039498347520:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 199us (900us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131170.317214:0:19285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 21 00000100:00100000:0.0:1789131170.327224:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131170.327412:0:19096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498347776 00000100:00100000:2.0:1789131170.327424:0:19096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498347776 00000100:00100000:2.0:1789131170.327535:0:19096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 67 00000100:00100000:2.0:1789131170.327551:0:19096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff7c3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+45:15957:x1876039498347776:12345-192.168.203.11@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789131170.327697:0:19096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff7c3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+45:15957:x1876039498347776:12345-192.168.203.11@tcp:57:lhsmtool_posix.0 Request processed in 151us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131170.327705:0:19096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 67 00000100:00100000:1.0:1789131170.331174:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131170.331399:0:17772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498347904 00000100:00100000:0.0:1789131170.331422:0:17772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498347904 00000100:00100000:0.0:1789131170.331609:0:17772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 68 00000100:00100000:0.0:1789131170.331624:0:17772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc5f930c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+45:15957:x1876039498347904:12345-192.168.203.11@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1789131170.336678:0:17751:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000004:00080000:2.0:1789131170.336700:0:17751:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00010000:00010000:0.0:1789131170.336839:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0031200/0xf3fe2838e1fc396c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131170.336849:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0031200/0xf3fe2838e1fc396c lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131170.336856:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0031200/0xf3fe2838e1fc396c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131170.336863:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddc0031200 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:0.0:1789131170.336867:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0031200/0xf3fe2838e1fc396c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131170.336881:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0031200/0xf3fe2838e1fc396c lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131170.336896:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff91dcc6c0f700) 00010000:00010000:0.0:1789131170.336899:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789131170.336903:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0031200/0xf3fe2838e1fc396c lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131170.336910:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0031200/0xf3fe2838e1fc396c lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131170.336932:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78df000/0xf3fe2838e1fc3973 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131170.336939:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78df000/0xf3fe2838e1fc3973 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131170.336944:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78df000/0xf3fe2838e1fc3973 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131170.336949:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc78df000 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:0.0:1789131170.336951:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78df000/0xf3fe2838e1fc3973 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131170.336957:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78df000/0xf3fe2838e1fc3973 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131170.336978:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff91dcc7d6cd00) 00010000:00010000:0.0:1789131170.336981:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789131170.336984:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78df000/0xf3fe2838e1fc3973 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131170.336998:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78df000/0xf3fe2838e1fc3973 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131170.337012:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0031600/0xf3fe2838e1fc3a1b lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131170.337018:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0031600/0xf3fe2838e1fc3a1b lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131170.337024:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0031600/0xf3fe2838e1fc3a1b lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131170.337029:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddc0031600 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:0.0:1789131170.337032:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0031600/0xf3fe2838e1fc3a1b lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131170.337038:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0031600/0xf3fe2838e1fc3a1b lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131170.337047:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff91dcc6c0fa00) 00010000:00010000:0.0:1789131170.337050:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789131170.337053:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0031600/0xf3fe2838e1fc3a1b lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131170.337059:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0031600/0xf3fe2838e1fc3a1b lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131170.337084:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78de600/0xf3fe2838e1fc3aa0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131170.337090:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78de600/0xf3fe2838e1fc3aa0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131170.337102:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78de600/0xf3fe2838e1fc3aa0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131170.337107:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc78de600 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:0.0:1789131170.337110:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78de600/0xf3fe2838e1fc3aa0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131170.337116:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78de600/0xf3fe2838e1fc3aa0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131170.337124:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91dcc6c0f600) 00010000:00010000:0.0:1789131170.337126:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789131170.337129:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78de600/0xf3fe2838e1fc3aa0 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131170.337134:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78de600/0xf3fe2838e1fc3aa0 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131170.337145:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0031400/0xf3fe2838e1fc3ac3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131170.337150:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0031400/0xf3fe2838e1fc3ac3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131170.337154:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0031400/0xf3fe2838e1fc3ac3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131170.337159:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddc0031400 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:0.0:1789131170.337161:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0031400/0xf3fe2838e1fc3ac3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131170.337178:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0031400/0xf3fe2838e1fc3ac3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131170.337185:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91dcc6c0f600) 00010000:00010000:0.0:1789131170.337187:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789131170.337189:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0031400/0xf3fe2838e1fc3ac3 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131170.337194:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0031400/0xf3fe2838e1fc3ac3 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131170.337204:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78df400/0xf3fe2838e1fc3b09 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131170.337209:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78df400/0xf3fe2838e1fc3b09 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131170.337214:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78df400/0xf3fe2838e1fc3b09 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131170.337218:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91dcc78df400 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:0.0:1789131170.337221:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78df400/0xf3fe2838e1fc3b09 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131170.337226:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78df400/0xf3fe2838e1fc3b09 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131170.337232:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91dcc6c0f600) 00010000:00010000:0.0:1789131170.337234:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789131170.337237:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78df400/0xf3fe2838e1fc3b09 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131170.337252:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78df400/0xf3fe2838e1fc3b09 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131170.337263:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030800/0xf3fe2838e1fc3b8e lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131170.337269:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030800/0xf3fe2838e1fc3b8e lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131170.337275:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030800/0xf3fe2838e1fc3b8e lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131170.337280:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddc0030800 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:0.0:1789131170.337283:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030800/0xf3fe2838e1fc3b8e lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131170.337288:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030800/0xf3fe2838e1fc3b8e lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131170.337295:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff91dcc7d6c300) 00010000:00010000:0.0:1789131170.337297:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789131170.337300:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030800/0xf3fe2838e1fc3b8e lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131170.337306:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030800/0xf3fe2838e1fc3b8e lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17773 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131170.337849:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789131170.337869:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7b7a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1876039508915584:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1789131170.337933:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131170.338183:0:19981:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508915584 00000100:00100000:3.0:1789131170.338191:0:19981:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508915584 00000100:00100000:3.0:1789131170.338256:0:19981:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789131170.338266:0:19981:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc5f92940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3628:x1876039508915584:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1789131170.338397:0:19981:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1789131170.338401:0:19981:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1789131170.338402:0:19981:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1789131170.338404:0:19981:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1789131169 -> 1789131169 00002000:00010000:3.0:1789131170.338406:0:19981:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1789131170.338624:0:19981:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc5f92940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3628:x1876039508915584:12345-0@lo:2:osp-syn-1-0.0 Request processed in 359us (690us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1789131170.338632:0:19981:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000004:00080000:1.0:1789131170.338718:0:3628:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff91dcc7b7a940/2, rc 0, transno 8589934596 00000100:00100000:1.0:1789131170.338724:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7b7a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1876039508915584:0@lo:2:osp-syn-1-0.0 00000100:00080000:0.0:1789131170.338791:0:17767:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:2.0:1789131170.338932:0:17751:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:0.0:1789131170.339168:0:17772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc5f930c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+14:15957:x1876039498347904:12345-192.168.203.11@tcp:44:lhsmtool_posix.0 Request processed in 7547us (8000us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131170.339177:0:17772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 68 00010000:00010000:1.0:1789131170.341267:0:3612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030c00/0xf3fe2838e1fc39c0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131170.341281:0:3612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030c00/0xf3fe2838e1fc39c0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131170.341289:0:3612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030c00/0xf3fe2838e1fc39c0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131170.341295:0:3612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddc0030c00 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:1.0:1789131170.341299:0:3612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030c00/0xf3fe2838e1fc39c0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131170.341307:0:3612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030c00/0xf3fe2838e1fc39c0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131170.341323:0:3612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff91dcc7d6cd00) 00010000:00010000:1.0:1789131170.341326:0:3612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1789131170.341331:0:3612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030c00/0xf3fe2838e1fc39c0 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131170.341348:0:3612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030c00/0xf3fe2838e1fc39c0 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17773 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131170.342723:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131170.342816:0:19283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498348032 00000100:00100000:0.0:1789131170.342826:0:19283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498348032 00000100:00100000:0.0:1789131170.342914:0:19283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 23 00000100:00100000:0.0:1789131170.342924:0:19283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dde6e6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+7:2387:x1876039498348032:12345-192.168.203.11@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1789131170.343068:0:19283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dde6e6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+7:2387:x1876039498348032:12345-192.168.203.11@tcp:16:lhsmtool_posix.0 Request processed in 138us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131170.343081:0:19283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 23 00000100:00100000:2.0:1789131170.350903:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131170.351728:0:17773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498348288 00000100:00100000:3.0:1789131170.351740:0:17773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498348288 00000100:00100000:3.0:1789131170.351852:0:17773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 69 00000100:00100000:3.0:1789131170.351863:0:17773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd286d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+14:15957:x1876039498348288:12345-192.168.203.11@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789131170.351912:0:17773:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789131170.351939:0:17773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030200/0xf3fe2838e1fc3ba3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269ef8 expref: 14 pid: 17771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131170.351956:0:17773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff91dcc7d6c300) 00010000:00010000:3.0:1789131170.351961:0:17773:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789131170.351990:0:17773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0031a00/0xf3fe2838e1fc3bb1 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131170.352020:0:17773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0031a00/0xf3fe2838e1fc3bb1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131170.352030:0:17773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0031a00/0xf3fe2838e1fc3bb1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17773 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789131170.352161:0:17773:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000b71b7085 reply state 000000001daa154b transno 8589934623 ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0031a00/0xf3fe2838e1fc3bb1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131170.352174:0:17773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0031a00/0xf3fe2838e1fc3bb1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131170.352181:0:17773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff91dcc7d6c300) 00010000:00010000:3.0:1789131170.352184:0:17773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789131170.352187:0:17773:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789131170.352283:0:17773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd286d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+15:15957:x1876039498348288:12345-192.168.203.11@tcp:36:lhsmtool_posix.0 Request processed in 421us (1389us total) trans 8589934623 rc 0/0 00000100:00100000:3.0:1789131170.352290:0:17773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 69 00000100:00100000:0.0:1789131170.355956:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131170.356205:0:19284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498348416 00000100:00100000:2.0:1789131170.356214:0:19284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498348416 00000100:00100000:2.0:1789131170.356301:0:19284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 24 00000100:00100000:2.0:1789131170.356311:0:19284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff7c0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+7:15957:x1876039498348416:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789131170.356329:0:19284:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789131170.356347:0:19284:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000048e5bf12/0xf3fe2838e1fc3bb8 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269f06 expref: -99 pid: 19284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131170.356401:0:19284:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000008639f49/0xf3fe2838e1fc3baa lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269eff expref: 8 pid: 19285 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131170.356410:0:19284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789131170.356414:0:19284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789131170.356429:0:19284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048e5bf12/0xf3fe2838e1fc3bb8 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269f06 expref: 8 pid: 19284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131170.356557:0:19284:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000008639f49/0xf3fe2838e1fc3baa lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269eff expref: 8 pid: 19285 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131170.356572:0:19284:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000008639f49/0xf3fe2838e1fc3baa lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269eff expref: 8 pid: 19285 timeout: 626 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131170.356586:0:19284:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd286cb40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:19284:1876039508915712:192.168.203.11@tcp:104: 00000100:00100000:2.0:1789131170.356665:0:19284:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddd0683480 going to sleep for 11 seconds 00000100:00100000:2.0:1789131170.360793:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131170.360997:0:17758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498348544 00000100:00100000:0.0:1789131170.361006:0:17758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498348544 00010000:00010000:0.0:1789131170.361045:0:17758:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000008639f49/0xf3fe2838e1fc3baa lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269eff expref: 9 pid: 19285 timeout: 626 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131170.361096:0:17758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 20 00000100:00100000:0.0:1789131170.361106:0:17758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd286d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+9:2387:x1876039498348544:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789131170.361119:0:17758:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789131170.361138:0:17758:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000008639f49/0xf3fe2838e1fc3baa lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269eff expref: 9 pid: 19285 timeout: 626 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131170.361152:0:17758:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000008639f49/0xf3fe2838e1fc3baa lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269eff expref: 9 pid: 19285 timeout: 626 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131170.361177:0:17758:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789131170.361181:0:17758:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789131170.361189:0:17758:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000048e5bf12/0xf3fe2838e1fc3bb8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269f06 expref: 9 pid: 19284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131170.361217:0:17758:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048e5bf12/0xf3fe2838e1fc3bb8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269f06 expref: 9 pid: 19284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131170.361253:0:17758:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000048e5bf12/0xf3fe2838e1fc3bb8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269f06 expref: 9 pid: 19284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131170.361267:0:17758:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff7c30c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:17758:1876039508915840:192.168.203.11@tcp:105: 00000100:00100000:0.0:1789131170.361343:0:17758:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddcf4e26c0 going to sleep for 11 seconds 00010000:00010000:3.0:1789131170.361866:0:19284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000008639f49/0xf3fe2838e1fc3baa lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269eff expref: 9 pid: 19285 timeout: 626 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131170.361882:0:19284:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd286cb40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:19284:1876039508915712:192.168.203.11@tcp:104: 00010000:00010000:3.0:1789131170.361905:0:19284:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000048e5bf12/0xf3fe2838e1fc3bb8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269f06 expref: 8 pid: 19284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131170.361915:0:19284:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91dcc78df600, rc 0) 00000100:00100000:3.0:1789131170.361947:0:19284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff7c0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+8:15957:x1876039498348416:12345-192.168.203.11@tcp:101:lhsmtool_posix.0 Request processed in 5637us (6000us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131170.361970:0:19284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 24 00000100:00100000:2.0:1789131170.368765:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131170.368831:0:19981:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498348672 00000100:00100000:3.0:1789131170.368840:0:19981:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498348672 00000100:00100000:3.0:1789131170.368897:0:19981:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 25 00000100:00100000:3.0:1789131170.368907:0:19981:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd286c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+8:2388:x1876039498348672:12345-192.168.203.11@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1789131170.369048:0:19981:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1789131170.369052:0:19981:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 1789131168 00002000:00010000:3.0:1789131170.369054:0:19981:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 1789131167 00002000:00010000:3.0:1789131170.369057:0:19981:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1789131169 -> 1789131168 00002000:00010000:3.0:1789131170.369059:0:19981:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1789131170.369132:0:19981:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd286c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+9:2388:x1876039498348672:12345-192.168.203.11@tcp:2:lhsmtool_posix.0 Request processed in 227us (387us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1789131170.369141:0:19981:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 25 00000100:00100000:0.0:1789131170.370483:0:17758:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff7c30c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:17758:1876039508915840:192.168.203.11@tcp:105: 00010000:00010000:0.0:1789131170.370509:0:17758:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789131170.370558:0:17758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd286d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+8:2387:x1876039498348544:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 9453us (9775us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131170.370569:0:17758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 20 00000100:00100000:2.0:1789131170.374370:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131170.374501:0:19283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498348800 00000100:00100000:0.0:1789131170.374511:0:19283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498348800 00000100:00100000:0.0:1789131170.374558:0:19283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 26 00000100:00100000:0.0:1789131170.374567:0:19283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddd286cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+8:2385:x1876039498348800:12345-192.168.203.11@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1789131170.374614:0:19283:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008051552f/0xf3fe2838e1fc3bbf lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131170.374631:0:19283:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000048e5bf12/0xf3fe2838e1fc3bb8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269f06 expref: 8 pid: 19284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131170.374639:0:19283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789131170.374653:0:19283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789131170.374657:0:19283:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008051552f/0xf3fe2838e1fc3bbf lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131170.374688:0:19283:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000048e5bf12/0xf3fe2838e1fc3bb8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269f06 expref: 8 pid: 19284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131170.374701:0:19283:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000048e5bf12/0xf3fe2838e1fc3bb8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269f06 expref: 8 pid: 19284 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131170.374714:0:19283:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff7c30c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:19283:1876039508915968:192.168.203.11@tcp:104: 00000100:00100000:0.0:1789131170.374841:0:19283:0:(client.c:2715:ptlrpc_set_wait()) set ffff91ddcf4e26c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789131170.380031:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131170.380204:0:17757:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498348928 00000100:00100000:3.0:1789131170.380213:0:17757:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498348928 00010000:00010000:3.0:1789131170.380256:0:17757:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000048e5bf12/0xf3fe2838e1fc3bb8 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269f06 expref: 9 pid: 19284 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131170.380293:0:17757:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 21 00000100:00100000:3.0:1789131170.380303:0:17757:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01ad0780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+9:2388:x1876039498348928:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789131170.380317:0:17757:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789131170.380336:0:17757:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000048e5bf12/0xf3fe2838e1fc3bb8 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269f06 expref: 9 pid: 19284 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131170.380350:0:17757:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000048e5bf12/0xf3fe2838e1fc3bb8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269f06 expref: 9 pid: 19284 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131170.380391:0:17757:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789131170.380396:0:17757:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789131170.380402:0:17757:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008051552f/0xf3fe2838e1fc3bbf lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 19283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131170.380411:0:17757:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008051552f/0xf3fe2838e1fc3bbf lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 19283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131170.380444:0:17757:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789131170.380529:0:17757:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01ad0780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+9:2388:x1876039498348928:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 227us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131170.380538:0:17757:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 21 00010000:00010000:0.0:1789131170.382138:0:19283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000048e5bf12/0xf3fe2838e1fc3bb8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269f06 expref: 8 pid: 19284 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131170.382163:0:19283:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff7c30c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:19283:1876039508915968:192.168.203.11@tcp:104: 00010000:00010000:0.0:1789131170.382187:0:19283:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008051552f/0xf3fe2838e1fc3bbf lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131170.382199:0:19283:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008051552f/0xf3fe2838e1fc3bbf lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131170.382207:0:19283:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008051552f/0xf3fe2838e1fc3bbf lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131170.382233:0:19283:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008051552f/0xf3fe2838e1fc3bbf lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131170.382255:0:19283:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008051552f/0xf3fe2838e1fc3bbf lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131170.382263:0:19283:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008051552f/0xf3fe2838e1fc3bbf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131170.382271:0:19283:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddfd0b4400 already unused, calling callback (ffffffffc0c4e550) 00010000:00010000:0.0:1789131170.382275:0:19283:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008051552f/0xf3fe2838e1fc3bbf lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131170.382286:0:19283:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008051552f/0xf3fe2838e1fc3bbf lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131170.382303:0:19283:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008051552f/0xf3fe2838e1fc3bbf lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131170.382311:0:19283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008051552f/0xf3fe2838e1fc3bbf lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131170.382781:0:19283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddd286cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+7:2385:x1876039498348800:12345-192.168.203.11@tcp:1:lhsmtool_posix.0 Request processed in 8212us (8417us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131170.382791:0:19283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 26 00000100:00100000:1.0:1789131170.385615:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789131170.385637:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc5f90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508916096:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789131170.385703:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131170.385759:0:19286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508916096 00000100:00100000:1.0:1789131170.385767:0:19286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508916096 00000100:00100000:1.0:1789131170.385822:0:19286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789131170.385831:0:19286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc5f90780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508916096:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789131170.385859:0:19286:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1789131170.385904:0:19286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc5f90780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1876039508916096:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131170.385911:0:19286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789131170.385956:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc5f90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1876039508916096:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1789131170.385989:0:17767:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789131170.388593:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131170.388674:0:17771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498349184 00000100:00100000:3.0:1789131170.388682:0:17771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498349184 00000100:00100000:3.0:1789131170.388772:0:17771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 70 00000100:00100000:3.0:1789131170.388783:0:17771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01ad1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+15:15957:x1876039498349184:12345-192.168.203.11@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789131170.388863:0:17771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030200/0xf3fe2838e1fc3bc6 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131170.388878:0:17771:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78dec00/0xf3fe2838e1fc3a99 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269ea4 expref: 15 pid: 17771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131170.388886:0:17771:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030200/0xf3fe2838e1fc3bc6 lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131170.388919:0:17771:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78dec00/0xf3fe2838e1fc3a99 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269ea4 expref: 15 pid: 17771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131170.388948:0:17771:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78dec00/0xf3fe2838e1fc3a99 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269ea4 expref: 15 pid: 17771 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131170.388973:0:17771:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7b78780 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17771:1876039508916224:192.168.203.11@tcp:104: 00000100:00100000:3.0:1789131170.389057:0:17771:0:(client.c:2715:ptlrpc_set_wait()) set ffff91dcc7fab900 going to sleep for 11 seconds 00000100:00100000:3.0:1789131170.391870:0:17771:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7b78780 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17771:1876039508916224:192.168.203.11@tcp:104: 00010000:00010000:3.0:1789131170.391899:0:17771:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030200/0xf3fe2838e1fc3bc6 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131170.395251:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789131170.395349:0:17756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498349312 00000100:00100000:1.0:1789131170.395359:0:17756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498349312 00010000:00010000:1.0:1789131170.395399:0:17756:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78dec00/0xf3fe2838e1fc3a99 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269ea4 expref: 16 pid: 17771 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131170.396769:0:17756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 22 00000100:00100000:1.0:1789131170.396786:0:17756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01ad03c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+16:2387:x1876039498349312:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789131170.396804:0:17756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789131170.396814:0:17756:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78dec00/0xf3fe2838e1fc3a99 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269ea4 expref: 16 pid: 17771 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131170.396842:0:17756:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78dec00/0xf3fe2838e1fc3a99 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269ea4 expref: 16 pid: 17771 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131170.396866:0:17756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78dec00/0xf3fe2838e1fc3a99 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269ea4 expref: 16 pid: 17771 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131170.396881:0:17756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91dcc6c0f600) 00010000:00010000:1.0:1789131170.396886:0:17756:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78df800/0xf3fe2838e1fc3b2c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269ed5 expref: 15 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131170.396895:0:17756:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030200/0xf3fe2838e1fc3bc6 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131170.396902:0:17756:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030200/0xf3fe2838e1fc3bc6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131170.396910:0:17756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030200/0xf3fe2838e1fc3bc6 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131170.396941:0:17756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789131170.397011:0:17756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01ad03c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+15:2387:x1876039498349312:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 231us (1769us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131170.397019:0:17756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 22 00010000:00010000:3.0:1789131170.397080:0:17771:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030200/0xf3fe2838e1fc3bc6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131170.397088:0:17771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030200/0xf3fe2838e1fc3bc6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131170.397282:0:17771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030000/0xf3fe2838e1fc3bcd lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131170.397294:0:17771:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4200/0xf3fe2838e1fc3b95 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269ef1 expref: 15 pid: 17772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131170.397302:0:17771:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030000/0xf3fe2838e1fc3bcd lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131170.397331:0:17771:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4200/0xf3fe2838e1fc3b95 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269ef1 expref: 15 pid: 17772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131170.397345:0:17771:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4200/0xf3fe2838e1fc3b95 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269ef1 expref: 15 pid: 17772 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131170.397367:0:17771:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7b78780 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17771:1876039508916352:192.168.203.11@tcp:104: 00000100:00100000:3.0:1789131170.397416:0:17771:0:(client.c:2715:ptlrpc_set_wait()) set ffff91dcc7fab900 going to sleep for 11 seconds 00000100:00100000:0.0:1789131170.401089:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131170.401150:0:17771:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7b78780 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17771:1876039508916352:192.168.203.11@tcp:104: 00010000:00010000:3.0:1789131170.401179:0:17771:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030000/0xf3fe2838e1fc3bcd lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131170.402219:0:17758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498349440 00000100:00100000:2.0:1789131170.402228:0:17758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498349440 00010000:00010000:2.0:1789131170.402286:0:17758:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4200/0xf3fe2838e1fc3b95 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269ef1 expref: 16 pid: 17772 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131170.402328:0:17758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 23 00000100:00100000:2.0:1789131170.402338:0:17758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff4ea450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+16:2388:x1876039498349440:12345-192.168.203.11@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789131170.402351:0:17758:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789131170.402359:0:17758:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4200/0xf3fe2838e1fc3b95 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269ef1 expref: 16 pid: 17772 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131170.402372:0:17758:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4200/0xf3fe2838e1fc3b95 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269ef1 expref: 16 pid: 17772 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131170.402394:0:17758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4200/0xf3fe2838e1fc3b95 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269ef1 expref: 16 pid: 17772 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131170.402410:0:17758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff91dcc7d6c300) 00010000:00010000:2.0:1789131170.402426:0:17758:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030000/0xf3fe2838e1fc3bcd lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131170.402436:0:17758:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030000/0xf3fe2838e1fc3bcd lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131170.402443:0:17758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030000/0xf3fe2838e1fc3bcd lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131170.402484:0:17758:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789131170.402658:0:17758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff4ea450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+15:2388:x1876039498349440:12345-192.168.203.11@tcp:103:ldlm_bl.0 Request processed in 320us (1585us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131170.402665:0:17758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 23 00010000:00010000:2.0:1789131170.403831:0:17771:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030000/0xf3fe2838e1fc3bcd lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131170.403845:0:17771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030000/0xf3fe2838e1fc3bcd lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789131170.403956:0:17771:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000001:00080000:2.0:1789131170.405004:0:17771:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934625 00000001:00080000:2.0:1789131170.405061:0:17771:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934626 00000100:00100000:2.0:1789131170.405338:0:17771:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01ad0780 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:17771:1876039508916480:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1789131170.405401:0:17771:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131170.405578:0:17771:0:(client.c:2715:ptlrpc_set_wait()) set ffff91dcc10f59c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789131170.406242:0:17777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508916480 00000100:00100000:1.0:1789131170.406250:0:17777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508916480 00000100:00100000:1.0:1789131170.406340:0:17777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789131170.406350:0:17777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01ad03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17771:x1876039508916480:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1789131170.406523:0:17777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01ad03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17771:x1876039508916480:12345-0@lo:1000:mdt00_000.0 Request processed in 173us (1119us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131170.406530:0:17777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789131170.406607:0:17771:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01ad0780 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:17771:1876039508916480:0@lo:1000:mdt00_000.0 00000001:00080000:3.0:1789131170.406782:0:17771:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934627 00000100:00100000:3.0:1789131170.406841:0:17771:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7b78780 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:17771:1876039508916608:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1789131170.406875:0:17771:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131170.407679:0:17771:0:(client.c:2715:ptlrpc_set_wait()) set ffff91dcc7fab600 going to sleep for 11 seconds 00000100:00100000:2.0:1789131170.407768:0:18514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508916608 00000100:00100000:2.0:1789131170.407775:0:18514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508916608 00000100:00100000:2.0:1789131170.407808:0:18514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789131170.407816:0:18514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7b7a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17771:x1876039508916608:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1789131170.407999:0:18514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7b7a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:17771:x1876039508916608:12345-0@lo:1000:mdt00_000.0 Request processed in 182us (1121us total) trans 8589934598 rc 0/0 00000100:00100000:2.0:1789131170.408008:0:18514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789131170.408219:0:17771:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7b78780 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:17771:1876039508916608:0@lo:1000:mdt00_000.0 00010000:00010000:3.0:1789131170.408258:0:17771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030000/0xf3fe2838e1fc3bcd lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131170.408268:0:17771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030000/0xf3fe2838e1fc3bcd lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131170.408275:0:17771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030000/0xf3fe2838e1fc3bcd lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131170.408282:0:17771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddc0030000 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:3.0:1789131170.408286:0:17771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030000/0xf3fe2838e1fc3bcd lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131170.408294:0:17771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030000/0xf3fe2838e1fc3bcd lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131170.408319:0:17771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff91dcc7d6c300) 00010000:00010000:3.0:1789131170.408322:0:17771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789131170.408328:0:17771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030000/0xf3fe2838e1fc3bcd lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131170.408335:0:17771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030000/0xf3fe2838e1fc3bcd lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131170.408368:0:17771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030400/0xf3fe2838e1fc3b25 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131170.408374:0:17771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030400/0xf3fe2838e1fc3b25 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131170.408380:0:17771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030400/0xf3fe2838e1fc3b25 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131170.408385:0:17771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddc0030400 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:3.0:1789131170.408387:0:17771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030400/0xf3fe2838e1fc3b25 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131170.408394:0:17771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030400/0xf3fe2838e1fc3b25 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131170.408402:0:17771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91dcc6c0f600) 00010000:00010000:3.0:1789131170.408404:0:17771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789131170.408411:0:17771:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78df800/0xf3fe2838e1fc3b2c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269ed5 expref: 18 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131170.408786:0:17771:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78df800/0xf3fe2838e1fc3b2c lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269ed5 expref: 18 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131170.408806:0:17771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78df800/0xf3fe2838e1fc3b2c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269ed5 expref: 18 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131170.408839:0:17771:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff91dcc78df800/0xf3fe2838e1fc3b2c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269ed5 expref: 18 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131170.408852:0:17771:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc7b78b40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17771:1876039508916736:192.168.203.11@tcp:105: 00000100:00100000:3.0:1789131170.409276:0:17771:0:(client.c:2715:ptlrpc_set_wait()) set ffff91dcc7fab600 going to sleep for 11 seconds 00000100:00100000:0.0:1789131170.413986:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:1.0:1789131170.414059:0:17774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498349568 00000100:00100000:1.0:1789131170.414068:0:17774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498349568 00000100:00100000:1.0:1789131170.414138:0:17774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 12 00000100:00100000:1.0:1789131170.414160:0:17774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff7c30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+19:15956:x1876039498349568:12345-192.168.203.11@tcp:49:bash.0 00000100:00100000:1.0:1789131170.414284:0:17774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff7c30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+19:15956:x1876039498349568:12345-192.168.203.11@tcp:49:bash.0 Request processed in 136us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131170.414292:0:17774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 12 00000100:00100000:3.0:1789131170.416265:0:17771:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc7b78b40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17771:1876039508916736:192.168.203.11@tcp:105: 00010000:00010000:3.0:1789131170.416297:0:17771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030400/0xf3fe2838e1fc3b25 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131170.416309:0:17771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030400/0xf3fe2838e1fc3b25 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131170.416344:0:17771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030e00/0xf3fe2838e1fc3bd4 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131170.416357:0:17771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030e00/0xf3fe2838e1fc3bd4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131170.416368:0:17771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030e00/0xf3fe2838e1fc3bd4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131170.416378:0:17771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030e00/0xf3fe2838e1fc3bd4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131170.416385:0:17771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030e00/0xf3fe2838e1fc3bd4 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131170.416403:0:17771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030e00/0xf3fe2838e1fc3bd4 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131170.416409:0:17771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddc0030e00 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:3.0:1789131170.416525:0:17771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030e00/0xf3fe2838e1fc3bd4 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131170.416535:0:17771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030e00/0xf3fe2838e1fc3bd4 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131170.416548:0:17771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91dcc6c0f600) 00010000:00010000:3.0:1789131170.416552:0:17771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789131170.416556:0:17771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030e00/0xf3fe2838e1fc3bd4 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131170.416562:0:17771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030e00/0xf3fe2838e1fc3bd4 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131170.416572:0:17771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030200/0xf3fe2838e1fc3bc6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131170.416578:0:17771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030200/0xf3fe2838e1fc3bc6 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131170.416584:0:17771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030200/0xf3fe2838e1fc3bc6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131170.416589:0:17771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddc0030200 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:3.0:1789131170.416592:0:17771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030200/0xf3fe2838e1fc3bc6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131170.416610:0:17771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030200/0xf3fe2838e1fc3bc6 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131170.416619:0:17771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91dcc6c0f600) 00010000:00010000:3.0:1789131170.416621:0:17771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789131170.416624:0:17771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030200/0xf3fe2838e1fc3bc6 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131170.416630:0:17771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030200/0xf3fe2838e1fc3bc6 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131170.416833:0:17771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01ad1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+18:15957:x1876039498349184:12345-192.168.203.11@tcp:57:lhsmtool_posix.0 Request processed in 28050us (28418us total) trans 8589934628 rc 0/0 00000100:00100000:3.0:1789131170.416844:0:17771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 70 00000020:00080000:3.0:1789131170.416850:0:17771:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1789131170.419351:0:17805:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789131170.419373:0:17805:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789131170.419410:0:17805:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1789131170.419419:0:17805:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1789131170.420348:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131170.423170:0:19284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498349696 00000100:00100000:3.0:1789131170.423184:0:19284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498349696 00000100:00100000:2.0:1789131170.423399:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131170.423495:0:19284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 27 00000100:00100000:3.0:1789131170.423506:0:19284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01ad2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+7:15956:x1876039498349696:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:3.0:1789131170.423535:0:19284:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789131170.423556:0:19284:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000106c77d5/0xf3fe2838e1fc3bdb lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269f0d expref: -99 pid: 19284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789131170.423581:0:19284:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x6aa3f9a0, atime: 0x6aa3f99f, ctime: 0x6aa3f9a0, blocks: 0x0 00010000:00010000:3.0:1789131170.423602:0:19284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=526s v=(0 0) 00010000:00010000:3.0:1789131170.423606:0:19284:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789131170.423616:0:19284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000106c77d5/0xf3fe2838e1fc3bdb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269f0d expref: 8 pid: 19284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131170.423647:0:19284:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000106c77d5/0xf3fe2838e1fc3bdb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269f0d expref: 8 pid: 19284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131170.423659:0:19284:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ddc0031e00, rc 0) 00000100:00100000:3.0:1789131170.423709:0:19284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01ad2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+8:15956:x1876039498349696:12345-192.168.203.11@tcp:101:bash.0 Request processed in 205us (3368us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131170.423715:0:19284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 27 00000100:00100000:1.0:1789131170.426134:0:17774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498349952 00000100:00100000:1.0:1789131170.426147:0:17774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498349952 00000100:00100000:1.0:1789131170.426262:0:17774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 13 00000100:00100000:1.0:1789131170.426272:0:17774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01ad0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+18:15957:x1876039498349952:12345-192.168.203.11@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1789131170.426906:0:17774:0:(mdd_object.c:4024:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1789131170.426933:0:17774:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934629 00010000:00010000:0.0:1789131170.426977:0:17774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4200/0xf3fe2838e1fc3be2 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131170.426992:0:17774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4200/0xf3fe2838e1fc3be2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131170.427002:0:17774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4200/0xf3fe2838e1fc3be2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131170.427010:0:17774:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4200/0xf3fe2838e1fc3be2 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131170.427017:0:17774:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4200/0xf3fe2838e1fc3be2 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131170.427023:0:17774:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4200/0xf3fe2838e1fc3be2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131170.427044:0:17774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789131170.427242:0:17774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01ad0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+20:15957:x1876039498349952:12345-192.168.203.11@tcp:35:lhsmtool_posix.0 Request processed in 970us (3845us total) trans 8589934630 rc 0/0 00000100:00100000:0.0:1789131170.427255:0:17774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 13 00000020:00080000:0.0:1789131170.427260:0:17774:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789131170.427535:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00010000:00010000:1.0:1789131170.427865:0:19311:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789131170.427872:0:19311:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4200/0xf3fe2838e1fc3be2 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131170.427880:0:19311:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddfd0b4200 already unused, calling callback (ffffffffc0c4e550) 00010000:00010000:1.0:1789131170.427884:0:19311:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4200/0xf3fe2838e1fc3be2 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131170.427892:0:19311:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4200/0xf3fe2838e1fc3be2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131170.427905:0:19311:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff91dcc7d6c300) 00010000:00010000:1.0:1789131170.427908:0:19311:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789131170.427927:0:19311:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4200/0xf3fe2838e1fc3be2 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131170.427933:0:19311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4200/0xf3fe2838e1fc3be2 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17774 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131170.427946:0:19311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789131170.427947:0:19311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789131170.427949:0:19311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789131170.429582:0:19096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498350080 00000100:00100000:3.0:1789131170.429595:0:19096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498350080 00000100:00100000:3.0:1789131170.429663:0:19096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 71 00000100:00100000:3.0:1789131170.429672:0:19096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7b78b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+20:15956:x1876039498350080:12345-192.168.203.11@tcp:101:bash.0 00010000:00010000:3.0:1789131170.429691:0:19096:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789131170.429709:0:19096:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030800/0xf3fe2838e1fc3be9 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269f14 expref: -99 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131170.429740:0:19096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0031400/0xf3fe2838e1fc3bf0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131170.429765:0:19096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0031400/0xf3fe2838e1fc3bf0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131170.429775:0:19096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0031400/0xf3fe2838e1fc3bf0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131170.429888:0:19096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030800/0xf3fe2838e1fc3be9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269f14 expref: 22 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131170.429920:0:19096:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0031400/0xf3fe2838e1fc3bf0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269f14 expref: 21 pid: 19096 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131170.429929:0:19096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91dcc6c0f600) 00010000:00010000:3.0:1789131170.429932:0:19096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789131170.429936:0:19096:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ddc0031400, rc 0) 00000100:00100000:3.0:1789131170.430009:0:19096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7b78b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+21:15956:x1876039498350080:12345-192.168.203.11@tcp:101:bash.0 Request processed in 338us (2476us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131170.430017:0:19096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 71 00000100:00100000:3.0:1789131170.434732:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131170.434880:0:17775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498350336 00000100:00100000:2.0:1789131170.434890:0:17775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498350336 00000100:00100000:2.0:1789131170.434950:0:17775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 14 00000100:00100000:2.0:1789131170.434961:0:17775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7b7b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+21:15956:x1876039498350336:12345-192.168.203.11@tcp:35:bash.0 00000001:00080000:2.0:1789131170.435256:0:17775:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934631 00000001:00080000:2.0:1789131170.436706:0:17775:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934632 00000100:00100000:2.0:1789131170.436857:0:17775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7b7b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+24:15956:x1876039498350336:12345-192.168.203.11@tcp:35:bash.0 Request processed in 1894us (2129us total) trans 8589934633 rc 0/0 00000100:00100000:2.0:1789131170.436881:0:17775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 14 00000020:00080000:2.0:1789131170.436887:0:17775:0:(tgt_main.c:785:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1789131170.566983:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131170.567109:0:17772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498350592 00000100:00100000:0.0:1789131170.567117:0:17772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498350592 00000100:00100000:0.0:1789131170.567172:0:17772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 72 00000100:00100000:0.0:1789131170.567181:0:17772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc5f90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+24:15967:x1876039498350592:12345-192.168.203.11@tcp:101:lfs.0 00010000:00010000:0.0:1789131170.567217:0:17772:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789131170.567239:0:17772:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4400/0xf3fe2838e1fc3bf7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf8eae2996d269f1b expref: -99 pid: 17772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789131170.567332:0:17772:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1789131170.567441:0:17772:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4400/0xf3fe2838e1fc3bf7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269f1b expref: 26 pid: 17772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131170.567454:0:17772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91ddf5c12100) 00010000:00010000:0.0:1789131170.567501:0:17772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789131170.567517:0:17772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddfd0b4400/0xf3fe2838e1fc3bf7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.11@tcp remote: 0xf8eae2996d269f1b expref: 26 pid: 17772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131170.567530:0:17772:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ddfd0b4400, rc 0) 00000100:00100000:0.0:1789131170.567592:0:17772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc5f90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+25:15967:x1876039498350592:12345-192.168.203.11@tcp:101:lfs.0 Request processed in 411us (616us total) trans 8589934634 rc 301/301 00000100:00100000:0.0:1789131170.567599:0:17772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 72 00000100:00100000:1.0:1789131170.573096:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131170.573238:0:19096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498350720 00000100:00100000:3.0:1789131170.573248:0:19096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498350720 00000100:00100000:3.0:1789131170.573307:0:19096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 73 00000100:00100000:3.0:1789131170.573318:0:19096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc5f92d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+25:15967:x1876039498350720:12345-192.168.203.11@tcp:34:lfs.0 00010000:00010000:3.0:1789131170.573390:0:19096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030800/0xf3fe2838e1fc3c05 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131170.573406:0:19096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030800/0xf3fe2838e1fc3c05 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131170.573428:0:19096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030800/0xf3fe2838e1fc3c05 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131170.573445:0:19096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030200/0xf3fe2838e1fc3c0c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131170.573453:0:19096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030200/0xf3fe2838e1fc3c0c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131170.573516:0:19096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030200/0xf3fe2838e1fc3c0c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131170.573589:0:19096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030e00/0xf3fe2838e1fc3c13 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131170.573598:0:19096:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030e00/0xf3fe2838e1fc3c13 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131170.573605:0:19096:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030e00/0xf3fe2838e1fc3c13 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789131170.573654:0:19096:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030e00/0xf3fe2838e1fc3c13 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131170.573666:0:19096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030800/0xf3fe2838e1fc3c05 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131170.573672:0:19096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030800/0xf3fe2838e1fc3c05 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131170.573679:0:19096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030800/0xf3fe2838e1fc3c05 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131170.573685:0:19096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddc0030800 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:3.0:1789131170.573688:0:19096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030800/0xf3fe2838e1fc3c05 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131170.573695:0:19096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030800/0xf3fe2838e1fc3c05 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131170.573707:0:19096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff91dcc7d6cd00) 00010000:00010000:3.0:1789131170.573716:0:19096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789131170.573722:0:19096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030800/0xf3fe2838e1fc3c05 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131170.573728:0:19096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030800/0xf3fe2838e1fc3c05 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131170.573741:0:19096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030200/0xf3fe2838e1fc3c0c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131170.573758:0:19096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030200/0xf3fe2838e1fc3c0c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131170.573764:0:19096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030200/0xf3fe2838e1fc3c0c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131170.573770:0:19096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddc0030200 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:3.0:1789131170.573773:0:19096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030200/0xf3fe2838e1fc3c0c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131170.573779:0:19096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030200/0xf3fe2838e1fc3c0c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131170.573787:0:19096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff91ddc30c6000) 00010000:00010000:3.0:1789131170.573789:0:19096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789131170.573792:0:19096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030200/0xf3fe2838e1fc3c0c lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131170.573797:0:19096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030200/0xf3fe2838e1fc3c0c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131170.573812:0:19096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030e00/0xf3fe2838e1fc3c13 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131170.573824:0:19096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030e00/0xf3fe2838e1fc3c13 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131170.573830:0:19096:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030e00/0xf3fe2838e1fc3c13 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131170.573834:0:19096:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ddc0030e00 already unused, calling callback (ffffffffc185c4f0) 00010000:00010000:3.0:1789131170.573837:0:19096:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030e00/0xf3fe2838e1fc3c13 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131170.573843:0:19096:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030e00/0xf3fe2838e1fc3c13 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131170.573852:0:19096:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91dcc6c0f600) 00010000:00010000:3.0:1789131170.573855:0:19096:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789131170.573858:0:19096:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030e00/0xf3fe2838e1fc3c13 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131170.573863:0:19096:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ddc0030e00/0xf3fe2838e1fc3c13 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19096 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131170.573938:0:19096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc5f92d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+25:15967:x1876039498350720:12345-192.168.203.11@tcp:34:lfs.0 Request processed in 621us (849us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131170.573947:0:19096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 73 00000100:00100000:2.0:1789131170.579566:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:3.0:1789131170.579834:0:17775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498350976 00000100:00100000:3.0:1789131170.579844:0:17775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498350976 00000100:00100000:3.0:1789131170.579898:0:17775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 15 00000100:00100000:3.0:1789131170.579909:0:17775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01ad0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+25:15967:x1876039498350976:12345-192.168.203.11@tcp:35:lfs.0 00000100:00100000:3.0:1789131170.580371:0:17775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01ad0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+26:15967:x1876039498350976:12345-192.168.203.11@tcp:35:lfs.0 Request processed in 462us (812us total) trans 8589934635 rc 0/0 00000100:00100000:3.0:1789131170.580392:0:17775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 15 00010000:00010000:0.0:1789131170.833698:0:17759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789131170.899086:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789131170.899109:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01ad2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508916864:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789131170.899176:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131170.899694:0:18514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508916864 00000100:00100000:2.0:1789131170.899702:0:18514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508916864 00000100:00100000:2.0:1789131170.899762:0:18514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789131170.899774:0:18514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc5f93c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508916864:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789131170.899807:0:18514:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789131170.899864:0:18514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc5f93c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1876039508916864:12345-0@lo:41:osp-pre-1-0.0 Request processed in 93us (687us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131170.899871:0:18514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789131170.899968:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01ad2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1876039508916864:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789131170.904207:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddff7c03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1876039508916992:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789131170.904284:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131170.904509:0:17776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508916992 00000100:00100000:0.0:1789131170.904516:0:17776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508916992 00000100:00100000:0.0:1789131170.904573:0:17776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789131170.904584:0:17776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc7b79680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1876039508916992:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789131170.904620:0:17776:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:0.0:1789131170.904683:0:17776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc7b79680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1876039508916992:12345-0@lo:41:osp-pre-0-1.0 Request processed in 101us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131170.904691:0:17776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789131170.904893:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddff7c03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1876039508916992:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789131171.863050:0:17760:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789131171.866995:0:18526:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789131172.434561:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789131172.434592:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd1df9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1876039508917120:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789131172.434932:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131172.434992:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01ad21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1876039508917248:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789131172.435018:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131172.435057:0:19287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508917120 00000100:00100000:2.0:1789131172.435067:0:19287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508917120 00000100:00080000:1.0:1789131172.435174:0:17767:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789131172.438928:0:19287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508917248 00000100:00100000:2.0:1789131172.438948:0:19287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508917248 00000100:00100000:2.0:1789131172.439010:0:19287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789131172.439023:0:19287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01ad1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3628:x1876039508917120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789131172.439063:0:19287:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:2.0:1789131172.439169:0:19287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01ad1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3628:x1876039508917120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 149us (4237us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131172.439177:0:19287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789131172.439197:0:19287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789131172.439214:0:19287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01ad0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1876039508917248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789131172.439232:0:19287:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1789131172.439265:0:19287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01ad0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1876039508917248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 53us (4246us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131172.439271:0:19287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789131172.439379:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01ad21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1876039508917248:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789131172.439403:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd1df9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1876039508917120:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789131172.439531:0:3625:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01ad21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508917376:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789131172.439572:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131172.439609:0:19287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508917376 00000100:00100000:2.0:1789131172.439614:0:19287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508917376 00000100:00100000:2.0:1789131172.439650:0:19287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789131172.439656:0:19287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91de01ad2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508917376:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789131172.439668:0:19287:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:2.0:1789131172.439698:0:19287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91de01ad2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1876039508917376:12345-0@lo:13:osp-pre-1-1.0 Request processed in 42us (126us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131172.439704:0:19287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789131172.439730:0:3625:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01ad21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3625:1876039508917376:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789131172.440587:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01ad21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:3626:1876039508917504:0@lo:400:kworker.0 00000100:00100000:2.0:1789131172.441082:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131172.441125:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd1daf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1876039508918016:0@lo:400:kworker.0 00000100:00100000:2.0:1789131172.441156:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131172.441179:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc6ffa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3626:1876039508918528:0@lo:400:kworker.0 00000100:00100000:2.0:1789131172.441205:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789131172.441595:0:17767:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789131172.441604:0:17767:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789131172.441633:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01ad2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1876039508917632:0@lo:400:kworker.0 00000100:00100000:1.0:1789131172.441674:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131172.441701:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd1daf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3627:1876039508918144:0@lo:400:kworker.0 00000100:00100000:1.0:1789131172.441749:0:19285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508918016 00000100:00100000:1.0:1789131172.441757:0:19285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508918016 00000100:00100000:1.0:1789131172.441829:0:19285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789131172.441838:0:19285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc6ff83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1876039508918016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789131172.441893:0:19285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc6ff83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1876039508918016:12345-0@lo:400:kworker.0 Request processed in 56us (735us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131172.441901:0:19285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789131172.441930:0:17777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508917632 00000100:00100000:1.0:1789131172.441934:0:17777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508917632 00000100:00100000:1.0:1789131172.441981:0:17777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789131172.441987:0:17777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc5f90f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3627:x1876039508917632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789131172.442026:0:17777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc5f90f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3627:x1876039508917632:12345-0@lo:400:kworker.0 Request processed in 40us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131172.442033:0:17777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:1.0:1789131172.442047:0:17767:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789131172.442387:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd1daf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1876039508918016:0@lo:400:kworker.0 00000100:00100000:2.0:1789131172.442408:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1789131172.442415:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd286d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1876039508917888:0@lo:400:kworker.0 00000100:00100000:2.0:1789131172.442443:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131172.442480:0:3626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd1dade00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3626:1876039508918400:0@lo:400:kworker.0 00000100:00100000:2.0:1789131172.442506:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131172.442537:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91de01ad0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3628:1876039508917760:0@lo:400:kworker.0 00000100:00100000:2.0:1789131172.442562:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131172.442579:0:3628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91ddd1dac780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3628:1876039508918272:0@lo:400:kworker.0 00000100:00100000:2.0:1789131172.442621:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131172.445419:0:17764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508917504 00000100:00100000:3.0:1789131172.445435:0:17764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508917504 00000100:00100000:3.0:1789131172.445539:0:17764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1789131172.445551:0:17764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddfff14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+24:3626:x1876039508917504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789131172.445686:0:17764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddfff14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20+24:3626:x1876039508917504:12345-0@lo:400:kworker.0 Request processed in 137us (4604us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131172.445695:0:17764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1789131172.445751:0:17771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508918528 00000100:00100000:3.0:1789131172.445756:0:17771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508918528 00000100:00100000:3.0:1789131172.445791:0:17771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508918400 00000100:00100000:3.0:1789131172.445794:0:17771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508918400 00000100:00100000:3.0:1789131172.445813:0:17771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508917760 00000100:00100000:3.0:1789131172.445816:0:17771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508917760 00000100:00100000:3.0:1789131172.445828:0:17771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508918272 00000100:00100000:3.0:1789131172.445831:0:17771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508918272 00000100:00100000:3.0:1789131172.445845:0:17771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789131172.445851:0:17771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc6ff9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1876039508918528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789131172.445889:0:17771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc6ff9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1876039508918528:12345-0@lo:400:kworker.0 Request processed in 38us (4682us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131172.445908:0:17771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789131172.445923:0:17771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789131172.445929:0:17771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc6ff92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1876039508918400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789131172.445961:0:17771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc6ff92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1876039508918400:12345-0@lo:400:kworker.0 Request processed in 34us (3456us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131172.445966:0:17771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789131172.445978:0:17771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789131172.445983:0:17771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc6ffa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1876039508917760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789131172.446019:0:17771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc6ffa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1876039508917760:12345-0@lo:400:kworker.0 Request processed in 35us (3455us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131172.446025:0:17771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789131172.446036:0:17771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789131172.446042:0:17771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc6ffad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3628:x1876039508918272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789131172.446071:0:17771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc6ffad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3628:x1876039508918272:12345-0@lo:400:kworker.0 Request processed in 30us (3450us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131172.446076:0:17771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:3.0:1789131172.446129:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91ddd1dade00 x1876039508918400/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789131188 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789131172.446148:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd1dade00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3626:1876039508918400:0@lo:400:kworker.0 00000100:00100000:3.0:1789131172.446161:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01ad21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f81b4fe9-c4c1-47de-84bb-5c7bf0f99d20:3626:1876039508917504:0@lo:400:kworker.0 00000100:00100000:3.0:1789131172.446175:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc6ffa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3626:1876039508918528:0@lo:400:kworker.0 00000100:00100000:3.0:1789131172.446303:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01ad0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3628:1876039508917760:0@lo:400:kworker.0 00000100:00100000:3.0:1789131172.446315:0:3628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd1dac780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3628:1876039508918272:0@lo:400:kworker.0 00000100:00100000:1.0:1789131172.451233:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131172.451313:0:3627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff91dcc6ff9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3627:1876039508918656:0@lo:400:kworker.0 00000100:00100000:1.0:1789131172.451398:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131172.451477:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91de01ad2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1876039508917632:0@lo:400:kworker.0 00000100:00100000:1.0:1789131172.451520:0:18514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508917888 00000100:00100000:1.0:1789131172.451530:0:18514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508917888 00000100:00100000:1.0:1789131172.451585:0:18514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789131172.451596:0:18514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc6ffb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1876039508917888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789131172.451675:0:18514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc6ffb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1876039508917888:12345-0@lo:400:kworker.0 Request processed in 81us (9230us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131172.451683:0:18514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789131172.451712:0:17773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508918144 00000100:00100000:1.0:1789131172.451716:0:17773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508918144 00000100:00100000:1.0:1789131172.451751:0:17773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039508918656 00000100:00100000:1.0:1789131172.451754:0:17773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039508918656 00000100:00100000:1.0:1789131172.451775:0:17773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789131172.451781:0:17773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc5f93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1876039508918144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789131172.451819:0:17773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc5f93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1876039508918144:12345-0@lo:400:kworker.0 Request processed in 38us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131172.451825:0:17773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789131172.451838:0:17773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789131172.451863:0:17773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc5f92940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3627:x1876039508918656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789131172.451894:0:17773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc5f92940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3627:x1876039508918656:12345-0@lo:400:kworker.0 Request processed in 33us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131172.451899:0:17773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:1.0:1789131172.451918:0:17767:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789131172.451923:0:17767:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789131172.451954:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd1daf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3627:1876039508918144:0@lo:400:kworker.0 00010000:00080000:1.0:1789131172.451968:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91dcc6ff9680 x1876039508918656/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789131188 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789131172.451979:0:3627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91dcc6ff9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3627:1876039508918656:0@lo:400:kworker.0 00000100:00100000:1.0:1789131172.452010:0:3626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff91ddd286d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1876039508917888:0@lo:400:kworker.0 00000001:02000400:1.0:1789131172.599040:0:20958:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: /mnt/lustre/d1c.sanity-pcc/f1c.sanity-pcc expected pcc state: readwrite, but got: none 00000100:00100000:0.0:1789131172.706898:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131172.706955:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131172.706991:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131172.707018:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131172.707041:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131172.707060:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131172.707134:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131172.707153:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131172.707180:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131172.707213:0:19283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498351616 00000100:00100000:0.0:1789131172.707225:0:19283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498351616 00000100:00100000:0.0:1789131172.707296:0:19283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498352128 00000100:00100000:0.0:1789131172.707299:0:19283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498352128 00000100:00100000:0.0:1789131172.707314:0:19283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498351488 00000100:00100000:0.0:1789131172.707317:0:19283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498351488 00000100:00100000:0.0:1789131172.707331:0:19283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498352000 00000100:00100000:0.0:1789131172.707334:0:19283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498352000 00000100:00100000:0.0:1789131172.707353:0:19283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 23 00000100:00100000:0.0:1789131172.707363:0:19283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff7c1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+8:2388:x1876039498351616:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1789131172.707554:0:17773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498351360 00000100:00100000:1.0:1789131172.707559:0:17773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498351360 00000100:00100000:1.0:1789131172.707600:0:17773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498351872 00000100:00100000:1.0:1789131172.707604:0:17773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498351872 00000100:00100000:1.0:1789131172.707618:0:17773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498351232 00000100:00100000:1.0:1789131172.707620:0:17773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498351232 00000100:00100000:1.0:1789131172.707634:0:17773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498351744 00000100:00100000:1.0:1789131172.707636:0:17773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498351744 00000100:00100000:1.0:1789131172.707650:0:17773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 62 00000100:00100000:1.0:1789131172.707658:0:17773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff7c21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+5:2388:x1876039498351360:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1789131172.707694:0:17773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff7c21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+5:2388:x1876039498351360:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 37us (739us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131172.707742:0:17773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 62 00000100:00100000:1.0:1789131172.707764:0:17773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 63 00000100:00100000:1.0:1789131172.707780:0:17773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff7c03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:014f7d38-34be-4f2e-b715-3fbda0147a70+5:2388:x1876039498351872:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1789131172.707809:0:17773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff7c03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:014f7d38-34be-4f2e-b715-3fbda0147a70+5:2388:x1876039498351872:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 30us (790us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131172.707815:0:17773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 63 00000100:00100000:1.0:1789131172.707828:0:17773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 64 00000100:00100000:1.0:1789131172.707835:0:17773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff7c1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+26:2388:x1876039498351232:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1789131172.707867:0:17773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff7c1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+26:2388:x1876039498351232:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 33us (805us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131172.707873:0:17773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 64 00000100:00100000:1.0:1789131172.707884:0:17773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 65 00000100:00100000:1.0:1789131172.707890:0:17773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddca22a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:014f7d38-34be-4f2e-b715-3fbda0147a70+6:2388:x1876039498351744:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:1.0:1789131172.707917:0:17773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddca22a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:014f7d38-34be-4f2e-b715-3fbda0147a70+6:2388:x1876039498351744:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 26us (762us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131172.707922:0:17773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 65 00000100:00100000:3.0:1789131172.708243:0:17766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498351104 00000100:00100000:3.0:1789131172.708248:0:17766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498351104 00000100:00100000:3.0:1789131172.708284:0:17766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 167 00000100:00100000:3.0:1789131172.708292:0:17766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddfff15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22edf929-4c0f-42f3-973d-fe4d92543efa+13:2388:x1876039498351104:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1789131172.708322:0:17766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddfff15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:22edf929-4c0f-42f3-973d-fe4d92543efa+13:2388:x1876039498351104:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 32us (1440us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131172.708328:0:17766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 167 00000100:00100000:3.0:1789131172.708364:0:19284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 24 00000100:00100000:3.0:1789131172.708373:0:19284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddff7c0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:014f7d38-34be-4f2e-b715-3fbda0147a70+5:2388:x1876039498352128:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1789131172.708400:0:19284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff7c0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:014f7d38-34be-4f2e-b715-3fbda0147a70+5:2388:x1876039498352128:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 29us (1358us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131172.708405:0:19284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 24 00000100:00100000:3.0:1789131172.708423:0:19284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 25 00000100:00100000:3.0:1789131172.708429:0:19284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddca228b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+5:2388:x1876039498351488:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:3.0:1789131172.708453:0:19284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddca228b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+5:2388:x1876039498351488:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 25us (1320us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131172.708478:0:19284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 25 00000100:00100000:0.0:1789131172.709627:0:19283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddff7c1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+8:2388:x1876039498351616:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 121us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131172.714897:0:19283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 23 00000100:00100000:0.0:1789131172.714959:0:19283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 26 00000100:00100000:0.0:1789131172.714978:0:19283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91ddca22a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:014f7d38-34be-4f2e-b715-3fbda0147a70+5:2388:x1876039498352000:12345-192.168.203.11@tcp:400:kworker.0 00000100:00100000:0.0:1789131172.715108:0:19283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91ddca22a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:014f7d38-34be-4f2e-b715-3fbda0147a70+5:2388:x1876039498352000:12345-192.168.203.11@tcp:400:kworker.0 Request processed in 138us (7924us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131172.715116:0:19283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 26 00000100:00080000:0.0:1789131172.715169:0:17767:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789131172.715188:0:17767:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789131172.715193:0:17767:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789131172.715197:0:17767:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1789131172.883942:0:19311:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789131173.752663:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:2.0:1789131173.752799:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.11@tcp (source: 12345-192.168.203.11@tcp) 00000100:00100000:0.0:1789131173.753812:0:19288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498352256 00000100:00100000:0.0:1789131173.753828:0:19288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498352256 00002000:00100000:0.0:1789131173.753891:0:19288:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x22:0x0] (0->8) req@ffff91dcc6ffbc00 x1876039498352256/t0(0) o4->10a3c9cb-0ead-44d0-a06d-1a07b352d8a9@192.168.203.11@tcp:134/0 lens 504/0 e 0 to 0 dl 1789131184 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:0.0:1789131173.753904:0:19288:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff91dcc6ffbc00 with x1876039498352256 ext(0->8) 00002000:00010000:0.0:1789131173.753912:0:19288:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91dcc6ffbc00 00000100:00100000:0.0:1789131173.753960:0:19288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 0 00000100:00100000:0.0:1789131173.753971:0:19288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc6ffbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+8:2386:x1876039498352256:12345-192.168.203.11@tcp:4:bash.0 00000100:00100000:1.0:1789131173.757550:0:19283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039498352384 00000100:00100000:1.0:1789131173.757568:0:19283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039498352384 00000100:00100000:1.0:1789131173.757662:0:19283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.11@tcp, seq: 28 00000100:00100000:1.0:1789131173.757674:0:19283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91dcc6ffa1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+9:2385:x1876039498352384:12345-192.168.203.11@tcp:16:kworker.0 00000100:00100000:1.0:1789131173.757843:0:19283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc6ffa1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+9:2385:x1876039498352384:12345-192.168.203.11@tcp:16:kworker.0 Request processed in 171us (5043us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131173.757852:0:19283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 28 00000100:00100000:0.0:1789131173.766210:0:19288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91dcc6ffbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:10a3c9cb-0ead-44d0-a06d-1a07b352d8a9+10:2386:x1876039498352256:12345-192.168.203.11@tcp:4:bash.0 Request processed in 12223us (13544us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1789131173.766295:0:19288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.11@tcp, seq: 0 00002000:00100000:0.0:1789131173.766316:0:19288:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x22:0x0] (0->8) req@ffff91dcc6ffbc00 x1876039498352256/t8589934599(0) o4->10a3c9cb-0ead-44d0-a06d-1a07b352d8a9@192.168.203.11@tcp:134/0 lens 504/448 e 0 to 0 dl 1789131184 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:0.0:1789131173.766328:0:19288:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff91dcc6ffbc00 with x1876039498352256 ext(0->8) 00002000:00010000:0.0:1789131173.766336:0:19288:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91dcc6ffbc00 00010000:00010000:0.0:1789131173.906117:0:17759:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 44713 lines, 44713 kept, 0 dropped, 0 bad.